Trace number 3693711

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
SCIP spx standard SCIP 2.1.1.4. with SoPlex 1.6.0.3 standard fixed? (TO) 1802.11 1802.4

General information on the benchmark

Name/OPT-SMALLINT-LIN/sroussel/NG/
normalized-NG.dot_luby_10null20mast_rapportOE1.0_TMAX300_K192_cod2.opb
MD5SUMecfb37e57149da15322fff965cafdd0d
Bench CategoryOPT-SMALLINT-LIN (optimisation, small integers, linear constraints)
Best result obtained on this benchmarkOPT
Best value of the objective obtained on this benchmark-60544
Best CPU time to get the best result obtained on this benchmark1010.68
Has Objective FunctionYES
Satisfiable
(Un)Satisfiability was proved
Best value of the objective function
Optimality of the best value was proved
Number of variables400896
Total number of constraints402763
Number of constraints which are clauses400785
Number of constraints which are cardinality constraints (but not clauses)194
Number of constraints which are nor clauses,nor cardinality constraints1784
Minimum length of a constraint2
Maximum length of a constraint58023
Number of terms in the objective function 1605
Biggest coefficient in the objective function 1024
Number of bits for the biggest coefficient in the objective function 11
Sum of the numbers in the objective function 370126
Number of bits of the sum of numbers in the objective function 19
Biggest number in a constraint 1024
Number of bits of the biggest number in a constraint 11
Biggest sum of numbers in a constraint 370126
Number of bits of the biggest sum of numbers19
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Solver Data

0.00/0.00	c SCIP version 2.1.1.4 [precision: 8 byte] [memory: block] [mode: optimized] [LP solver: SoPlex 1.6.0.3] [GitHash: a3bf3a4-dirty]
0.00/0.00	c Copyright (c) 2002-2012 Konrad-Zuse-Zentrum fuer Informationstechnik Berlin (ZIB)
0.00/0.00	c 
0.00/0.00	c user parameter file <scip.set> not found - using default parameters
0.00/0.00	c reading problem <HOME/instance-3693711-1338047070.opb>
1.98/2.09	c original problem has 400896 variables (400896 bin, 0 int, 0 impl, 0 cont) and 402763 constraints
1.98/2.09	c problem read in 2.09
4.68/4.70	c presolving:
8.38/8.49	c (round 1) 0 del vars, 1977 del conss, 0 add conss, 0 chg bounds, 0 chg sides, 0 chg coeffs, 398809 upgd conss, 67806 impls, 1977 clqs
9.49/9.58	c (round 2) 0 del vars, 1977 del conss, 0 add conss, 0 chg bounds, 0 chg sides, 0 chg coeffs, 400786 upgd conss, 67806 impls, 1977 clqs

Verifier Data

ERROR: no interpretation found !

Watcher Data

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.1 (svn: 989)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3693711-1338047070/watcher-3693711-1338047070 -o /tmp/evaluation-result-3693711-1338047070/solver-3693711-1338047070 -C 1800 -W 1900 -M 15500 HOME/scip-2.1.1.4sfix.linux.x86_64.gnu.opt.spx -f HOME/instance-3693711-1338047070.opb -t 1800 -m 15500 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1900 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 2.00 2.00 2.00 3/176 1299
/proc/meminfo: memFree=26978052/32873648 swapFree=7372/7372
[pid=1299] ppid=1297 vsize=6724 CPUtime=0 cores=1,3,5,7
/proc/1299/stat : 1299 (scip-2.1.1.4sfi) R 1297 1299 31092 0 -1 4202496 575 0 0 0 0 0 0 0 20 0 1 0 270833037 6885376 529 33554432000 4194304 10169799 140734377066848 140733533379752 8723904 0 0 4096 0 0 0 0 17 1 0 0 0 0 0
/proc/1299/statm: 1682 538 370 1459 0 214 0

[startup+0.024379 s]
/proc/loadavg: 2.00 2.00 2.00 3/176 1299
/proc/meminfo: memFree=26978052/32873648 swapFree=7372/7372
[pid=1299] ppid=1297 vsize=19604 CPUtime=0.01 cores=1,3,5,7
/proc/1299/stat : 1299 (scip-2.1.1.4sfi) R 1297 1299 31092 0 -1 4202496 3665 0 0 0 1 0 0 0 20 0 1 0 270833037 20074496 3619 33554432000 4194304 10169799 140734377066848 140733533379752 8982256 0 0 4096 0 0 0 0 17 1 0 0 0 0 0
/proc/1299/statm: 5157 3619 412 1459 0 3689 0
Current children cumulated CPU time (s) 0.01
Current children cumulated vsize (KiB) 19604

[startup+0.100378 s]
/proc/loadavg: 2.00 2.00 2.00 3/176 1299
/proc/meminfo: memFree=26978052/32873648 swapFree=7372/7372
[pid=1299] ppid=1297 vsize=43528 CPUtime=0.09 cores=1,3,5,7
/proc/1299/stat : 1299 (scip-2.1.1.4sfi) R 1297 1299 31092 0 -1 4202496 9642 0 0 0 8 1 0 0 20 0 1 0 270833037 44572672 9596 33554432000 4194304 10169799 140734377066848 140733533379752 8982256 0 0 4096 0 0 0 0 17 1 0 0 0 0 0
/proc/1299/statm: 10882 9596 412 1459 0 9414 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 43528

[startup+0.300285 s]
/proc/loadavg: 2.00 2.00 2.00 3/176 1299
/proc/meminfo: memFree=26978052/32873648 swapFree=7372/7372
[pid=1299] ppid=1297 vsize=85384 CPUtime=0.29 cores=1,3,5,7
/proc/1299/stat : 1299 (scip-2.1.1.4sfi) R 1297 1299 31092 0 -1 4202496 19932 0 0 0 27 2 0 0 20 0 1 0 270833037 87433216 19888 33554432000 4194304 10169799 140734377066848 140734376933176 7543003 0 0 4096 0 0 0 0 17 1 0 0 0 0 0
/proc/1299/statm: 21346 19922 412 1459 0 19878 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 85384

[startup+0.700281 s]
/proc/loadavg: 2.00 2.00 2.00 3/176 1299
/proc/meminfo: memFree=26978052/32873648 swapFree=7372/7372
[pid=1299] ppid=1297 vsize=190484 CPUtime=0.69 cores=1,3,5,7
/proc/1299/stat : 1299 (scip-2.1.1.4sfi) R 1297 1299 31092 0 -1 4202496 46270 0 0 0 63 6 0 0 20 0 1 0 270833037 195055616 46224 33554432000 4194304 10169799 140734377066848 140734376933176 5282286 0 0 4096 0 0 0 0 17 1 0 0 0 0 0
/proc/1299/statm: 47621 46224 412 1459 0 46153 0
Current children cumulated CPU time (s) 0.69
Current children cumulated vsize (KiB) 190484

[startup+1.50029 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 1300
/proc/meminfo: memFree=26718016/32873648 swapFree=7372/7372
[pid=1299] ppid=1297 vsize=387728 CPUtime=1.48 cores=1,3,5,7
/proc/1299/stat : 1299 (scip-2.1.1.4sfi) R 1297 1299 31092 0 -1 4202496 95547 0 0 0 135 13 0 0 20 0 1 0 270833037 397033472 95501 33554432000 4194304 10169799 140734377066848 140734376932504 7139024 0 0 4096 0 0 0 0 17 1 0 0 0 0 0
/proc/1299/statm: 96932 95501 412 1459 0 95464 0
Current children cumulated CPU time (s) 1.48
Current children cumulated vsize (KiB) 387728

[startup+3.10033 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 1300
/proc/meminfo: memFree=26544640/32873648 swapFree=7372/7372
[pid=1299] ppid=1297 vsize=935636 CPUtime=3.08 cores=1,3,5,7
/proc/1299/stat : 1299 (scip-2.1.1.4sfi) R 1297 1299 31092 0 -1 4202496 230944 0 0 0 276 32 0 0 20 0 1 0 270833037 958091264 232377 33554432000 4194304 10169799 140734377066848 140734377063832 5757893 0 0 4096 16384 0 0 0 17 1 0 0 0 0 0
/proc/1299/statm: 233909 232377 490 1459 0 232441 0
Current children cumulated CPU time (s) 3.08
Current children cumulated vsize (KiB) 935636

[startup+6.30029 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 1300
/proc/meminfo: memFree=25745320/32873648 swapFree=7372/7372
[pid=1299] ppid=1297 vsize=1341908 CPUtime=6.28 cores=1,3,5,7
/proc/1299/stat : 1299 (scip-2.1.1.4sfi) R 1297 1299 31092 0 -1 4202496 355694 0 0 0 563 65 0 0 20 0 1 0 270833037 1374113792 332696 33554432000 4194304 10169799 140734377066848 140734377065000 8961143 0 0 4096 16384 0 0 0 17 1 0 0 0 0 0
/proc/1299/statm: 335477 332696 555 1459 0 334009 0
Current children cumulated CPU time (s) 6.28
Current children cumulated vsize (KiB) 1341908

[startup+12.7003 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 1300
/proc/meminfo: memFree=25090980/32873648 swapFree=7372/7372
[pid=1299] ppid=1297 vsize=1902508 CPUtime=12.69 cores=1,3,5,7
/proc/1299/stat : 1299 (scip-2.1.1.4sfi) R 1297 1299 31092 0 -1 4202496 508390 0 0 0 1146 123 0 0 20 0 1 0 270833037 1948168192 471241 33554432000 4194304 10169799 140734377066848 140734377063496 8922310 0 0 4096 16384 0 0 0 17 1 0 0 0 0 0
/proc/1299/statm: 475627 471241 609 1459 0 474159 0
Current children cumulated CPU time (s) 12.69
Current children cumulated vsize (KiB) 1902508

[startup+25.5003 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 1300
/proc/meminfo: memFree=25082548/32873648 swapFree=7372/7372
[pid=1299] ppid=1297 vsize=1910124 CPUtime=25.48 cores=1,3,5,7
/proc/1299/stat : 1299 (scip-2.1.1.4sfi) R 1297 1299 31092 0 -1 4202496 509648 0 0 0 2425 123 0 0 20 0 1 0 270833037 1955966976 473010 33554432000 4194304 10169799 140734377066848 140734377063368 8922316 0 0 4096 16384 0 0 0 17 1 0 0 0 0 0
/proc/1299/statm: 477531 473010 609 1459 0 476063 0
Current children cumulated CPU time (s) 25.48
Current children cumulated vsize (KiB) 1910124

[startup+51.1002 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 1300
/proc/meminfo: memFree=24966312/32873648 swapFree=7372/7372
[pid=1299] ppid=1297 vsize=1914028 CPUtime=51.08 cores=1,3,5,7
/proc/1299/stat : 1299 (scip-2.1.1.4sfi) R 1297 1299 31092 0 -1 4202496 510708 0 0 0 4985 123 0 0 20 0 1 0 270833037 1959964672 474070 33554432000 4194304 10169799 140734377066848 140734377064376 8922295 0 0 4096 16384 0 0 0 17 3 0 0 0 0 0
/proc/1299/statm: 478507 474070 609 1459 0 477039 0
Current children cumulated CPU time (s) 51.08
Current children cumulated vsize (KiB) 1914028

[startup+102.307 s]
/proc/loadavg: 2.07 2.02 2.00 3/177 1300
/proc/meminfo: memFree=24510104/32873648 swapFree=7372/7372
[pid=1299] ppid=1297 vsize=2391320 CPUtime=102.27 cores=1,3,5,7
/proc/1299/stat : 1299 (scip-2.1.1.4sfi) R 1297 1299 31092 0 -1 4202496 627462 0 0 0 10089 138 0 0 20 0 1 0 270833037 2448711680 589999 33554432000 4194304 10169799 140734377066848 140734377063112 7432582 0 0 4096 16384 0 0 0 17 3 0 0 0 0 0
/proc/1299/statm: 597830 589999 609 1459 0 596362 0
Current children cumulated CPU time (s) 102.27
Current children cumulated vsize (KiB) 2391320

[startup+162.3 s]
/proc/loadavg: 2.02 2.01 2.00 3/177 1301
/proc/meminfo: memFree=23603868/32873648 swapFree=7372/7372
[pid=1299] ppid=1297 vsize=3309008 CPUtime=162.26 cores=1,3,5,7
/proc/1299/stat : 1299 (scip-2.1.1.4sfi) R 1297 1299 31092 0 -1 4202496 832812 0 0 0 16060 166 0 0 20 0 1 0 270833037 3388424192 813514 33554432000 4194304 10169799 140734377066848 140734377063112 8922285 0 0 4096 16384 0 0 0 17 3 0 0 0 0 0
/proc/1299/statm: 827252 813514 609 1459 0 825784 0
Current children cumulated CPU time (s) 162.26
Current children cumulated vsize (KiB) 3309008

[startup+222.3 s]
/proc/loadavg: 2.01 2.00 2.00 3/177 1301
/proc/meminfo: memFree=23596956/32873648 swapFree=7372/7372
[pid=1299] ppid=1297 vsize=3310032 CPUtime=222.25 cores=1,3,5,7
/proc/1299/stat : 1299 (scip-2.1.1.4sfi) R 1297 1299 31092 0 -1 4202496 833288 0 0 0 22059 166 0 0 20 0 1 0 270833037 3389472768 813990 33554432000 4194304 10169799 140734377066848 140734377063112 8922280 0 0 4096 16384 0 0 0 17 3 0 0 0 0 0
/proc/1299/statm: 827508 813990 609 1459 0 826040 0
Current children cumulated CPU time (s) 222.25
Current children cumulated vsize (KiB) 3310032

[startup+282.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 1301
/proc/meminfo: memFree=23580804/32873648 swapFree=7372/7372
[pid=1299] ppid=1297 vsize=3313104 CPUtime=282.24 cores=1,3,5,7
/proc/1299/stat : 1299 (scip-2.1.1.4sfi) R 1297 1299 31092 0 -1 4202496 834308 0 0 0 28058 166 0 0 20 0 1 0 270833037 3392618496 815010 33554432000 4194304 10169799 140734377066848 140734377063112 8922285 0 0 4096 16384 0 0 0 17 3 0 0 0 0 0
/proc/1299/statm: 828276 815010 609 1459 0 826808 0
Current children cumulated CPU time (s) 282.24
Current children cumulated vsize (KiB) 3313104

[startup+342.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/178 1304
/proc/meminfo: memFree=23579216/32873648 swapFree=7372/7372
[pid=1299] ppid=1297 vsize=3313104 CPUtime=342.23 cores=1,3,5,7
/proc/1299/stat : 1299 (scip-2.1.1.4sfi) R 1297 1299 31092 0 -1 4202496 834532 0 0 0 34057 166 0 0 20 0 1 0 270833037 3392618496 815234 33554432000 4194304 10169799 140734377066848 140734377063112 8922295 0 0 4096 16384 0 0 0 17 3 0 0 0 0 0
/proc/1299/statm: 828276 815234 609 1459 0 826808 0
Current children cumulated CPU time (s) 342.23
Current children cumulated vsize (KiB) 3313104

[startup+402.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 1304
/proc/meminfo: memFree=23573548/32873648 swapFree=7372/7372
[pid=1299] ppid=1297 vsize=3313996 CPUtime=402.22 cores=1,3,5,7
/proc/1299/stat : 1299 (scip-2.1.1.4sfi) R 1297 1299 31092 0 -1 4202496 835010 0 0 0 40056 166 0 0 20 0 1 0 270833037 3393531904 815679 33554432000 4194304 10169799 140734377066848 140734377063640 8922290 0 0 4096 16384 0 0 0 17 3 0 0 0 0 0
/proc/1299/statm: 828499 815679 609 1459 0 827031 0
Current children cumulated CPU time (s) 402.22
Current children cumulated vsize (KiB) 3313996

[startup+462.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 1305
/proc/meminfo: memFree=23569512/32873648 swapFree=7372/7372
[pid=1299] ppid=1297 vsize=3315852 CPUtime=462.21 cores=1,3,5,7
/proc/1299/stat : 1299 (scip-2.1.1.4sfi) R 1297 1299 31092 0 -1 4202496 835694 0 0 0 46054 167 0 0 20 0 1 0 270833037 3395432448 816363 33554432000 4194304 10169799 140734377066848 140734377063112 8922280 0 0 4096 16384 0 0 0 17 3 0 0 0 0 0
/proc/1299/statm: 828963 816363 609 1459 0 827495 0
Current children cumulated CPU time (s) 462.21
Current children cumulated vsize (KiB) 3315852

[startup+522.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 1305
/proc/meminfo: memFree=23569120/32873648 swapFree=7372/7372
[pid=1299] ppid=1297 vsize=3315852 CPUtime=522.2 cores=1,3,5,7
/proc/1299/stat : 1299 (scip-2.1.1.4sfi) R 1297 1299 31092 0 -1 4202496 835915 0 0 0 52053 167 0 0 20 0 1 0 270833037 3395432448 816583 33554432000 4194304 10169799 140734377066848 140734377063112 8922300 0 0 4096 16384 0 0 0 17 3 0 0 0 0 0
/proc/1299/statm: 828963 816583 609 1459 0 827495 0
Current children cumulated CPU time (s) 522.2
Current children cumulated vsize (KiB) 3315852

[startup+582.3 s]
/proc/loadavg: 2.11 2.03 2.01 3/177 1305
/proc/meminfo: memFree=23567164/32873648 swapFree=7372/7372
[pid=1299] ppid=1297 vsize=3316876 CPUtime=582.19 cores=1,3,5,7
/proc/1299/stat : 1299 (scip-2.1.1.4sfi) R 1297 1299 31092 0 -1 4202496 836392 0 0 0 58052 167 0 0 20 0 1 0 270833037 3396481024 817059 33554432000 4194304 10169799 140734377066848 140734377063112 8922341 0 0 4096 16384 0 0 0 17 3 0 0 0 0 0
/proc/1299/statm: 829219 817059 609 1459 0 827751 0
Current children cumulated CPU time (s) 582.19
Current children cumulated vsize (KiB) 3316876

[startup+642.3 s]

################
# More data... #
################

/proc/1299/stat : 1299 (scip-2.1.1.4sfi) R 1297 1299 31092 0 -1 4202496 841028 0 0 0 106043 169 0 0 20 0 1 0 270833037 3407876096 825311 33554432000 4194304 10169799 140734377066848 140734377063112 8922268 0 0 4096 16384 0 0 0 17 3 0 0 0 0 0
/proc/1299/statm: 832001 825311 609 1459 0 830533 0
Current children cumulated CPU time (s) 1062.12
Current children cumulated vsize (KiB) 3328004

[startup+1122.3 s]
/proc/loadavg: 2.02 2.02 2.00 3/177 1332
/proc/meminfo: memFree=23530100/32873648 swapFree=7372/7372
[pid=1299] ppid=1297 vsize=3330052 CPUtime=1122.11 cores=1,3,5,7
/proc/1299/stat : 1299 (scip-2.1.1.4sfi) R 1297 1299 31092 0 -1 4202496 841771 0 0 0 112042 169 0 0 20 0 1 0 270833037 3409973248 826144 33554432000 4194304 10169799 140734377066848 140734377063112 8922290 0 0 4096 16384 0 0 0 17 3 0 0 0 0 0
/proc/1299/statm: 832513 826144 609 1459 0 831045 0
Current children cumulated CPU time (s) 1122.11
Current children cumulated vsize (KiB) 3330052

[startup+1182.3 s]
/proc/loadavg: 2.07 2.03 2.00 3/177 1375
/proc/meminfo: memFree=24152728/32873648 swapFree=7372/7372
[pid=1299] ppid=1297 vsize=3331076 CPUtime=1182.11 cores=1,3,5,7
/proc/1299/stat : 1299 (scip-2.1.1.4sfi) R 1297 1299 31092 0 -1 4202496 842267 0 0 0 118041 170 0 0 20 0 1 0 270833037 3411021824 826749 33554432000 4194304 10169799 140734377066848 140734377063112 8922290 0 0 4096 16384 0 0 0 17 3 0 0 0 0 0
/proc/1299/statm: 832769 826749 609 1459 0 831301 0
Current children cumulated CPU time (s) 1182.11
Current children cumulated vsize (KiB) 3331076

[startup+1242.3 s]
/proc/loadavg: 2.02 2.02 2.00 3/177 1375
/proc/meminfo: memFree=24014824/32873648 swapFree=7372/7372
[pid=1299] ppid=1297 vsize=3332932 CPUtime=1242.1 cores=1,3,5,7
/proc/1299/stat : 1299 (scip-2.1.1.4sfi) R 1297 1299 31092 0 -1 4202496 842971 0 0 0 124040 170 0 0 20 0 1 0 270833037 3412922368 827453 33554432000 4194304 10169799 140734377066848 140734377063112 8922316 0 0 4096 16384 0 0 0 17 3 0 0 0 0 0
/proc/1299/statm: 833233 827453 609 1459 0 831765 0
Current children cumulated CPU time (s) 1242.1
Current children cumulated vsize (KiB) 3332932

[startup+1302.3 s]
/proc/loadavg: 2.01 2.02 2.00 3/177 1375
/proc/meminfo: memFree=24010944/32873648 swapFree=7372/7372
[pid=1299] ppid=1297 vsize=3332800 CPUtime=1302.09 cores=1,3,5,7
/proc/1299/stat : 1299 (scip-2.1.1.4sfi) R 1297 1299 31092 0 -1 4202496 843215 0 0 0 130039 170 0 0 20 0 1 0 270833037 3412787200 827664 33554432000 4194304 10169799 140734377066848 140734377063432 8922310 0 0 4096 16384 0 0 0 17 3 0 0 0 0 0
/proc/1299/statm: 833200 827664 609 1459 0 831732 0
Current children cumulated CPU time (s) 1302.09
Current children cumulated vsize (KiB) 3332800

[startup+1362.3 s]
/proc/loadavg: 2.03 2.03 2.00 3/176 1375
/proc/meminfo: memFree=23995688/32873648 swapFree=7372/7372
[pid=1299] ppid=1297 vsize=3334848 CPUtime=1362.07 cores=1,3,5,7
/proc/1299/stat : 1299 (scip-2.1.1.4sfi) R 1297 1299 31092 0 -1 4202496 843938 0 0 0 136037 170 0 0 20 0 1 0 270833037 3414884352 829280 33554432000 4194304 10169799 140734377066848 140734377063112 8922305 0 0 4096 16384 0 0 0 17 3 0 0 0 0 0
/proc/1299/statm: 833712 829280 609 1459 0 832244 0
Current children cumulated CPU time (s) 1362.07
Current children cumulated vsize (KiB) 3334848

[startup+1422.31 s]
/proc/loadavg: 2.01 2.02 2.00 3/177 1376
/proc/meminfo: memFree=23989728/32873648 swapFree=7372/7372
[pid=1299] ppid=1297 vsize=3335872 CPUtime=1422.07 cores=1,3,5,7
/proc/1299/stat : 1299 (scip-2.1.1.4sfi) R 1297 1299 31092 0 -1 4202496 844309 0 0 0 142037 170 0 0 20 0 1 0 270833037 3415932928 830507 33554432000 4194304 10169799 140734377066848 140734377063112 8922316 0 0 4096 16384 0 0 0 17 3 0 0 0 0 0
/proc/1299/statm: 833968 830507 609 1459 0 832500 0
Current children cumulated CPU time (s) 1422.07
Current children cumulated vsize (KiB) 3335872

[startup+1482.3 s]
/proc/loadavg: 2.00 2.01 2.00 3/177 1376
/proc/meminfo: memFree=23985364/32873648 swapFree=7372/7372
[pid=1299] ppid=1297 vsize=3338752 CPUtime=1482.05 cores=1,3,5,7
/proc/1299/stat : 1299 (scip-2.1.1.4sfi) R 1297 1299 31092 0 -1 4202496 845069 0 0 0 148035 170 0 0 20 0 1 0 270833037 3418882048 831440 33554432000 4194304 10169799 140734377066848 140734377063112 8922285 0 0 4096 16384 0 0 0 17 3 0 0 0 0 0
/proc/1299/statm: 834688 831440 609 1459 0 833220 0
Current children cumulated CPU time (s) 1482.05
Current children cumulated vsize (KiB) 3338752

[startup+1542.3 s]
/proc/loadavg: 2.00 2.01 2.00 3/178 1379
/proc/meminfo: memFree=23982692/32873648 swapFree=7372/7372
[pid=1299] ppid=1297 vsize=3338752 CPUtime=1542.04 cores=1,3,5,7
/proc/1299/stat : 1299 (scip-2.1.1.4sfi) R 1297 1299 31092 0 -1 4202496 845109 0 0 0 154034 170 0 0 20 0 1 0 270833037 3418882048 831480 33554432000 4194304 10169799 140734377066848 140734377063112 8922300 0 0 4096 16384 0 0 0 17 3 0 0 0 0 0
/proc/1299/statm: 834688 831480 609 1459 0 833220 0
Current children cumulated CPU time (s) 1542.04
Current children cumulated vsize (KiB) 3338752

[startup+1602.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 1379
/proc/meminfo: memFree=23981540/32873648 swapFree=7372/7372
[pid=1299] ppid=1297 vsize=3339776 CPUtime=1602.03 cores=1,3,5,7
/proc/1299/stat : 1299 (scip-2.1.1.4sfi) R 1297 1299 31092 0 -1 4202496 845405 0 0 0 160033 170 0 0 20 0 1 0 270833037 3419930624 831776 33554432000 4194304 10169799 140734377066848 140734377063112 8922351 0 0 4096 16384 0 0 0 17 3 0 0 0 0 0
/proc/1299/statm: 834944 831776 609 1459 0 833476 0
Current children cumulated CPU time (s) 1602.03
Current children cumulated vsize (KiB) 3339776

[startup+1662.3 s]
/proc/loadavg: 2.03 2.01 2.00 3/177 1379
/proc/meminfo: memFree=23979896/32873648 swapFree=7372/7372
[pid=1299] ppid=1297 vsize=3341632 CPUtime=1662.02 cores=1,3,5,7
/proc/1299/stat : 1299 (scip-2.1.1.4sfi) R 1297 1299 31092 0 -1 4202496 845909 0 0 0 166032 170 0 0 20 0 1 0 270833037 3421831168 832280 33554432000 4194304 10169799 140734377066848 140734377063112 8922295 0 0 4096 16384 0 0 0 17 3 0 0 0 0 0
/proc/1299/statm: 835408 832280 609 1459 0 833940 0
Current children cumulated CPU time (s) 1662.02
Current children cumulated vsize (KiB) 3341632

[startup+1722.3 s]
/proc/loadavg: 2.01 2.01 2.00 3/177 1380
/proc/meminfo: memFree=23947868/32873648 swapFree=7372/7372
[pid=1299] ppid=1297 vsize=3377036 CPUtime=1722.02 cores=1,3,5,7
/proc/1299/stat : 1299 (scip-2.1.1.4sfi) R 1297 1299 31092 0 -1 4202496 853986 0 0 0 172030 172 0 0 20 0 1 0 270833037 3458084864 840835 33554432000 4194304 10169799 140734377066848 140734377063320 8922254 0 0 4096 16384 0 0 0 17 3 0 0 0 0 0
/proc/1299/statm: 844259 840835 609 1459 0 842791 0
Current children cumulated CPU time (s) 1722.02
Current children cumulated vsize (KiB) 3377036

[startup+1782.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 1380
/proc/meminfo: memFree=23847020/32873648 swapFree=7372/7372
[pid=1299] ppid=1297 vsize=3452808 CPUtime=1782.01 cores=1,3,5,7
/proc/1299/stat : 1299 (scip-2.1.1.4sfi) R 1297 1299 31092 0 -1 4202496 873028 0 0 0 178027 174 0 0 20 0 1 0 270833037 3535675392 859990 33554432000 4194304 10169799 140734377066848 140734377063320 8922310 0 0 4096 16384 0 0 0 17 3 0 0 0 0 0
/proc/1299/statm: 863202 859990 609 1459 0 861734 0
Current children cumulated CPU time (s) 1782.01
Current children cumulated vsize (KiB) 3452808



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1800.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 1380
/proc/meminfo: memFree=23691556/32873648 swapFree=7372/7372
[pid=1299] ppid=1297 vsize=3601536 CPUtime=1800.01 cores=1,3,5,7
/proc/1299/stat : 1299 (scip-2.1.1.4sfi) R 1297 1299 31092 0 -1 4202496 905604 0 0 0 179823 178 0 0 20 0 1 0 270833037 3687972864 895874 33554432000 4194304 10169799 140734377066848 140734377063160 8922290 0 0 4096 16384 0 0 0 17 3 0 0 0 0 0
/proc/1299/statm: 900384 895874 609 1459 0 898916 0
Current children cumulated CPU time (s) 1800.01
Current children cumulated vsize (KiB) 3601536

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Sending SIGKILL to process tree (bottom up)

Sending SIGKILL to -1299

Solver just ended. Dumping a history of the last processes samples

[startup+1801.4 s]
/proc/loadavg: 2.00 2.00 2.00 3/178 1382
/proc/meminfo: memFree=23691556/32873648 swapFree=7372/7372
[pid=1299] ppid=1297 vsize=3601536 CPUtime=1801.1 cores=1,3,5,7
/proc/1299/stat : 1299 (scip-2.1.1.4sfi) R 1297 1299 31092 0 -1 4202496 905604 0 0 0 179932 178 0 0 20 0 1 0 270833037 3687972864 895874 33554432000 4194304 10169799 140734377066848 140734377062592 8922310 0 0 4096 16384 0 0 0 17 3 0 0 0 0 0
/proc/1299/statm: 900384 895874 609 1459 0 898916 0
Current children cumulated CPU time (s) 1801.1
Current children cumulated vsize (KiB) 3601536

[startup+1801.81 s]
/proc/loadavg: 2.00 2.00 2.00 3/178 1382
/proc/meminfo: memFree=23691176/32873648 swapFree=7372/7372
[pid=1299] ppid=1297 vsize=3601536 CPUtime=1801.51 cores=1,3,5,7
/proc/1299/stat : 1299 (scip-2.1.1.4sfi) R 1297 1299 31092 0 -1 4202496 905604 0 0 0 179973 178 0 0 20 0 1 0 270833037 3687972864 895874 33554432000 4194304 10169799 140734377066848 140734377062592 8922290 0 0 4096 16384 0 0 0 17 3 0 0 0 0 0
/proc/1299/statm: 900384 895874 609 1459 0 898916 0
Current children cumulated CPU time (s) 1801.51
Current children cumulated vsize (KiB) 3601536

[startup+1802.2 s]
/proc/loadavg: 2.00 2.00 2.00 3/178 1382
/proc/meminfo: memFree=23691176/32873648 swapFree=7372/7372
[pid=1299] ppid=1297 vsize=3601536 CPUtime=1801.9 cores=1,3,5,7
/proc/1299/stat : 1299 (scip-2.1.1.4sfi) R 1297 1299 31092 0 -1 4202496 905604 0 0 0 180012 178 0 0 20 0 1 0 270833037 3687972864 895874 33554432000 4194304 10169799 140734377066848 140734377062592 8922351 0 0 4096 16384 0 0 0 17 3 0 0 0 0 0
/proc/1299/statm: 900384 895874 609 1459 0 898916 0
Current children cumulated CPU time (s) 1801.9
Current children cumulated vsize (KiB) 3601536

[startup+1802.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/178 1382
/proc/meminfo: memFree=23691176/32873648 swapFree=7372/7372
[pid=1299] ppid=1297 vsize=3601536 CPUtime=1802 cores=1,3,5,7
/proc/1299/stat : 1299 (scip-2.1.1.4sfi) R 1297 1299 31092 0 -1 4202496 905609 0 0 0 180022 178 0 0 20 0 1 0 270833037 3687972864 895879 33554432000 4194304 10169799 140734377066848 140734377062592 8922305 0 0 4096 16384 0 0 0 17 3 0 0 0 0 0
/proc/1299/statm: 900384 895879 609 1459 0 898916 0
Current children cumulated CPU time (s) 1802
Current children cumulated vsize (KiB) 3601536

Child ended because it received signal 9 (SIGKILL)
Real time (s): 1802.4
CPU time (s): 1802.11
CPU user time (s): 1800.24
CPU system time (s): 1.87471
CPU usage (%): 99.9842
Max. virtual memory (cumulated for all children) (KiB): 3601536

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1800.24
system time used= 1.87471
maximum resident set size= 3583516
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 905609
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 11
involuntary context switches= 1937

runsolver used 4.96524 second user time and 13.7459 second system time

The end

Launcher Data

Begin job on node122 at 2012-05-26 17:44:30
IDJOB=3693711
IDBENCH=90887
IDSOLVER=2272
FILE ID=node122/3693711-1338047070
RUNJOBID= node122-1338028451-32496
PBS_JOBID= 14624349
Free space on /tmp= 71284 MiB

SOLVER NAME= SCIP spx standard SCIP 2.1.1.4. with SoPlex 1.6.0.3 standard fixed
BENCH NAME= PB12/normalized-PB12/OPT-SMALLINT-LIN/sroussel/NG/normalized-NG.dot_luby_10null20mast_rapportOE1.0_TMAX300_K192_cod2.opb
COMMAND LINE= HOME/scip-2.1.1.4sfix.linux.x86_64.gnu.opt.spx -f BENCHNAME -t TIMEOUT -m MEMLIMIT
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3693711-1338047070/watcher-3693711-1338047070 -o /tmp/evaluation-result-3693711-1338047070/solver-3693711-1338047070 -C 1800 -W 1900 -M 15500  HOME/scip-2.1.1.4sfix.linux.x86_64.gnu.opt.spx -f HOME/instance-3693711-1338047070.opb -t 1800 -m 15500

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= ecfb37e57149da15322fff965cafdd0d
RANDOM SEED=8950700

node122.alineos.net Linux 2.6.32-71.29.1.el6.x86_64 #1 SMP Mon Jun 27 19:49:27 BST 2011

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.533
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.06
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.533
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.533
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.04
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.533
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.533
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.533
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5438.54
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.533
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.533
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32873648 kB
MemFree:        26978052 kB
Buffers:          242744 kB
Cached:          3220428 kB
SwapCached:            0 kB
Active:          3031308 kB
Inactive:        2084040 kB
Active(anon):    1643504 kB
Inactive(anon):    11052 kB
Active(file):    1387804 kB
Inactive(file):  2072988 kB
Unevictable:        7372 kB
Mlocked:            7372 kB
SwapTotal:      67108856 kB
SwapFree:       67108856 kB
Dirty:             41132 kB
Writeback:             0 kB
AnonPages:       1659176 kB
Mapped:            17068 kB
Shmem:               200 kB
Slab:             640044 kB
SReclaimable:      83968 kB
SUnreclaim:       556076 kB
KernelStack:        1456 kB
PageTables:         7328 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83545680 kB
Committed_AS:    1808604 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      346400 kB
VmallocChunk:   34341988052 kB
HardwareCorrupted:     0 kB
AnonHugePages:    933888 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:        7680 kB
DirectMap2M:    33538048 kB

Free space on /tmp at the end= 71256 MiB
End job on node122 at 2012-05-26 18:14:33