Trace number 3741206

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
PB07: bsolo 3.0.17? (TO) 1800.09 1800.41

General information on the benchmark

Name/DEC-SMALLINT-LIN/heinz/
normalized-neos-820157.opb
MD5SUMda32b1e615c8e1bae2ecd5f742c16c96
Bench CategoryDEC-SMALLINT-LIN (no optimisation, small integers, linear constraints)
Best result obtained on this benchmark
Best value of the objective obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Has Objective FunctionNO
Satisfiable
(Un)Satisfiability was proved
Best value of the objective function
Optimality of the best value was proved
Number of variables1200
Total number of constraints1015
Number of constraints which are clauses835
Number of constraints which are cardinality constraints (but not clauses)180
Number of constraints which are nor clauses,nor cardinality constraints0
Minimum length of a constraint2
Maximum length of a constraint20
Number of terms in the objective function 0
Biggest coefficient in the objective function 0
Number of bits for the biggest coefficient in the objective function 0
Sum of the numbers in the objective function 0
Number of bits of the sum of numbers in the objective function 0
Biggest number in a constraint 3
Number of bits of the biggest number in a constraint 2
Biggest sum of numbers in a constraint 21
Number of bits of the biggest sum of numbers5
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Solver Data 

0.00/0.00	c bsolo beta version 3.0.17 - 27/04/2007 : 1600 GMT
0.00/0.00	c Developed by Vasco Manquinho IST/UTL - INESC-ID
0.00/0.00	c type "bsolo -h" for help
0.00/0.00	c Time Limit set via environment variable PBTIMEOUT to 1800
0.00/0.00	c Memory Limit set to 15500 MB
0.00/0.00	c Instance file HOME/instance-3741206-1338756535.opb
0.00/0.00	c File size is 46027 bytes.
0.00/0.01	c Highest Coefficient sum: 21
0.00/0.01	c Parsing was ok!!
0.00/0.01	c Total parsing time: 0.005 s
0.00/0.01	c Var: 1200 Constr: 1135 940/195/0 Lit: 6975 Watch. Lit: 4300
0.00/0.01	c Obj. Vars: 0 (0 % of total variables)
0.00/0.02	c Pre-processing Time: 0.016 s
0.00/0.02	c    Confl   Vars     Ctrs     Lits  LPC   W.Lits     Max Learnt Conf/s Time
0.00/0.02	c        0   1200     1045     5175    4     3310    7698      0      0 0.02
0.00/0.02	c Switching off LPR mode.
1800.08/1800.40	c      101   1200     1146     8339    7     3512    8468    101   5611 0.02
1800.08/1800.40	c      251   1200     1296    13865   10     3812    9315    251  10040 0.03
1800.08/1800.40	c      476   1200     1521    20524   13     4262   10247    476  13222 0.04
1800.08/1800.40	c      817   1200     1862    29292   15     4944   11272    817  16340 0.05
1800.08/1800.40	c     1329   1200     2374    45213   19     5968   12400   1329  15635 0.09
1800.08/1800.40	c     2095   1200     3140    68892   21     7500   13641   2095  14155 0.15
1800.08/1800.40	c     3241   1200     4286   105391   24     9792   15006   3241  12810 0.25
1800.08/1800.40	c     4962   1200     6007   166161   27    13234   16507   4962  10105 0.49
1800.08/1800.40	c     7546   1200     8591   272367   31    18402   18158   7546   8053 0.94
1800.08/1800.40	c    11425   1200    12470   493129   39    26160   19974  11425   5391 2.12
1800.08/1800.40	c    17248   1200    18293   783170   42    37806   21972  17248   3661 4.71
1800.08/1800.40	c    25986   1200    15618   919851   58    32456   24170  14573   2774 9.37
1800.08/1800.40	c    39097   1200    16019   789158   49    33258   26588  14974   2245 17.41
1800.08/1800.40	c    58768   1200    22096  1484502   67    45412   29247  21051   1937 30.33
1800.08/1800.40	c    88278   1200    21111  1362668   64    43442   32172  20066   1506 58.60
1800.08/1800.40	c   132549   1200    29901  2220261   74    61022   35390  28856   1258 105.33
1800.08/1800.40	c   198961   1200    18274  1513535   82    37768   38930  17229   1168 170.32
1800.08/1800.40	c   298581   1200    30019  2540497   84    61258   42824  28974   1015 294.01
1800.08/1800.40	c   448017   1200    25438  1832997   72    52096   47107  24393    943 475.06
1800.08/1800.40	c   672175   1200    40749  2859041   70    82718   51818  39704    818 821.55
1800.08/1800.40	c  1008421   1200    38354  3688339   96    77928   57000  37309    728 1384.72
1800.08/1800.40	c Caught signal: 15
1800.08/1800.40	c  Rst    Confl    NCB      Dec     Ctrs     Lits Learnt Conf/s Time
1800.08/1800.40	c   21  1217186 244855  1787393    58277  5595649  57232    676 1800.09
1800.08/1800.40	s UNKNOWN
1800.08/1800.40	c Total time: 1800.09 s

Verifier Data 

ERROR: no interpretation found !

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.1 (svn: 989)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3741206-1338756535/watcher-3741206-1338756535 -o /tmp/evaluation-result-3741206-1338756535/solver-3741206-1338756535 -C 1800 -W 1900 -M 15500 bsolo3.0.17 -m15500 HOME/instance-3741206-1338756535.opb 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1900 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 2.00 2.00 2.00 3/176 6948
/proc/meminfo: memFree=28388060/32873844 swapFree=7112/7112
[pid=6948] ppid=6946 vsize=4476 CPUtime=0 cores=0,2,4,6
/proc/6948/stat : 6948 (bsolo3.0.17) R 6946 6948 5948 0 -1 4194304 127 0 0 0 0 0 0 0 20 0 1 0 341779176 4583424 80 33554432000 134512640 135840783 4294433904 4294433244 5440941 0 0 4096 0 0 0 0 17 0 0 0 0 0 0
/proc/6948/statm: 1119 99 81 325 0 39 0

[startup+0.039406 s]
/proc/loadavg: 2.00 2.00 2.00 3/176 6948
/proc/meminfo: memFree=28388060/32873844 swapFree=7112/7112
[pid=6948] ppid=6946 vsize=5216 CPUtime=0.03 cores=0,2,4,6
/proc/6948/stat : 6948 (bsolo3.0.17) R 6946 6948 5948 0 -1 4202496 629 0 0 0 3 0 0 0 20 0 1 0 341779176 5341184 554 33554432000 134512640 135840783 4294433904 4294433264 134550893 0 0 4096 16384 0 0 0 17 0 0 0 0 0 0
/proc/6948/statm: 1304 554 347 325 0 240 0
Current children cumulated CPU time (s) 0.03
Current children cumulated vsize (KiB) 5216

[startup+0.100209 s]
/proc/loadavg: 2.00 2.00 2.00 3/176 6948
/proc/meminfo: memFree=28388060/32873844 swapFree=7112/7112
[pid=6948] ppid=6946 vsize=5612 CPUtime=0.09 cores=0,2,4,6
/proc/6948/stat : 6948 (bsolo3.0.17) R 6946 6948 5948 0 -1 4202496 751 0 0 0 9 0 0 0 20 0 1 0 341779176 5746688 676 33554432000 134512640 135840783 4294433904 4294433168 3367446 0 0 4096 16384 0 0 0 17 0 0 0 0 0 0
/proc/6948/statm: 1403 676 347 325 0 339 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 5612

[startup+0.300171 s]
/proc/loadavg: 2.00 2.00 2.00 3/176 6948
/proc/meminfo: memFree=28388060/32873844 swapFree=7112/7112
[pid=6948] ppid=6946 vsize=6780 CPUtime=0.28 cores=0,2,4,6
/proc/6948/stat : 6948 (bsolo3.0.17) R 6946 6948 5948 0 -1 4202496 1043 0 0 0 28 0 0 0 20 0 1 0 341779176 6942720 968 33554432000 134512640 135840783 4294433904 4294433264 134550887 0 0 4096 16384 0 0 0 17 0 0 0 0 0 0
/proc/6948/statm: 1695 968 347 325 0 631 0
Current children cumulated CPU time (s) 0.28
Current children cumulated vsize (KiB) 6780

[startup+0.700169 s]
/proc/loadavg: 2.00 2.00 2.00 3/176 6948
/proc/meminfo: memFree=28388060/32873844 swapFree=7112/7112
[pid=6948] ppid=6946 vsize=8360 CPUtime=0.68 cores=0,2,4,6
/proc/6948/stat : 6948 (bsolo3.0.17) R 6946 6948 5948 0 -1 4202496 1439 0 0 0 68 0 0 0 20 0 1 0 341779176 8560640 1364 33554432000 134512640 135840783 4294433904 4294433424 134551975 0 0 4096 16384 0 0 0 17 0 0 0 0 0 0
/proc/6948/statm: 2090 1364 347 325 0 1026 0
Current children cumulated CPU time (s) 0.68
Current children cumulated vsize (KiB) 8360

[startup+1.50017 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 6949
/proc/meminfo: memFree=28382828/32873844 swapFree=7112/7112
[pid=6948] ppid=6946 vsize=10836 CPUtime=1.48 cores=0,2,4,6
/proc/6948/stat : 6948 (bsolo3.0.17) R 6946 6948 5948 0 -1 4202496 2043 0 0 0 148 0 0 0 20 0 1 0 341779176 11096064 1968 33554432000 134512640 135840783 4294433904 4294433164 5999443 0 0 4096 16384 0 0 0 17 0 0 0 0 0 0
/proc/6948/statm: 2709 1968 347 325 0 1645 0
Current children cumulated CPU time (s) 1.48
Current children cumulated vsize (KiB) 10836

[startup+3.10019 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 6949
/proc/meminfo: memFree=28379232/32873844 swapFree=7112/7112
[pid=6948] ppid=6946 vsize=14348 CPUtime=3.08 cores=0,2,4,6
/proc/6948/stat : 6948 (bsolo3.0.17) R 6946 6948 5948 0 -1 4202496 2932 0 0 0 308 0 0 0 20 0 1 0 341779176 14692352 2857 33554432000 134512640 135840783 4294433904 4294433264 134550924 0 0 4096 16384 0 0 0 17 0 0 0 0 0 0
/proc/6948/statm: 3587 2857 347 325 0 2523 0
Current children cumulated CPU time (s) 3.08
Current children cumulated vsize (KiB) 14348

[startup+6.30024 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 6949
/proc/meminfo: memFree=28372892/32873844 swapFree=7112/7112
[pid=6948] ppid=6946 vsize=19812 CPUtime=6.28 cores=0,2,4,6
/proc/6948/stat : 6948 (bsolo3.0.17) R 6946 6948 5948 0 -1 4202496 4290 0 0 0 627 1 0 0 20 0 1 0 341779176 20287488 4215 33554432000 134512640 135840783 4294433904 4294431888 6001959 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/6948/statm: 4953 4215 347 325 0 3889 0
Current children cumulated CPU time (s) 6.28
Current children cumulated vsize (KiB) 19812

[startup+12.7002 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 6949
/proc/meminfo: memFree=28367584/32873844 swapFree=7112/7112
[pid=6948] ppid=6946 vsize=23572 CPUtime=12.68 cores=0,2,4,6
/proc/6948/stat : 6948 (bsolo3.0.17) R 6946 6948 5948 0 -1 4202496 5239 0 0 0 1267 1 0 0 20 0 1 0 341779176 24137728 5164 33554432000 134512640 135840783 4294433904 4294433264 134550764 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/6948/statm: 5893 5164 347 325 0 4829 0
Current children cumulated CPU time (s) 12.68
Current children cumulated vsize (KiB) 23572

[startup+25.5003 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 6949
/proc/meminfo: memFree=28359988/32873844 swapFree=7112/7112
[pid=6948] ppid=6946 vsize=28348 CPUtime=25.48 cores=0,2,4,6
/proc/6948/stat : 6948 (bsolo3.0.17) R 6946 6948 5948 0 -1 4202496 6433 0 0 0 2546 2 0 0 20 0 1 0 341779176 29028352 6358 33554432000 134512640 135840783 4294433904 4294433140 5996628 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/6948/statm: 7087 6358 347 325 0 6023 0
Current children cumulated CPU time (s) 25.48
Current children cumulated vsize (KiB) 28348

[startup+51.1003 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 6949
/proc/meminfo: memFree=28349416/32873844 swapFree=7112/7112
[pid=6948] ppid=6946 vsize=36088 CPUtime=51.08 cores=0,2,4,6
/proc/6948/stat : 6948 (bsolo3.0.17) R 6946 6948 5948 0 -1 4202496 8370 0 0 0 5106 2 0 0 20 0 1 0 341779176 36954112 8295 33554432000 134512640 135840783 4294433904 4294433264 134550779 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/6948/statm: 9022 8295 347 325 0 7958 0
Current children cumulated CPU time (s) 51.08
Current children cumulated vsize (KiB) 36088

[startup+102.306 s]
/proc/loadavg: 2.00 2.00 2.00 3/178 6952
/proc/meminfo: memFree=28340652/32873844 swapFree=7112/7112
[pid=6948] ppid=6946 vsize=37288 CPUtime=102.27 cores=0,2,4,6
/proc/6948/stat : 6948 (bsolo3.0.17) R 6946 6948 5948 0 -1 4202496 8672 0 0 0 10225 2 0 0 20 0 1 0 341779176 38182912 8597 33554432000 134512640 135840783 4294433904 4294433264 134551052 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/6948/statm: 9322 8597 347 325 0 8258 0
Current children cumulated CPU time (s) 102.27
Current children cumulated vsize (KiB) 37288

[startup+162.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 6953
/proc/meminfo: memFree=28319484/32873844 swapFree=7112/7112
[pid=6948] ppid=6946 vsize=48052 CPUtime=162.24 cores=0,2,4,6
/proc/6948/stat : 6948 (bsolo3.0.17) R 6946 6948 5948 0 -1 4202496 11446 0 0 0 16221 3 0 0 20 0 1 0 341779176 49205248 11283 33554432000 134512640 135840783 4294433904 4294433040 5999291 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/6948/statm: 12013 11283 347 325 0 10949 0
Current children cumulated CPU time (s) 162.24
Current children cumulated vsize (KiB) 48052

[startup+222.3 s]
/proc/loadavg: 2.12 2.03 2.01 3/177 6953
/proc/meminfo: memFree=28307456/32873844 swapFree=7112/7112
[pid=6948] ppid=6946 vsize=51896 CPUtime=222.23 cores=0,2,4,6
/proc/6948/stat : 6948 (bsolo3.0.17) R 6946 6948 5948 0 -1 4202496 12428 0 0 0 22220 3 0 0 20 0 1 0 341779176 53141504 12250 33554432000 134512640 135840783 4294433904 4294433264 134550994 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/6948/statm: 12974 12250 347 325 0 11910 0
Current children cumulated CPU time (s) 222.23
Current children cumulated vsize (KiB) 51896

[startup+282.3 s]
/proc/loadavg: 2.05 2.02 2.00 3/177 6953
/proc/meminfo: memFree=28296336/32873844 swapFree=7112/7112
[pid=6948] ppid=6946 vsize=56516 CPUtime=282.23 cores=0,2,4,6
/proc/6948/stat : 6948 (bsolo3.0.17) R 6946 6948 5948 0 -1 4202496 13594 0 0 0 28219 4 0 0 20 0 1 0 341779176 57872384 13377 33554432000 134512640 135840783 4294433904 4294433264 134550902 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/6948/statm: 14129 13377 347 325 0 13065 0
Current children cumulated CPU time (s) 282.23
Current children cumulated vsize (KiB) 56516

[startup+342.3 s]
/proc/loadavg: 2.01 2.02 2.00 3/177 6953
/proc/meminfo: memFree=28286960/32873844 swapFree=7112/7112
[pid=6948] ppid=6946 vsize=56964 CPUtime=342.21 cores=0,2,4,6
/proc/6948/stat : 6948 (bsolo3.0.17) R 6946 6948 5948 0 -1 4202496 13712 0 0 0 34217 4 0 0 20 0 1 0 341779176 58331136 13488 33554432000 134512640 135840783 4294433904 4294433264 134551368 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/6948/statm: 14241 13488 347 325 0 13177 0
Current children cumulated CPU time (s) 342.21
Current children cumulated vsize (KiB) 56964

[startup+402.3 s]
/proc/loadavg: 2.00 2.01 2.00 3/177 6953
/proc/meminfo: memFree=28274188/32873844 swapFree=7112/7112
[pid=6948] ppid=6946 vsize=63232 CPUtime=402.2 cores=0,2,4,6
/proc/6948/stat : 6948 (bsolo3.0.17) R 6946 6948 5948 0 -1 4202496 15319 0 0 0 40215 5 0 0 20 0 1 0 341779176 64749568 15052 33554432000 134512640 135840783 4294433904 4294433264 134551052 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/6948/statm: 15808 15052 347 325 0 14744 0
Current children cumulated CPU time (s) 402.2
Current children cumulated vsize (KiB) 63232

[startup+462.3 s]
/proc/loadavg: 2.00 2.01 2.00 3/177 6954
/proc/meminfo: memFree=28270200/32873844 swapFree=7112/7112
[pid=6948] ppid=6946 vsize=63232 CPUtime=462.19 cores=0,2,4,6
/proc/6948/stat : 6948 (bsolo3.0.17) R 6946 6948 5948 0 -1 4202496 15319 0 0 0 46214 5 0 0 20 0 1 0 341779176 64749568 15052 33554432000 134512640 135840783 4294433904 4294433264 134551076 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/6948/statm: 15808 15052 347 325 0 14744 0
Current children cumulated CPU time (s) 462.19
Current children cumulated vsize (KiB) 63232

[startup+522.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 6954
/proc/meminfo: memFree=28265420/32873844 swapFree=7112/7112
[pid=6948] ppid=6946 vsize=63248 CPUtime=522.18 cores=0,2,4,6
/proc/6948/stat : 6948 (bsolo3.0.17) R 6946 6948 5948 0 -1 4202496 15329 0 0 0 52213 5 0 0 20 0 1 0 341779176 64765952 15059 33554432000 134512640 135840783 4294433904 4294433264 134550994 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/6948/statm: 15812 15059 347 325 0 14748 0
Current children cumulated CPU time (s) 522.18
Current children cumulated vsize (KiB) 63248

[startup+582.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 6954
/proc/meminfo: memFree=28257236/32873844 swapFree=7112/7112
[pid=6948] ppid=6946 vsize=66256 CPUtime=582.17 cores=0,2,4,6
/proc/6948/stat : 6948 (bsolo3.0.17) R 6946 6948 5948 0 -1 4202496 16186 0 0 0 58212 5 0 0 20 0 1 0 341779176 67846144 15825 33554432000 134512640 135840783 4294433904 4294433260 3367424 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/6948/statm: 16564 15825 347 325 0 15500 0
Current children cumulated CPU time (s) 582.17
Current children cumulated vsize (KiB) 66256

[startup+642.3 s]

################
# More data... #
################

[startup+822.3 s]
/proc/loadavg: 2.02 2.02 2.00 3/177 6981
/proc/meminfo: memFree=28194096/32873844 swapFree=7112/7112
[pid=6948] ppid=6946 vsize=69060 CPUtime=822.13 cores=0,2,4,6
/proc/6948/stat : 6948 (bsolo3.0.17) R 6946 6948 5948 0 -1 4202496 16873 0 0 0 82207 6 0 0 20 0 1 0 341779176 70717440 16509 33554432000 134512640 135840783 4294433904 4294433264 134551084 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/6948/statm: 17265 16509 347 325 0 16201 0
Current children cumulated CPU time (s) 822.13
Current children cumulated vsize (KiB) 69060

[startup+882.3 s]
/proc/loadavg: 2.00 2.01 2.00 3/177 6981
/proc/meminfo: memFree=28130032/32873844 swapFree=7112/7112
[pid=6948] ppid=6946 vsize=69080 CPUtime=882.12 cores=0,2,4,6
/proc/6948/stat : 6948 (bsolo3.0.17) R 6946 6948 5948 0 -1 4202496 16879 0 0 0 88206 6 0 0 20 0 1 0 341779176 70737920 16515 33554432000 134512640 135840783 4294433904 4294433264 134550804 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/6948/statm: 17270 16515 347 325 0 16206 0
Current children cumulated CPU time (s) 882.12
Current children cumulated vsize (KiB) 69080

[startup+942.3 s]
/proc/loadavg: 2.00 2.01 2.00 3/177 6981
/proc/meminfo: memFree=28104944/32873844 swapFree=7112/7112
[pid=6948] ppid=6946 vsize=72116 CPUtime=942.11 cores=0,2,4,6
/proc/6948/stat : 6948 (bsolo3.0.17) R 6946 6948 5948 0 -1 4202496 17770 0 0 0 94205 6 0 0 20 0 1 0 341779176 73846784 17303 33554432000 134512640 135840783 4294433904 4294433264 134550913 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/6948/statm: 18029 17303 347 325 0 16965 0
Current children cumulated CPU time (s) 942.11
Current children cumulated vsize (KiB) 72116

[startup+1002.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 6981
/proc/meminfo: memFree=28081628/32873844 swapFree=7112/7112
[pid=6948] ppid=6946 vsize=72428 CPUtime=1002.1 cores=0,2,4,6
/proc/6948/stat : 6948 (bsolo3.0.17) R 6946 6948 5948 0 -1 4202496 17820 0 0 0 100204 6 0 0 20 0 1 0 341779176 74166272 17351 33554432000 134512640 135840783 4294433904 4294433264 134550767 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/6948/statm: 18107 17351 347 325 0 17043 0
Current children cumulated CPU time (s) 1002.1
Current children cumulated vsize (KiB) 72428

[startup+1062.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/176 6981
/proc/meminfo: memFree=28054480/32873844 swapFree=7112/7112
[pid=6948] ppid=6946 vsize=72428 CPUtime=1062.09 cores=0,2,4,6
/proc/6948/stat : 6948 (bsolo3.0.17) R 6946 6948 5948 0 -1 4202496 17820 0 0 0 106203 6 0 0 20 0 1 0 341779176 74166272 17351 33554432000 134512640 135840783 4294433904 4294433136 5626623 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/6948/statm: 18107 17351 347 325 0 17043 0
Current children cumulated CPU time (s) 1062.09
Current children cumulated vsize (KiB) 72428

[startup+1122.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 6982
/proc/meminfo: memFree=28036244/32873844 swapFree=7112/7112
[pid=6948] ppid=6946 vsize=72428 CPUtime=1122.08 cores=0,2,4,6
/proc/6948/stat : 6948 (bsolo3.0.17) R 6946 6948 5948 0 -1 4202496 17820 0 0 0 112202 6 0 0 20 0 1 0 341779176 74166272 17351 33554432000 134512640 135840783 4294433904 4294433264 134551330 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/6948/statm: 18107 17351 347 325 0 17043 0
Current children cumulated CPU time (s) 1122.08
Current children cumulated vsize (KiB) 72428

[startup+1182.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 6982
/proc/meminfo: memFree=28012932/32873844 swapFree=7112/7112
[pid=6948] ppid=6946 vsize=75360 CPUtime=1182.08 cores=0,2,4,6
/proc/6948/stat : 6948 (bsolo3.0.17) R 6946 6948 5948 0 -1 4202496 18553 0 0 0 118201 7 0 0 20 0 1 0 341779176 77168640 18084 33554432000 134512640 135840783 4294433904 4294433264 134550804 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/6948/statm: 18840 18084 347 325 0 17776 0
Current children cumulated CPU time (s) 1182.08
Current children cumulated vsize (KiB) 75360

[startup+1242.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 6982
/proc/meminfo: memFree=27991200/32873844 swapFree=7112/7112
[pid=6948] ppid=6946 vsize=79184 CPUtime=1242.06 cores=0,2,4,6
/proc/6948/stat : 6948 (bsolo3.0.17) R 6946 6948 5948 0 -1 4202496 19509 0 0 0 124198 8 0 0 20 0 1 0 341779176 81084416 19040 33554432000 134512640 135840783 4294433904 4294433264 134551475 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/6948/statm: 19796 19040 347 325 0 18732 0
Current children cumulated CPU time (s) 1242.06
Current children cumulated vsize (KiB) 79184

[startup+1302.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/178 6985
/proc/meminfo: memFree=27975664/32873844 swapFree=7112/7112
[pid=6948] ppid=6946 vsize=79184 CPUtime=1302.06 cores=0,2,4,6
/proc/6948/stat : 6948 (bsolo3.0.17) R 6946 6948 5948 0 -1 4202496 19509 0 0 0 130198 8 0 0 20 0 1 0 341779176 81084416 19040 33554432000 134512640 135840783 4294433904 4294433200 134572890 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/6948/statm: 19796 19040 347 325 0 18732 0
Current children cumulated CPU time (s) 1302.06
Current children cumulated vsize (KiB) 79184

[startup+1362.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 6985
/proc/meminfo: memFree=27957004/32873844 swapFree=7112/7112
[pid=6948] ppid=6946 vsize=79184 CPUtime=1362.04 cores=0,2,4,6
/proc/6948/stat : 6948 (bsolo3.0.17) R 6946 6948 5948 0 -1 4202496 19534 0 0 0 136196 8 0 0 20 0 1 0 341779176 81084416 19062 33554432000 134512640 135840783 4294433904 4294433264 134551058 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/6948/statm: 19796 19062 347 325 0 18732 0
Current children cumulated CPU time (s) 1362.04
Current children cumulated vsize (KiB) 79184

[startup+1422.31 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 6986
/proc/meminfo: memFree=27942000/32873844 swapFree=7112/7112
[pid=6948] ppid=6946 vsize=79184 CPUtime=1422.05 cores=0,2,4,6
/proc/6948/stat : 6948 (bsolo3.0.17) R 6946 6948 5948 0 -1 4202496 19534 0 0 0 142196 9 0 0 20 0 1 0 341779176 81084416 19062 33554432000 134512640 135840783 4294433904 4294433264 134550804 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/6948/statm: 19796 19062 347 325 0 18732 0
Current children cumulated CPU time (s) 1422.05
Current children cumulated vsize (KiB) 79184

[startup+1482.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 6986
/proc/meminfo: memFree=27930220/32873844 swapFree=7112/7112
[pid=6948] ppid=6946 vsize=87520 CPUtime=1482.02 cores=0,2,4,6
/proc/6948/stat : 6948 (bsolo3.0.17) R 6946 6948 5948 0 -1 4202496 21670 0 0 0 148192 10 0 0 20 0 1 0 341779176 89620480 21141 33554432000 134512640 135840783 4294433904 4294433040 6001393 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/6948/statm: 21880 21141 347 325 0 20816 0
Current children cumulated CPU time (s) 1482.02
Current children cumulated vsize (KiB) 87520

[startup+1542.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/176 6986
/proc/meminfo: memFree=27927624/32873844 swapFree=7112/7112
[pid=6948] ppid=6946 vsize=87812 CPUtime=1542.02 cores=0,2,4,6
/proc/6948/stat : 6948 (bsolo3.0.17) R 6946 6948 5948 0 -1 4202496 21726 0 0 0 154192 10 0 0 20 0 1 0 341779176 89919488 21197 33554432000 134512640 135840783 4294433904 4294433264 134550782 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/6948/statm: 21953 21197 347 325 0 20889 0
Current children cumulated CPU time (s) 1542.02
Current children cumulated vsize (KiB) 87812

[startup+1602.3 s]
/proc/loadavg: 1.95 1.98 1.99 3/177 7026
/proc/meminfo: memFree=28402808/32873844 swapFree=7112/7112
[pid=6948] ppid=6946 vsize=90248 CPUtime=1602.01 cores=0,2,4,6
/proc/6948/stat : 6948 (bsolo3.0.17) R 6946 6948 5948 0 -1 4202496 22335 0 0 0 160191 10 0 0 20 0 1 0 341779176 92413952 21806 33554432000 134512640 135840783 4294433904 4294433208 2971820 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/6948/statm: 22562 21806 347 325 0 21498 0
Current children cumulated CPU time (s) 1602.01
Current children cumulated vsize (KiB) 90248

[startup+1662.3 s]
/proc/loadavg: 1.98 1.98 1.99 3/177 7026
/proc/meminfo: memFree=28389048/32873844 swapFree=7112/7112
[pid=6948] ppid=6946 vsize=90752 CPUtime=1661.99 cores=0,2,4,6
/proc/6948/stat : 6948 (bsolo3.0.17) R 6946 6948 5948 0 -1 4202496 22467 0 0 0 166189 10 0 0 20 0 1 0 341779176 92930048 21932 33554432000 134512640 135840783 4294433904 4294433264 134550804 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/6948/statm: 22688 21932 347 325 0 21624 0
Current children cumulated CPU time (s) 1661.99
Current children cumulated vsize (KiB) 90752

[startup+1722.3 s]
/proc/loadavg: 2.07 2.00 2.00 3/177 7027
/proc/meminfo: memFree=28381892/32873844 swapFree=7112/7112
[pid=6948] ppid=6946 vsize=90752 CPUtime=1721.98 cores=0,2,4,6
/proc/6948/stat : 6948 (bsolo3.0.17) R 6946 6948 5948 0 -1 4202496 22467 0 0 0 172188 10 0 0 20 0 1 0 341779176 92930048 21932 33554432000 134512640 135840783 4294433904 4294433264 134550804 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/6948/statm: 22688 21932 347 325 0 21624 0
Current children cumulated CPU time (s) 1721.98
Current children cumulated vsize (KiB) 90752

[startup+1782.3 s]
/proc/loadavg: 2.02 2.00 2.00 3/177 7027
/proc/meminfo: memFree=28381272/32873844 swapFree=7112/7112
[pid=6948] ppid=6946 vsize=90752 CPUtime=1781.97 cores=0,2,4,6
/proc/6948/stat : 6948 (bsolo3.0.17) R 6946 6948 5948 0 -1 4202496 22467 0 0 0 178187 10 0 0 20 0 1 0 341779176 92930048 21932 33554432000 134512640 135840783 4294433904 4294433264 134550764 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/6948/statm: 22688 21932 347 325 0 21624 0
Current children cumulated CPU time (s) 1781.97
Current children cumulated vsize (KiB) 90752



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1800.4 s]
/proc/loadavg: 2.02 2.00 2.00 3/177 7027
/proc/meminfo: memFree=28381272/32873844 swapFree=7112/7112
[pid=6948] ppid=6946 vsize=90752 CPUtime=1800.08 cores=0,2,4,6
/proc/6948/stat : 6948 (bsolo3.0.17) R 6946 6948 5948 0 -1 4202496 22467 0 0 0 179998 10 0 0 20 0 1 0 341779176 92930048 21932 33554432000 134512640 135840783 4294433904 4294433264 134550902 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/6948/statm: 22688 21932 347 325 0 21624 0
Current children cumulated CPU time (s) 1800.08
Current children cumulated vsize (KiB) 90752

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child status: 15
Real time (s): 1800.41
CPU time (s): 1800.09
CPU user time (s): 1799.98
CPU system time (s): 0.110983
CPU usage (%): 99.9826
Max. virtual memory (cumulated for all children) (KiB): 90752

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1799.98
system time used= 0.110983
maximum resident set size= 87728
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 22470
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 54
involuntary context switches= 1860

runsolver used 3.52146 second user time and 8.61269 second system time

The end

Launcher Data 

Begin job on node119 at 2012-06-03 22:48:55
IDJOB=3741206
IDBENCH=89819
IDSOLVER=2318
FILE ID=node119/3741206-1338756535
RUNJOBID= node119-1338748763-5964
PBS_JOBID= 14636790
Free space on /tmp= 70880 MiB

SOLVER NAME= PB07: bsolo 3.0.17
BENCH NAME= PB11/normalized-PB11/DEC-SMALLINT-LIN/heinz/normalized-neos-820157.opb
COMMAND LINE= bsolo3.0.17 -mMEMLIMIT BENCHNAME            
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3741206-1338756535/watcher-3741206-1338756535 -o /tmp/evaluation-result-3741206-1338756535/solver-3741206-1338756535 -C 1800 -W 1900 -M 15500  bsolo3.0.17 -m15500 HOME/instance-3741206-1338756535.opb            

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= da32b1e615c8e1bae2ecd5f742c16c96
RANDOM SEED=676219748

node119.alineos.net Linux 2.6.32-71.29.1.el6.x86_64 #1 SMP Mon Jun 27 19:49:27 BST 2011

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.943
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.88
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.943
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.943
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.93
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.943
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.943
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.93
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.943
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.92
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.943
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.90
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.943
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32873844 kB
MemFree:        28388432 kB
Buffers:          411928 kB
Cached:          3081808 kB
SwapCached:         1936 kB
Active:          1667856 kB
Inactive:        1988172 kB
Active(anon):     157904 kB
Inactive(anon):     6624 kB
Active(file):    1509952 kB
Inactive(file):  1981548 kB
Unevictable:        7112 kB
Mlocked:            7112 kB
SwapTotal:      67108856 kB
SwapFree:       67100224 kB
Dirty:              6620 kB
Writeback:             8 kB
AnonPages:        167952 kB
Mapped:            13112 kB
Shmem:                 0 kB
Slab:             690732 kB
SReclaimable:     132764 kB
SUnreclaim:       557968 kB
KernelStack:        1480 kB
PageTables:         4448 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83545776 kB
Committed_AS:     281088 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      346368 kB
VmallocChunk:   34341987984 kB
HardwareCorrupted:     0 kB
AnonHugePages:      2048 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:        7872 kB
DirectMap2M:    33538048 kB

Free space on /tmp at the end= 70888 MiB
End job on node119 at 2012-06-03 23:18:57