Trace number 3742386

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
PB07: bsolo 3.0.17? (TO) 1800.2 1802.6

General information on the benchmark

Name/DEC-SMALLINT-LIN/sroussel/
ShortestPathNG/normalized-NG_K163.opb
MD5SUM5c9e224cdd9eef3594ee47236fa33798
Bench CategoryDEC-SMALLINT-LIN (no optimisation, small integers, linear constraints)
Best result obtained on this benchmark
Best value of the objective obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Has Objective FunctionNO
Satisfiable
(Un)Satisfiability was proved
Best value of the objective function
Optimality of the best value was proved
Number of variables19397
Total number of constraints19725
Number of constraints which are clauses19562
Number of constraints which are cardinality constraints (but not clauses)163
Number of constraints which are nor clauses,nor cardinality constraints0
Minimum length of a constraint1
Maximum length of a constraint163
Number of terms in the objective function 0
Biggest coefficient in the objective function 0
Number of bits for the biggest coefficient in the objective function 0
Sum of the numbers in the objective function 0
Number of bits of the sum of numbers in the objective function 0
Biggest number in a constraint 1
Number of bits of the biggest number in a constraint 1
Biggest sum of numbers in a constraint 164
Number of bits of the biggest sum of numbers8
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Solver Data 

0.00/0.00	c bsolo beta version 3.0.17 - 27/04/2007 : 1600 GMT
0.00/0.00	c Developed by Vasco Manquinho IST/UTL - INESC-ID
0.00/0.00	c type "bsolo -h" for help
0.00/0.00	c Time Limit set via environment variable PBTIMEOUT to 1800
0.00/0.00	c Memory Limit set to 15500 MB
0.00/0.00	c Instance file HOME/instance-3742386-1338770379.opb
0.00/0.00	c File size is 1334228 bytes.
0.08/0.13	c Highest Coefficient sum: 164
0.08/0.13	c Parsing was ok!!
0.08/0.13	c Total parsing time: 0.122 s
0.08/0.25	c Var: 19397 Constr: 19725 19562/163/0 Lit: 126881 Watch. Lit: 58519
0.08/0.25	c Obj. Vars: 0 (0 % of total variables)
8.68/8.78	c Pre-processing Time: 8.767 s
8.68/8.78	c    Confl   Vars     Ctrs     Lits  LPC   W.Lits     Max Learnt Conf/s Time
8.68/8.78	c        0  17855    18289   120446    6    55227  165475      0      0 8.77
8.68/8.78	c Switching off LPR mode.
1800.10/1800.50	c      100  17855    18389   125527    6    55427  182023    100     11 8.82
1800.10/1800.50	c      250  17855    18539   141095    7    55727  200226    250     27 8.93
1800.10/1800.50	c      475  17855    18764   155442    8    56177  220249    475     51 9.25
1800.10/1800.50	c      813  17855    19102   183685    9    56853  242274    813     85 9.56
1800.10/1800.50	c     1321  17855    19610   234897   11    57869  266502   1321    130 10.09
1800.10/1800.50	c     2087  17855    20376   350276   17    59401  293153   2087    193 10.77
1800.10/1800.50	c     3233  17855    21522   579567   26    61693  322469   3233    272 11.88
1800.10/1800.50	c     4954  17855    23243   804184   34    65135  354716   4954    358 13.81
1800.10/1800.50	c     7538  17855    25827  1221495   47    70303  390188   7538    453 16.62
1800.10/1800.50	c    11419  17855    29708  1877298   63    78065  429207  11419    531 21.50
1800.10/1800.50	c    17241  17855    35530  2925330   82    89709  472128  17241    579 29.74
1800.10/1800.50	c    25978  17855    44267  4426500   99   107183  519341  25978    569 45.59
1800.10/1800.50	c    39088  17855    57377  8811277  153   133403  571276  39088    488 80.03
1800.10/1800.50	c    58758  17855    77047 16056189  208   172743  628404  58758    427 137.60
1800.10/1800.50	c    88269  17855   106558 31347925  294   231765  691245  88269    336 262.66
1800.10/1800.50	c   132539  17855   150828 52024927  344   320305  760370 132539    262 505.67
1800.10/1800.50	c   198949  17855   217238 94306010  434   453125  836408 198949    184 1075.83
1800.10/1800.50	c Caught signal: 15
1800.10/1800.50	c  Rst    Confl    NCB      Dec     Ctrs     Lits Learnt Conf/s Time
1800.10/1800.50	c   17   259025 163238 12958090   277314 167136634 259025    143 1800.11
1800.10/1800.50	s UNKNOWN
1800.10/1800.50	c Total time: 1800.11 s

Verifier Data 

ERROR: no interpretation found !

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.1 (svn: 989)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3742386-1338770379/watcher-3742386-1338770379 -o /tmp/evaluation-result-3742386-1338770379/solver-3742386-1338770379 -C 1800 -W 1900 -M 15500 bsolo3.0.17 -m15500 HOME/instance-3742386-1338770379.opb 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1900 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 1.92 1.98 1.99 3/177 23162
/proc/meminfo: memFree=27045832/32873648 swapFree=6864/6864
[pid=23162] ppid=23160 vsize=2776 CPUtime=0 cores=0,2,4,6
/proc/23162/stat : 23162 (bsolo3.0.17) R 23160 23162 20253 0 -1 4194304 98 0 0 0 0 0 0 0 20 0 1 0 343164771 2842624 50 33554432000 134512640 135840783 4289913808 4289911816 11203524 0 0 4096 0 0 0 0 17 0 0 0 0 0 0
/proc/23162/statm: 722 53 40 325 0 33 0

[startup+0.0154919 s]
/proc/loadavg: 1.92 1.98 1.99 3/177 23162
/proc/meminfo: memFree=27045832/32873648 swapFree=6864/6864
[pid=23162] ppid=23160 vsize=14232 CPUtime=0 cores=0,2,4,6
/proc/23162/stat : 23162 (bsolo3.0.17) R 23160 23162 20253 0 -1 4202496 601 0 0 0 0 0 0 0 20 0 1 0 343164771 14573568 537 33554432000 134512640 135840783 4289913808 4289910576 11715879 0 0 4096 16384 0 0 0 17 0 0 0 0 0 0
/proc/23162/statm: 3558 537 340 325 0 2168 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 14232

[startup+0.100211 s]
/proc/loadavg: 1.92 1.98 1.99 3/177 23162
/proc/meminfo: memFree=27045832/32873648 swapFree=6864/6864
[pid=23162] ppid=23160 vsize=9684 CPUtime=0.08 cores=0,2,4,6
/proc/23162/stat : 23162 (bsolo3.0.17) R 23160 23162 20253 0 -1 4202496 1632 0 0 0 8 0 0 0 20 0 1 0 343164771 9916416 1568 33554432000 134512640 135840783 4289913808 4289912528 11713226 0 0 4096 16384 0 0 0 17 0 0 0 0 0 0
/proc/23162/statm: 2421 1568 573 325 0 1031 0
Current children cumulated CPU time (s) 0.08
Current children cumulated vsize (KiB) 9684

[startup+0.353798 s]
/proc/loadavg: 1.92 1.98 1.99 3/177 23162
/proc/meminfo: memFree=27045832/32873648 swapFree=6864/6864
[pid=23162] ppid=23160 vsize=11920 CPUtime=0.33 cores=0,2,4,6
/proc/23162/stat : 23162 (bsolo3.0.17) R 23160 23162 20253 0 -1 4202496 2562 0 0 0 33 0 0 0 20 0 1 0 343164771 12206080 2172 33554432000 134512640 135840783 4289913808 4289680144 134552084 0 0 4096 16384 0 0 0 17 6 0 0 0 0 0
/proc/23162/statm: 2980 2172 342 325 0 1916 0
Current children cumulated CPU time (s) 0.33
Current children cumulated vsize (KiB) 11920

[startup+0.700121 s]
/proc/loadavg: 1.92 1.98 1.99 3/177 23162
/proc/meminfo: memFree=27045832/32873648 swapFree=6864/6864
[pid=23162] ppid=23160 vsize=11920 CPUtime=0.68 cores=0,2,4,6
/proc/23162/stat : 23162 (bsolo3.0.17) R 23160 23162 20253 0 -1 4202496 2562 0 0 0 68 0 0 0 20 0 1 0 343164771 12206080 2172 33554432000 134512640 135840783 4289913808 4289679984 134550808 0 0 4096 16384 0 0 0 17 6 0 0 0 0 0
/proc/23162/statm: 2980 2172 342 325 0 1916 0
Current children cumulated CPU time (s) 0.68
Current children cumulated vsize (KiB) 11920

[startup+1.50019 s]
/proc/loadavg: 1.92 1.98 1.99 3/178 23163
/proc/meminfo: memFree=27035020/32873648 swapFree=6864/6864
[pid=23162] ppid=23160 vsize=11920 CPUtime=1.48 cores=0,2,4,6
/proc/23162/stat : 23162 (bsolo3.0.17) R 23160 23162 20253 0 -1 4202496 2563 0 0 0 147 1 0 0 20 0 1 0 343164771 12206080 2173 33554432000 134512640 135840783 4289913808 4289680096 134583111 0 0 4096 16384 0 0 0 17 0 0 0 0 0 0
/proc/23162/statm: 2980 2173 342 325 0 1916 0
Current children cumulated CPU time (s) 1.48
Current children cumulated vsize (KiB) 11920

[startup+3.10019 s]
/proc/loadavg: 1.92 1.98 1.99 3/178 23163
/proc/meminfo: memFree=27031672/32873648 swapFree=6864/6864
[pid=23162] ppid=23160 vsize=11920 CPUtime=3.08 cores=0,2,4,6
/proc/23162/stat : 23162 (bsolo3.0.17) R 23160 23162 20253 0 -1 4202496 2564 0 0 0 307 1 0 0 20 0 1 0 343164771 12206080 2174 33554432000 134512640 135840783 4289913808 4289679984 134551048 0 0 4096 16384 0 0 0 17 0 0 0 0 0 0
/proc/23162/statm: 2980 2174 342 325 0 1916 0
Current children cumulated CPU time (s) 3.08
Current children cumulated vsize (KiB) 11920

[startup+6.30018 s]
/proc/loadavg: 1.93 1.98 1.99 3/178 23163
/proc/meminfo: memFree=27024976/32873648 swapFree=6864/6864
[pid=23162] ppid=23160 vsize=11920 CPUtime=6.28 cores=0,2,4,6
/proc/23162/stat : 23162 (bsolo3.0.17) R 23160 23162 20253 0 -1 4202496 2566 0 0 0 627 1 0 0 20 0 1 0 343164771 12206080 2176 33554432000 134512640 135840783 4289913808 4289680096 134583067 0 0 4096 16384 0 0 0 17 0 0 0 0 0 0
/proc/23162/statm: 2980 2176 342 325 0 1916 0
Current children cumulated CPU time (s) 6.28
Current children cumulated vsize (KiB) 11920

[startup+12.7002 s]
/proc/loadavg: 1.93 1.98 1.99 3/178 23163
/proc/meminfo: memFree=26997968/32873648 swapFree=6864/6864
[pid=23162] ppid=23160 vsize=18816 CPUtime=12.67 cores=0,2,4,6
/proc/23162/stat : 23162 (bsolo3.0.17) R 23160 23162 20253 0 -1 4202496 4512 0 0 0 1265 2 0 0 20 0 1 0 343164771 19267584 3932 33554432000 134512640 135840783 4289913808 4289913372 134552112 0 0 4096 16384 0 0 0 17 0 0 0 0 0 0
/proc/23162/statm: 4704 3932 347 325 0 3640 0
Current children cumulated CPU time (s) 12.67
Current children cumulated vsize (KiB) 18816

[startup+25.5003 s]
/proc/loadavg: 1.95 1.98 1.99 3/178 23165
/proc/meminfo: memFree=26944608/32873648 swapFree=6864/6864
[pid=23162] ppid=23160 vsize=41468 CPUtime=25.47 cores=0,2,4,6
/proc/23162/stat : 23162 (bsolo3.0.17) R 23160 23162 20253 0 -1 4202496 10166 0 0 0 2544 3 0 0 20 0 1 0 343164771 42463232 9586 33554432000 134512640 135840783 4289913808 4289913168 134550606 0 0 4096 16384 0 0 0 17 0 0 0 0 0 0
/proc/23162/statm: 10367 9586 347 325 0 9303 0
Current children cumulated CPU time (s) 25.47
Current children cumulated vsize (KiB) 41468

[startup+51.1003 s]
/proc/loadavg: 1.96 1.98 1.99 3/178 23166
/proc/meminfo: memFree=26841856/32873648 swapFree=6864/6864
[pid=23162] ppid=23160 vsize=81784 CPUtime=51.06 cores=0,2,4,6
/proc/23162/stat : 23162 (bsolo3.0.17) R 23160 23162 20253 0 -1 4202496 20267 0 0 0 5101 5 0 0 20 0 1 0 343164771 83746816 19687 33554432000 134512640 135840783 4289913808 4289913168 134551330 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/23162/statm: 20446 19687 347 325 0 19382 0
Current children cumulated CPU time (s) 51.06
Current children cumulated vsize (KiB) 81784

[startup+102.3 s]
/proc/loadavg: 2.06 2.00 2.00 3/177 23166
/proc/meminfo: memFree=26664668/32873648 swapFree=6864/6864
[pid=23162] ppid=23160 vsize=149680 CPUtime=102.27 cores=0,2,4,6
/proc/23162/stat : 23162 (bsolo3.0.17) R 23160 23162 20253 0 -1 4202496 37216 0 0 0 10218 9 0 0 20 0 1 0 343164771 153272320 36636 33554432000 134512640 135840783 4289913808 4289913120 134551330 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/23162/statm: 37420 36636 347 325 0 36356 0
Current children cumulated CPU time (s) 102.27
Current children cumulated vsize (KiB) 149680

[startup+162.3 s]
/proc/loadavg: 2.02 2.00 2.00 3/177 23166
/proc/meminfo: memFree=26459612/32873648 swapFree=6864/6864
[pid=23162] ppid=23160 vsize=254424 CPUtime=162.26 cores=0,2,4,6
/proc/23162/stat : 23162 (bsolo3.0.17) R 23160 23162 20253 0 -1 4202496 63406 0 0 0 16210 16 0 0 20 0 1 0 343164771 260530176 62826 33554432000 134512640 135840783 4289913808 4289913120 134550779 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/23162/statm: 63606 62826 347 325 0 62542 0
Current children cumulated CPU time (s) 162.26
Current children cumulated vsize (KiB) 254424

[startup+222.307 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 23166
/proc/meminfo: memFree=26312204/32873648 swapFree=6864/6864
[pid=23162] ppid=23160 vsize=320356 CPUtime=222.25 cores=0,2,4,6
/proc/23162/stat : 23162 (bsolo3.0.17) R 23160 23162 20253 0 -1 4202496 79893 0 0 0 22206 19 0 0 20 0 1 0 343164771 328044544 79313 33554432000 134512640 135840783 4289913808 4289913168 134550902 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/23162/statm: 80089 79313 347 325 0 79025 0
Current children cumulated CPU time (s) 222.25
Current children cumulated vsize (KiB) 320356

[startup+282.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 23166
/proc/meminfo: memFree=26139252/32873648 swapFree=6864/6864
[pid=23162] ppid=23160 vsize=434728 CPUtime=282.24 cores=0,2,4,6
/proc/23162/stat : 23162 (bsolo3.0.17) R 23160 23162 20253 0 -1 4202496 108497 0 0 0 28200 24 0 0 20 0 1 0 343164771 445161472 107917 33554432000 134512640 135840783 4289913808 4289908800 11715879 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/23162/statm: 108682 107917 347 325 0 107618 0
Current children cumulated CPU time (s) 282.24
Current children cumulated vsize (KiB) 434728

[startup+342.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/176 23166
/proc/meminfo: memFree=26014172/32873648 swapFree=6864/6864
[pid=23162] ppid=23160 vsize=491460 CPUtime=342.22 cores=0,2,4,6
/proc/23162/stat : 23162 (bsolo3.0.17) R 23160 23162 20253 0 -1 4202496 122670 0 0 0 34195 27 0 0 20 0 1 0 343164771 503255040 122090 33554432000 134512640 135840783 4289913808 4289913168 134551175 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/23162/statm: 122865 122090 347 325 0 121801 0
Current children cumulated CPU time (s) 342.22
Current children cumulated vsize (KiB) 491460

[startup+402.3 s]
/proc/loadavg: 2.07 2.02 2.00 3/177 23167
/proc/meminfo: memFree=25905320/32873648 swapFree=6864/6864
[pid=23162] ppid=23160 vsize=551964 CPUtime=402.22 cores=0,2,4,6
/proc/23162/stat : 23162 (bsolo3.0.17) R 23160 23162 20253 0 -1 4202496 137801 0 0 0 40191 31 0 0 20 0 1 0 343164771 565211136 137221 33554432000 134512640 135840783 4289913808 4289913168 134551175 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/23162/statm: 137991 137221 347 325 0 136927 0
Current children cumulated CPU time (s) 402.22
Current children cumulated vsize (KiB) 551964

[startup+462.3 s]
/proc/loadavg: 2.02 2.01 2.00 3/177 23167
/proc/meminfo: memFree=25764360/32873648 swapFree=6864/6864
[pid=23162] ppid=23160 vsize=636060 CPUtime=462.2 cores=0,2,4,6
/proc/23162/stat : 23162 (bsolo3.0.17) R 23160 23162 20253 0 -1 4202496 158817 0 0 0 46184 36 0 0 20 0 1 0 343164771 651325440 158237 33554432000 134512640 135840783 4289913808 4289913168 134550779 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/23162/statm: 159015 158237 347 325 0 157951 0
Current children cumulated CPU time (s) 462.2
Current children cumulated vsize (KiB) 636060

[startup+522.3 s]
/proc/loadavg: 2.01 2.00 2.00 3/177 23167
/proc/meminfo: memFree=25637304/32873648 swapFree=6864/6864
[pid=23162] ppid=23160 vsize=704560 CPUtime=522.2 cores=0,2,4,6
/proc/23162/stat : 23162 (bsolo3.0.17) R 23160 23162 20253 0 -1 4202496 175964 0 0 0 52180 40 0 0 20 0 1 0 343164771 721469440 175384 33554432000 134512640 135840783 4289913808 4289913168 134551330 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/23162/statm: 176140 175384 347 325 0 175076 0
Current children cumulated CPU time (s) 522.2
Current children cumulated vsize (KiB) 704560

[startup+582.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 23167
/proc/meminfo: memFree=25531544/32873648 swapFree=6864/6864
[pid=23162] ppid=23160 vsize=757116 CPUtime=582.19 cores=0,2,4,6
/proc/23162/stat : 23162 (bsolo3.0.17) R 23160 23162 20253 0 -1 4202496 189094 0 0 0 58176 43 0 0 20 0 1 0 343164771 775286784 188514 33554432000 134512640 135840783 4289913808 4289913168 134550779 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/23162/statm: 189279 188514 347 325 0 188215 0
Current children cumulated CPU time (s) 582.19
Current children cumulated vsize (KiB) 757116

[startup+642.3 s]

################
# More data... #
################

/proc/23162/stat : 23162 (bsolo3.0.17) R 23160 23162 20253 0 -1 4202496 302435 0 0 0 106139 72 0 0 20 0 1 0 343164771 1239511040 301855 33554432000 134512640 135840783 4289913808 4289913168 134550804 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/23162/statm: 302615 301855 347 325 0 301551 0
Current children cumulated CPU time (s) 1062.11
Current children cumulated vsize (KiB) 1210460

[startup+1122.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 23172
/proc/meminfo: memFree=24497072/32873648 swapFree=6864/6864
[pid=23162] ppid=23160 vsize=1281036 CPUtime=1122.11 cores=0,2,4,6
/proc/23162/stat : 23162 (bsolo3.0.17) R 23160 23162 20253 0 -1 4202496 320075 0 0 0 112134 77 0 0 20 0 1 0 343164771 1311780864 319495 33554432000 134512640 135840783 4289913808 4289913168 134551058 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/23162/statm: 320259 319495 347 325 0 319195 0
Current children cumulated CPU time (s) 1122.11
Current children cumulated vsize (KiB) 1281036

[startup+1182.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 23172
/proc/meminfo: memFree=24381808/32873648 swapFree=6864/6864
[pid=23162] ppid=23160 vsize=1338844 CPUtime=1182.09 cores=0,2,4,6
/proc/23162/stat : 23162 (bsolo3.0.17) R 23160 23162 20253 0 -1 4202496 334537 0 0 0 118130 79 0 0 20 0 1 0 343164771 1370976256 333957 33554432000 134512640 135840783 4289913808 4289910384 134574742 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/23162/statm: 334711 333957 347 325 0 333647 0
Current children cumulated CPU time (s) 1182.09
Current children cumulated vsize (KiB) 1338844

[startup+1242.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/178 23175
/proc/meminfo: memFree=24275504/32873648 swapFree=6864/6864
[pid=23162] ppid=23160 vsize=1400956 CPUtime=1242.09 cores=0,2,4,6
/proc/23162/stat : 23162 (bsolo3.0.17) R 23160 23162 20253 0 -1 4202496 350041 0 0 0 124126 83 0 0 20 0 1 0 343164771 1434578944 349461 33554432000 134512640 135840783 4289913808 4289913168 134550872 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/23162/statm: 350239 349461 347 325 0 349175 0
Current children cumulated CPU time (s) 1242.09
Current children cumulated vsize (KiB) 1400956

[startup+1302.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/179 23199
/proc/meminfo: memFree=24170076/32873648 swapFree=6864/6864
[pid=23162] ppid=23160 vsize=1476112 CPUtime=1302.08 cores=0,2,4,6
/proc/23162/stat : 23162 (bsolo3.0.17) R 23160 23162 20253 0 -1 4202496 368857 0 0 0 130121 87 0 0 20 0 1 0 343164771 1511538688 368277 33554432000 134512640 135840783 4289913808 4289901904 11715879 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/23162/statm: 369028 368277 347 325 0 367964 0
Current children cumulated CPU time (s) 1302.08
Current children cumulated vsize (KiB) 1476112

[startup+1362.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/178 23199
/proc/meminfo: memFree=24053676/32873648 swapFree=6864/6864
[pid=23162] ppid=23160 vsize=1536004 CPUtime=1362.07 cores=0,2,4,6
/proc/23162/stat : 23162 (bsolo3.0.17) R 23160 23162 20253 0 -1 4202496 383809 0 0 0 136116 91 0 0 20 0 1 0 343164771 1572868096 383229 33554432000 134512640 135840783 4289913808 4289913168 134550764 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/23162/statm: 384001 383229 347 325 0 382937 0
Current children cumulated CPU time (s) 1362.07
Current children cumulated vsize (KiB) 1536004

[startup+1422.3 s]
/proc/loadavg: 1.95 1.98 1.99 3/178 23238
/proc/meminfo: memFree=26230712/32873648 swapFree=6864/6864
[pid=23162] ppid=23160 vsize=1656092 CPUtime=1422.06 cores=0,2,4,6
/proc/23162/stat : 23162 (bsolo3.0.17) R 23160 23162 20253 0 -1 4202496 413849 0 0 0 142110 96 0 0 20 0 1 0 343164771 1695838208 413255 33554432000 134512640 135840783 4289913808 4289913120 134550913 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/23162/statm: 414023 413255 347 325 0 412959 0
Current children cumulated CPU time (s) 1422.06
Current children cumulated vsize (KiB) 1656092

[startup+1482.3 s]
/proc/loadavg: 1.98 1.98 1.99 3/178 23238
/proc/meminfo: memFree=26042648/32873648 swapFree=6864/6864
[pid=23162] ppid=23160 vsize=1715060 CPUtime=1482.01 cores=0,2,4,6
/proc/23162/stat : 23162 (bsolo3.0.17) R 23160 23162 20253 0 -1 4202496 428632 0 0 0 148102 99 0 0 20 0 1 0 343164771 1756221440 428003 33554432000 134512640 135840783 4289913808 4289913168 134551042 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/23162/statm: 428765 428003 347 325 0 427701 0
Current children cumulated CPU time (s) 1482.01
Current children cumulated vsize (KiB) 1715060

[startup+1542.31 s]
/proc/loadavg: 1.99 1.98 1.99 3/178 23238
/proc/meminfo: memFree=25856800/32873648 swapFree=6864/6864
[pid=23162] ppid=23160 vsize=1787956 CPUtime=1541.99 cores=0,2,4,6
/proc/23162/stat : 23162 (bsolo3.0.17) R 23160 23162 20253 0 -1 4202496 446893 0 0 0 154096 103 0 0 20 0 1 0 343164771 1830866944 446236 33554432000 134512640 135840783 4289913808 4289913088 11718319 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/23162/statm: 446989 446236 347 325 0 445925 0
Current children cumulated CPU time (s) 1541.99
Current children cumulated vsize (KiB) 1787956

[startup+1602.3 s]
/proc/loadavg: 1.99 1.98 1.99 3/178 23239
/proc/meminfo: memFree=25713612/32873648 swapFree=6864/6864
[pid=23162] ppid=23160 vsize=1849576 CPUtime=1601.96 cores=0,2,4,6
/proc/23162/stat : 23162 (bsolo3.0.17) R 23160 23162 20253 0 -1 4202496 462328 0 0 0 160089 107 0 0 20 0 1 0 343164771 1893965824 461639 33554432000 134512640 135840783 4289913808 4289913168 134550804 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/23162/statm: 462394 461639 347 325 0 461330 0
Current children cumulated CPU time (s) 1601.96
Current children cumulated vsize (KiB) 1849576

[startup+1662.3 s]
/proc/loadavg: 2.03 2.00 2.00 3/178 23239
/proc/meminfo: memFree=25493044/32873648 swapFree=6864/6864
[pid=23162] ppid=23160 vsize=1950132 CPUtime=1661.94 cores=0,2,4,6
/proc/23162/stat : 23162 (bsolo3.0.17) R 23160 23162 20253 0 -1 4202496 487478 0 0 0 166085 109 0 0 20 0 1 0 343164771 1996935168 486771 33554432000 134512640 135840783 4289913808 4289913168 134550779 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/23162/statm: 487533 486771 347 325 0 486469 0
Current children cumulated CPU time (s) 1661.94
Current children cumulated vsize (KiB) 1950132

[startup+1722.3 s]
/proc/loadavg: 2.01 2.00 2.00 3/178 23239
/proc/meminfo: memFree=25343036/32873648 swapFree=6864/6864
[pid=23162] ppid=23160 vsize=2052940 CPUtime=1721.91 cores=0,2,4,6
/proc/23162/stat : 23162 (bsolo3.0.17) R 23160 23162 20253 0 -1 4202496 513216 0 0 0 172078 113 0 0 20 0 1 0 343164771 2102210560 512476 33554432000 134512640 135840783 4289913808 4289913120 134551084 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/23162/statm: 513235 512476 347 325 0 512171 0
Current children cumulated CPU time (s) 1721.91
Current children cumulated vsize (KiB) 2052940

[startup+1782.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/178 23239
/proc/meminfo: memFree=25217080/32873648 swapFree=6864/6864
[pid=23162] ppid=23160 vsize=2130500 CPUtime=1781.9 cores=0,2,4,6
/proc/23162/stat : 23162 (bsolo3.0.17) R 23160 23162 20253 0 -1 4202496 532609 0 0 0 178072 118 0 0 20 0 1 0 343164771 2181632000 531851 33554432000 134512640 135840783 4289913808 4289913168 134550878 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/23162/statm: 532625 531851 347 325 0 531561 0
Current children cumulated CPU time (s) 1781.9
Current children cumulated vsize (KiB) 2130500



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1800.5 s]
/proc/loadavg: 2.00 2.00 2.00 3/178 23239
/proc/meminfo: memFree=25154056/32873648 swapFree=6864/6864
[pid=23162] ppid=23160 vsize=2162300 CPUtime=1800.1 cores=0,2,4,6
/proc/23162/stat : 23162 (bsolo3.0.17) R 23160 23162 20253 0 -1 4202496 540579 0 0 0 179890 120 0 0 20 0 1 0 343164771 2214195200 539816 33554432000 134512640 135840783 4289913808 4289913168 134551324 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/23162/statm: 540575 539816 347 325 0 539511 0
Current children cumulated CPU time (s) 1800.1
Current children cumulated vsize (KiB) 2162300

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Sending SIGKILL to process tree (bottom up)

Sending SIGKILL to -23162

Solver just ended. Dumping a history of the last processes samples

[startup+1801.5 s]
/proc/loadavg: 2.00 2.00 2.00 2/179 23240
/proc/meminfo: memFree=25154056/32873648 swapFree=6864/6864
[pid=23162] ppid=23160 vsize=2162300 CPUtime=1800.1 cores=0,2,4,6
/proc/23162/stat : 23162 (bsolo3.0.17) S 23160 23162 20253 0 -1 4202496 540580 0 0 0 179890 120 0 0 20 0 1 0 343164771 2214195200 539817 33554432000 134512640 135840783 4289913808 4289907396 5026864 0 16384 4096 16384 18446744071579510697 0 0 17 2 0 0 0 0 0
/proc/23162/statm: 540575 539817 348 325 0 539511 0
Current children cumulated CPU time (s) 1800.1
Current children cumulated vsize (KiB) 2162300

[startup+1802.3 s]
/proc/loadavg: 2.00 2.00 2.00 2/179 23240
/proc/meminfo: memFree=25153552/32873648 swapFree=6864/6864
[pid=23162] ppid=23160 vsize=2162300 CPUtime=1800.1 cores=0,2,4,6
/proc/23162/stat : 23162 (bsolo3.0.17) S 23160 23162 20253 0 -1 4202496 540580 0 0 0 179890 120 0 0 20 0 1 0 343164771 2214195200 539817 33554432000 134512640 135840783 4289913808 4289907396 5026864 0 16384 4096 16384 18446744071579510697 0 0 17 2 0 0 0 0 0
/proc/23162/statm: 540575 539817 348 325 0 539511 0
Current children cumulated CPU time (s) 1800.1
Current children cumulated vsize (KiB) 2162300

[startup+1802.5 s]
/proc/loadavg: 2.00 2.00 2.00 2/179 23240
/proc/meminfo: memFree=25153552/32873648 swapFree=6864/6864
[pid=23162] ppid=23160 vsize=2162300 CPUtime=1800.1 cores=0,2,4,6
/proc/23162/stat : 23162 (bsolo3.0.17) S 23160 23162 20253 0 -1 4202496 540580 0 0 0 179890 120 0 0 20 0 1 0 343164771 2214195200 539817 33554432000 134512640 135840783 4289913808 4289907396 5026864 0 16384 4096 16384 18446744071579510697 0 0 17 2 0 0 0 0 0
/proc/23162/statm: 540575 539817 348 325 0 539511 0
Current children cumulated CPU time (s) 1800.1
Current children cumulated vsize (KiB) 2162300

[startup+1802.6 s]
/proc/loadavg: 2.00 2.00 2.00 2/179 23240
/proc/meminfo: memFree=25153552/32873648 swapFree=6864/6864
[pid=23162] ppid=23160 vsize=0 CPUtime=1800.19 cores=0,2,4,6
/proc/23162/stat : 23162 (bsolo3.0.17) R 23160 23162 20253 0 -1 4203524 540580 0 0 0 179890 129 0 0 20 0 1 0 343164771 0 0 33554432000 0 0 0 0 0 0 16384 4096 16384 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/23162/statm: 0 0 0 0 0 0 0
Current children cumulated CPU time (s) 1800.19
Current children cumulated vsize (KiB) 0

Child ended because it received signal 9 (SIGKILL)
Real time (s): 1802.6
CPU time (s): 1800.2
CPU user time (s): 1798.91
CPU system time (s): 1.2968
CPU usage (%): 99.8669
Max. virtual memory (cumulated for all children) (KiB): 2162300

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1798.91
system time used= 1.2968
maximum resident set size= 2159268
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 540580
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 209
involuntary context switches= 2007

runsolver used 3.23851 second user time and 7.45387 second system time

The end

Launcher Data 

Begin job on node113 at 2012-06-04 02:39:39
IDJOB=3742386
IDBENCH=90172
IDSOLVER=2318
FILE ID=node113/3742386-1338770379
RUNJOBID= node113-1338748314-20269
PBS_JOBID= 14636785
Free space on /tmp= 70972 MiB

SOLVER NAME= PB07: bsolo 3.0.17
BENCH NAME= PB12/normalized-PB12/DEC-SMALLINT-LIN/sroussel/ShortestPathNG/normalized-NG_K163.opb
COMMAND LINE= bsolo3.0.17 -mMEMLIMIT BENCHNAME            
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3742386-1338770379/watcher-3742386-1338770379 -o /tmp/evaluation-result-3742386-1338770379/solver-3742386-1338770379 -C 1800 -W 1900 -M 15500  bsolo3.0.17 -m15500 HOME/instance-3742386-1338770379.opb            

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 5c9e224cdd9eef3594ee47236fa33798
RANDOM SEED=1577485441

node113.alineos.net Linux 2.6.32-71.29.1.el6.x86_64 #1 SMP Mon Jun 27 19:49:27 BST 2011

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.026
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5334.05
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.026
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.90
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.026
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5438.54
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.026
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.026
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.026
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.026
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.92
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.026
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32873648 kB
MemFree:        27045740 kB
Buffers:          538768 kB
Cached:          3499080 kB
SwapCached:         2028 kB
Active:          2638788 kB
Inactive:        2287404 kB
Active(anon):     887240 kB
Inactive(anon):     1912 kB
Active(file):    1751548 kB
Inactive(file):  2285492 kB
Unevictable:        6864 kB
Mlocked:            6864 kB
SwapTotal:      67108856 kB
SwapFree:       67099708 kB
Dirty:              7948 kB
Writeback:             0 kB
AnonPages:        892028 kB
Mapped:            12564 kB
Shmem:                 0 kB
Slab:             763864 kB
SReclaimable:     207800 kB
SUnreclaim:       556064 kB
KernelStack:        1448 kB
PageTables:         5932 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83545680 kB
Committed_AS:    1007576 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      346400 kB
VmallocChunk:   34341988052 kB
HardwareCorrupted:     0 kB
AnonHugePages:         0 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:        7680 kB
DirectMap2M:    33538048 kB

Free space on /tmp at the end= 70964 MiB
End job on node113 at 2012-06-04 03:09:42