Trace number 3700659

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
npSolver 1.0? (TO) 1800.03 1801.42

General information on the benchmark

NameOPT-BIGINT-LIN/graca/
normalized-ped2.G.recomb5-0.10-9.opb
MD5SUMeb1486293241c3bbd58eaf083201528e
Bench CategoryOPT-BIGINT-LIN (optimisation, big integers, linear constraints)
Best result obtained on this benchmarkSAT
Best value of the objective obtained on this benchmark89020
Best CPU time to get the best result obtained on this benchmark1800.4
Has Objective FunctionYES
Satisfiable
(Un)Satisfiability was proved
Best value of the objective function
Optimality of the best value was proved
Number of variables212153
Total number of constraints2591417
Number of constraints which are clauses2591417
Number of constraints which are cardinality constraints (but not clauses)0
Number of constraints which are nor clauses,nor cardinality constraints0
Minimum length of a constraint1
Maximum length of a constraint579
Number of terms in the objective function 18980
Biggest coefficient in the objective function 581
Number of bits for the biggest coefficient in the objective function 10
Sum of the numbers in the objective function 10690980
Number of bits of the sum of numbers in the objective function 24
Biggest number in a constraint 581
Number of bits of the biggest number in a constraint 10
Biggest sum of numbers in a constraint 10690980
Number of bits of the biggest sum of numbers24
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Solver Data 

7.19/7.22	c run usual solver
15.08/16.02	c model valid
15.08/16.02	c current solution ok
16.47/17.54	o 228485
16.47/17.54	c current bound: 114242
16.47/17.54	c fallback to adder encoding
1800.03/1801.41	c error: unexpected solver exit code
1800.03/1801.41	s UNKNOWN

Verifier Data 

ERROR: no interpretation found !

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.1 (svn: 989)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3700659-1338144818/watcher-3700659-1338144818 -o /tmp/evaluation-result-3700659-1338144818/solver-3700659-1338144818 -C 1800 -W 1900 -M 15500 HOME/npSolver-pbo.sh HOME/instance-3700659-1338144818.opb 1983189677 HOME HOME 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1900 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 1.94 1.99 1.99 3/179 23831
/proc/meminfo: memFree=29403448/32873648 swapFree=7116/7116
[pid=23831] ppid=23829 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/23831/stat : 23831 (npSolver-pbo.sh) S 23829 23831 21157 0 -1 4202496 358 0 0 0 0 0 0 0 20 0 1 0 280609356 9367552 275 33554432000 4194304 5064252 140736014174000 140736014172912 219513775694 0 65536 4100 65538 18446744071579302229 0 0 17 3 0 0 0 0 0
/proc/23831/statm: 2287 275 233 213 0 72 0

[startup+0.071827 s]
/proc/loadavg: 1.94 1.99 1.99 3/179 23831
/proc/meminfo: memFree=29403448/32873648 swapFree=7116/7116
[pid=23831] ppid=23829 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/23831/stat : 23831 (npSolver-pbo.sh) S 23829 23831 21157 0 -1 4202496 358 0 0 0 0 0 0 0 20 0 1 0 280609356 9367552 275 33554432000 4194304 5064252 140736014174000 140736014172912 219513775694 0 65536 4100 65538 18446744071579302229 0 0 17 3 0 0 0 0 0
/proc/23831/statm: 2287 275 233 213 0 72 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 9148

[startup+0.10026 s]
/proc/loadavg: 1.94 1.99 1.99 3/179 23831
/proc/meminfo: memFree=29403448/32873648 swapFree=7116/7116
[pid=23831] ppid=23829 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/23831/stat : 23831 (npSolver-pbo.sh) S 23829 23831 21157 0 -1 4202496 358 0 0 0 0 0 0 0 20 0 1 0 280609356 9367552 275 33554432000 4194304 5064252 140736014174000 140736014172912 219513775694 0 65536 4100 65538 18446744071579302229 0 0 17 3 0 0 0 0 0
/proc/23831/statm: 2287 275 233 213 0 72 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 9148

[startup+0.300212 s]
/proc/loadavg: 1.94 1.99 1.99 3/179 23831
/proc/meminfo: memFree=29403448/32873648 swapFree=7116/7116
[pid=23831] ppid=23829 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/23831/stat : 23831 (npSolver-pbo.sh) S 23829 23831 21157 0 -1 4202496 358 0 0 0 0 0 0 0 20 0 1 0 280609356 9367552 275 33554432000 4194304 5064252 140736014174000 140736014172912 219513775694 0 65536 4100 65538 18446744071579302229 0 0 17 3 0 0 0 0 0
/proc/23831/statm: 2287 275 233 213 0 72 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 9148

[startup+0.700231 s]
/proc/loadavg: 1.94 1.99 1.99 3/179 23831
/proc/meminfo: memFree=29403448/32873648 swapFree=7116/7116
[pid=23831] ppid=23829 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/23831/stat : 23831 (npSolver-pbo.sh) S 23829 23831 21157 0 -1 4202496 358 0 0 0 0 0 0 0 20 0 1 0 280609356 9367552 275 33554432000 4194304 5064252 140736014174000 140736014172912 219513775694 0 65536 4100 65538 18446744071579302229 0 0 17 3 0 0 0 0 0
/proc/23831/statm: 2287 275 233 213 0 72 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 9148

[startup+1.50031 s]
/proc/loadavg: 1.94 1.99 1.99 3/181 23833
/proc/meminfo: memFree=29395056/32873648 swapFree=7116/7116
[pid=23831] ppid=23829 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/23831/stat : 23831 (npSolver-pbo.sh) S 23829 23831 21157 0 -1 4202496 358 0 0 0 0 0 0 0 20 0 1 0 280609356 9367552 275 33554432000 4194304 5064252 140736014174000 140736014172912 219513775694 0 65536 4100 65538 18446744071579302229 0 0 17 3 0 0 0 0 0
/proc/23831/statm: 2287 275 233 213 0 72 0
[pid=23832] ppid=23831 vsize=19632 CPUtime=1.48 cores=1,3,5,7
/proc/23832/stat : 23832 (npSolver-pbo) R 23831 23831 21157 0 -1 4202496 2740 0 0 0 148 0 0 0 20 0 1 0 280609356 20103168 3222 33554432000 4194304 5992684 140737468580064 140737468576184 5179600 0 0 4096 0 0 0 0 17 1 0 0 0 0 0
/proc/23832/statm: 4908 3222 145 440 0 4464 0
Current children cumulated CPU time (s) 1.48
Current children cumulated vsize (KiB) 28780

[startup+3.10026 s]
/proc/loadavg: 1.94 1.99 1.99 3/181 23833
/proc/meminfo: memFree=29386152/32873648 swapFree=7116/7116
[pid=23831] ppid=23829 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/23831/stat : 23831 (npSolver-pbo.sh) S 23829 23831 21157 0 -1 4202496 358 0 0 0 0 0 0 0 20 0 1 0 280609356 9367552 275 33554432000 4194304 5064252 140736014174000 140736014172912 219513775694 0 65536 4100 65538 18446744071579302229 0 0 17 3 0 0 0 0 0
/proc/23831/statm: 2287 275 233 213 0 72 0
[pid=23832] ppid=23831 vsize=36808 CPUtime=3.08 cores=1,3,5,7
/proc/23832/stat : 23832 (npSolver-pbo) R 23831 23831 21157 0 -1 4202496 3434 0 0 0 307 1 0 0 20 0 1 0 280609356 37691392 5952 33554432000 4194304 5992684 140737468580064 140737468576184 5179600 0 0 4096 0 0 0 0 17 1 0 0 0 0 0
/proc/23832/statm: 9202 5952 145 440 0 8758 0
Current children cumulated CPU time (s) 3.08
Current children cumulated vsize (KiB) 45956

[startup+6.30025 s]
/proc/loadavg: 1.94 1.99 1.99 3/181 23833
/proc/meminfo: memFree=29361848/32873648 swapFree=7116/7116
[pid=23831] ppid=23829 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/23831/stat : 23831 (npSolver-pbo.sh) S 23829 23831 21157 0 -1 4202496 358 0 0 0 0 0 0 0 20 0 1 0 280609356 9367552 275 33554432000 4194304 5064252 140736014174000 140736014172912 219513775694 0 65536 4100 65538 18446744071579302229 0 0 17 3 0 0 0 0 0
/proc/23831/statm: 2287 275 233 213 0 72 0
[pid=23832] ppid=23831 vsize=70896 CPUtime=6.29 cores=1,3,5,7
/proc/23832/stat : 23832 (npSolver-pbo) R 23831 23831 21157 0 -1 4202496 4308 0 0 0 626 3 0 0 20 0 1 0 280609356 72597504 11409 33554432000 4194304 5992684 140737468580064 140737468576184 5179600 0 0 4096 0 0 0 0 17 1 0 0 0 0 0
/proc/23832/statm: 17724 11409 145 440 0 17280 0
Current children cumulated CPU time (s) 6.29
Current children cumulated vsize (KiB) 80044

[startup+12.7002 s]
/proc/loadavg: 1.95 1.99 1.99 2/183 23836
/proc/meminfo: memFree=29264852/32873648 swapFree=7116/7116
[pid=23831] ppid=23829 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/23831/stat : 23831 (npSolver-pbo.sh) S 23829 23831 21157 0 -1 4202496 358 0 0 0 0 0 0 0 20 0 1 0 280609356 9367552 275 33554432000 4194304 5064252 140736014174000 140736014172912 219513775694 0 65536 4100 65538 18446744071579302229 0 0 17 3 0 0 0 0 0
/proc/23831/statm: 2287 275 233 213 0 72 0
[pid=23832] ppid=23831 vsize=93016 CPUtime=11.75 cores=1,3,5,7
/proc/23832/stat : 23832 (npSolver-pbo) S 23831 23831 21157 0 -1 4202496 10593 59316 0 0 710 15 406 44 20 0 1 0 280609356 95248384 20560 33554432000 4194304 5992684 140737468580064 140737468574672 5175646 0 65536 4102 0 18446744071579302229 0 0 17 1 0 0 0 0 0
/proc/23832/statm: 23254 20560 164 440 0 22810 0
Current children cumulated CPU time (s) 11.75
Current children cumulated vsize (KiB) 102164

[startup+25.5003 s]
/proc/loadavg: 1.97 1.99 1.99 3/183 23845
/proc/meminfo: memFree=28663772/32873648 swapFree=7116/7116
[pid=23831] ppid=23829 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/23831/stat : 23831 (npSolver-pbo.sh) S 23829 23831 21157 0 -1 4202496 358 0 0 0 0 0 0 0 20 0 1 0 280609356 9367552 275 33554432000 4194304 5064252 140736014174000 140736014172912 219513775694 0 65536 4100 65538 18446744071579302229 0 0 17 3 0 0 0 0 0
/proc/23831/statm: 2287 275 233 213 0 72 0
[pid=23832] ppid=23831 vsize=241596 CPUtime=18.38 cores=1,3,5,7
/proc/23832/stat : 23832 (npSolver-pbo) S 23831 23831 21157 0 -1 4202496 20188 66047 0 0 1211 155 424 48 20 0 1 0 280609356 247394304 55899 33554432000 4194304 5992684 140737468580064 140737468572384 5175646 0 65536 4102 0 18446744071579302229 0 0 17 1 0 0 11 0 0
/proc/23832/statm: 60399 55899 181 440 0 59955 0
[pid=23844] ppid=23832 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/23844/stat : 23844 (satsolver.sh) S 23832 23831 21157 0 -1 4202496 598 0 0 0 0 0 0 0 20 0 1 0 280611299 9367552 267 33554432000 4194304 5064252 140735618741968 140735618740880 219513775694 0 65536 4100 65538 18446744071579302229 0 0 17 7 0 0 0 0 0
/proc/23844/statm: 2287 267 226 213 0 72 0
[pid=23845] ppid=23844 vsize=398596 CPUtime=6.05 cores=1,3,5,7
/proc/23845/stat : 23845 (glucose) R 23844 23831 21157 0 -1 4202496 64096 0 0 0 587 18 0 0 20 0 1 0 280611300 408162304 89593 33554432000 4194304 5208918 140734689302496 140734689300168 4211712 0 0 4096 0 0 0 0 17 3 0 0 0 0 0
/proc/23845/statm: 99649 89593 105 248 0 99398 0
Current children cumulated CPU time (s) 24.43
Current children cumulated vsize (KiB) 658488

[startup+51.1003 s]
/proc/loadavg: 1.98 1.99 1.99 3/183 23845
/proc/meminfo: memFree=28655868/32873648 swapFree=7116/7116
[pid=23831] ppid=23829 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/23831/stat : 23831 (npSolver-pbo.sh) S 23829 23831 21157 0 -1 4202496 358 0 0 0 0 0 0 0 20 0 1 0 280609356 9367552 275 33554432000 4194304 5064252 140736014174000 140736014172912 219513775694 0 65536 4100 65538 18446744071579302229 0 0 17 3 0 0 0 0 0
/proc/23831/statm: 2287 275 233 213 0 72 0
[pid=23832] ppid=23831 vsize=241596 CPUtime=18.38 cores=1,3,5,7
/proc/23832/stat : 23832 (npSolver-pbo) S 23831 23831 21157 0 -1 4202496 20188 66047 0 0 1211 155 424 48 20 0 1 0 280609356 247394304 55899 33554432000 4194304 5992684 140737468580064 140737468572384 5175646 0 65536 4102 0 18446744071579302229 0 0 17 1 0 0 11 0 0
/proc/23832/statm: 60399 55899 181 440 0 59955 0
[pid=23844] ppid=23832 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/23844/stat : 23844 (satsolver.sh) S 23832 23831 21157 0 -1 4202496 598 0 0 0 0 0 0 0 20 0 1 0 280611299 9367552 267 33554432000 4194304 5064252 140735618741968 140735618740880 219513775694 0 65536 4100 65538 18446744071579302229 0 0 17 7 0 0 0 0 0
/proc/23844/statm: 2287 267 226 213 0 72 0
[pid=23845] ppid=23844 vsize=452048 CPUtime=31.65 cores=1,3,5,7
/proc/23845/stat : 23845 (glucose) R 23844 23831 21157 0 -1 4202496 65512 0 0 0 3146 19 0 0 20 0 1 0 280611300 462897152 91991 33554432000 4194304 5208918 140734689302496 140734689300248 4229528 0 0 4096 0 0 0 0 17 3 0 0 0 0 0
/proc/23845/statm: 113012 91991 105 248 0 112761 0
Current children cumulated CPU time (s) 50.03
Current children cumulated vsize (KiB) 711940

[startup+102.307 s]
/proc/loadavg: 2.07 2.01 2.00 3/183 23897
/proc/meminfo: memFree=27787928/32873648 swapFree=7116/7116
[pid=23831] ppid=23829 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/23831/stat : 23831 (npSolver-pbo.sh) S 23829 23831 21157 0 -1 4202496 358 0 0 0 0 0 0 0 20 0 1 0 280609356 9367552 275 33554432000 4194304 5064252 140736014174000 140736014172912 219513775694 0 65536 4100 65538 18446744071579302229 0 0 17 3 0 0 0 0 0
/proc/23831/statm: 2287 275 233 213 0 72 0
[pid=23832] ppid=23831 vsize=241596 CPUtime=18.38 cores=1,3,5,7
/proc/23832/stat : 23832 (npSolver-pbo) S 23831 23831 21157 0 -1 4202496 20188 66047 0 0 1211 155 424 48 20 0 1 0 280609356 247394304 55899 33554432000 4194304 5992684 140737468580064 140737468572384 5175646 0 65536 4102 0 18446744071579302229 0 0 17 1 0 0 11 0 0
/proc/23832/statm: 60399 55899 181 440 0 59955 0
[pid=23844] ppid=23832 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/23844/stat : 23844 (satsolver.sh) S 23832 23831 21157 0 -1 4202496 598 0 0 0 0 0 0 0 20 0 1 0 280611299 9367552 267 33554432000 4194304 5064252 140735618741968 140735618740880 219513775694 0 65536 4100 65538 18446744071579302229 0 0 17 7 0 0 0 0 0
/proc/23844/statm: 2287 267 226 213 0 72 0
[pid=23845] ppid=23844 vsize=452048 CPUtime=82.85 cores=1,3,5,7
/proc/23845/stat : 23845 (glucose) R 23844 23831 21157 0 -1 4202496 65530 0 0 0 8266 19 0 0 20 0 1 0 280611300 462897152 92520 33554432000 4194304 5208918 140734689302496 140734689300248 4211182 0 0 4096 0 0 0 0 17 3 0 0 0 0 0
/proc/23845/statm: 113012 92520 105 248 0 112761 0
Current children cumulated CPU time (s) 101.23
Current children cumulated vsize (KiB) 711940

[startup+162.3 s]
/proc/loadavg: 2.02 2.00 2.00 3/183 23897
/proc/meminfo: memFree=27769396/32873648 swapFree=7116/7116
[pid=23831] ppid=23829 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/23831/stat : 23831 (npSolver-pbo.sh) S 23829 23831 21157 0 -1 4202496 358 0 0 0 0 0 0 0 20 0 1 0 280609356 9367552 275 33554432000 4194304 5064252 140736014174000 140736014172912 219513775694 0 65536 4100 65538 18446744071579302229 0 0 17 3 0 0 0 0 0
/proc/23831/statm: 2287 275 233 213 0 72 0
[pid=23832] ppid=23831 vsize=241596 CPUtime=18.38 cores=1,3,5,7
/proc/23832/stat : 23832 (npSolver-pbo) S 23831 23831 21157 0 -1 4202496 20188 66047 0 0 1211 155 424 48 20 0 1 0 280609356 247394304 55899 33554432000 4194304 5992684 140737468580064 140737468572384 5175646 0 65536 4102 0 18446744071579302229 0 0 17 1 0 0 11 0 0
/proc/23832/statm: 60399 55899 181 440 0 59955 0
[pid=23844] ppid=23832 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/23844/stat : 23844 (satsolver.sh) S 23832 23831 21157 0 -1 4202496 598 0 0 0 0 0 0 0 20 0 1 0 280611299 9367552 267 33554432000 4194304 5064252 140735618741968 140735618740880 219513775694 0 65536 4100 65538 18446744071579302229 0 0 17 7 0 0 0 0 0
/proc/23844/statm: 2287 267 226 213 0 72 0
[pid=23845] ppid=23844 vsize=470924 CPUtime=142.83 cores=1,3,5,7
/proc/23845/stat : 23845 (glucose) R 23844 23831 21157 0 -1 4202496 70752 0 0 0 14258 25 0 0 20 0 1 0 280611300 482226176 97042 33554432000 4194304 5208918 140734689302496 140734689298872 4229424 0 0 4096 0 0 0 0 17 3 0 0 0 0 0
/proc/23845/statm: 117731 97042 105 248 0 117480 0
Current children cumulated CPU time (s) 161.21
Current children cumulated vsize (KiB) 730816

[startup+222.3 s]
/proc/loadavg: 2.01 2.00 2.00 3/183 23897
/proc/meminfo: memFree=27731208/32873648 swapFree=7120/7120
[pid=23831] ppid=23829 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/23831/stat : 23831 (npSolver-pbo.sh) S 23829 23831 21157 0 -1 4202496 358 0 0 0 0 0 0 0 20 0 1 0 280609356 9367552 275 33554432000 4194304 5064252 140736014174000 140736014172912 219513775694 0 65536 4100 65538 18446744071579302229 0 0 17 3 0 0 0 0 0
/proc/23831/statm: 2287 275 233 213 0 72 0
[pid=23832] ppid=23831 vsize=241596 CPUtime=18.38 cores=1,3,5,7
/proc/23832/stat : 23832 (npSolver-pbo) S 23831 23831 21157 0 -1 4202496 20188 66047 0 0 1211 155 424 48 20 0 1 0 280609356 247394304 55899 33554432000 4194304 5992684 140737468580064 140737468572384 5175646 0 65536 4102 0 18446744071579302229 0 0 17 1 0 0 11 0 0
/proc/23832/statm: 60399 55899 181 440 0 59955 0
[pid=23844] ppid=23832 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/23844/stat : 23844 (satsolver.sh) S 23832 23831 21157 0 -1 4202496 598 0 0 0 0 0 0 0 20 0 1 0 280611299 9367552 267 33554432000 4194304 5064252 140735618741968 140735618740880 219513775694 0 65536 4100 65538 18446744071579302229 0 0 17 7 0 0 0 0 0
/proc/23844/statm: 2287 267 226 213 0 72 0
[pid=23845] ppid=23844 vsize=489736 CPUtime=202.82 cores=1,3,5,7
/proc/23845/stat : 23845 (glucose) R 23844 23831 21157 0 -1 4202496 76654 0 0 0 20250 32 0 0 20 0 1 0 280611300 501489664 106368 33554432000 4194304 5208918 140734689302496 140734689300344 4228997 0 0 4096 0 0 0 0 17 3 0 0 0 0 0
/proc/23845/statm: 122434 106368 105 248 0 122183 0
Current children cumulated CPU time (s) 221.2

################
# More data... #
################

/proc/23845/stat : 23845 (glucose) R 23844 23831 21157 0 -1 4202496 115631 0 0 0 134157 104 0 0 20 0 1 0 280611300 711987200 150756 33554432000 4194304 5208918 140734689302496 140734689300344 4211553 0 0 4096 0 0 0 0 17 3 0 0 0 0 0
/proc/23845/statm: 173825 150756 105 248 0 173574 0
Current children cumulated CPU time (s) 1360.99
Current children cumulated vsize (KiB) 955192

[startup+1422.31 s]
/proc/loadavg: 2.00 2.00 2.00 3/183 23930
/proc/meminfo: memFree=27378120/32873648 swapFree=7116/7116
[pid=23831] ppid=23829 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/23831/stat : 23831 (npSolver-pbo.sh) S 23829 23831 21157 0 -1 4202496 358 0 0 0 0 0 0 0 20 0 1 0 280609356 9367552 275 33554432000 4194304 5064252 140736014174000 140736014172912 219513775694 0 65536 4100 65538 18446744071579302229 0 0 17 3 0 0 0 0 0
/proc/23831/statm: 2287 275 233 213 0 72 0
[pid=23832] ppid=23831 vsize=241596 CPUtime=18.38 cores=1,3,5,7
/proc/23832/stat : 23832 (npSolver-pbo) S 23831 23831 21157 0 -1 4202496 20188 66047 0 0 1211 155 424 48 20 0 1 0 280609356 247394304 55899 33554432000 4194304 5992684 140737468580064 140737468572384 5175646 0 65536 4102 0 18446744071579302229 0 0 17 1 0 0 11 0 0
/proc/23832/statm: 60399 55899 181 440 0 59955 0
[pid=23844] ppid=23832 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/23844/stat : 23844 (satsolver.sh) S 23832 23831 21157 0 -1 4202496 598 0 0 0 0 0 0 0 20 0 1 0 280611299 9367552 267 33554432000 4194304 5064252 140735618741968 140735618740880 219513775694 0 65536 4100 65538 18446744071579302229 0 0 17 7 0 0 0 0 0
/proc/23844/statm: 2287 267 226 213 0 72 0
[pid=23845] ppid=23844 vsize=699208 CPUtime=1402.62 cores=1,3,5,7
/proc/23845/stat : 23845 (glucose) R 23844 23831 21157 0 -1 4202496 116615 0 0 0 140157 105 0 0 20 0 1 0 280611300 715988992 155828 33554432000 4194304 5208918 140734689302496 140734689300344 4211584 0 0 4096 0 0 0 0 17 3 0 0 0 0 0
/proc/23845/statm: 174802 155828 105 248 0 174551 0
Current children cumulated CPU time (s) 1421
Current children cumulated vsize (KiB) 959100

[startup+1482.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/183 23931
/proc/meminfo: memFree=27385400/32873648 swapFree=7116/7116
[pid=23831] ppid=23829 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/23831/stat : 23831 (npSolver-pbo.sh) S 23829 23831 21157 0 -1 4202496 358 0 0 0 0 0 0 0 20 0 1 0 280609356 9367552 275 33554432000 4194304 5064252 140736014174000 140736014172912 219513775694 0 65536 4100 65538 18446744071579302229 0 0 17 3 0 0 0 0 0
/proc/23831/statm: 2287 275 233 213 0 72 0
[pid=23832] ppid=23831 vsize=241596 CPUtime=18.38 cores=1,3,5,7
/proc/23832/stat : 23832 (npSolver-pbo) S 23831 23831 21157 0 -1 4202496 20188 66047 0 0 1211 155 424 48 20 0 1 0 280609356 247394304 55899 33554432000 4194304 5992684 140737468580064 140737468572384 5175646 0 65536 4102 0 18446744071579302229 0 0 17 1 0 0 11 0 0
/proc/23832/statm: 60399 55899 181 440 0 59955 0
[pid=23844] ppid=23832 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/23844/stat : 23844 (satsolver.sh) S 23832 23831 21157 0 -1 4202496 598 0 0 0 0 0 0 0 20 0 1 0 280611299 9367552 267 33554432000 4194304 5064252 140735618741968 140735618740880 219513775694 0 65536 4100 65538 18446744071579302229 0 0 17 7 0 0 0 0 0
/proc/23844/statm: 2287 267 226 213 0 72 0
[pid=23845] ppid=23844 vsize=622328 CPUtime=1462.6 cores=1,3,5,7
/proc/23845/stat : 23845 (glucose) R 23844 23831 21157 0 -1 4202496 118040 0 0 0 146151 109 0 0 20 0 1 0 280611300 637263872 147751 33554432000 4194304 5208918 140734689302496 140734689300248 4211553 0 0 4096 0 0 0 0 17 3 0 0 0 0 0
/proc/23845/statm: 155582 147751 105 248 0 155331 0
Current children cumulated CPU time (s) 1480.98
Current children cumulated vsize (KiB) 882220

[startup+1542.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/183 23931
/proc/meminfo: memFree=27332308/32873648 swapFree=7116/7116
[pid=23831] ppid=23829 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/23831/stat : 23831 (npSolver-pbo.sh) S 23829 23831 21157 0 -1 4202496 358 0 0 0 0 0 0 0 20 0 1 0 280609356 9367552 275 33554432000 4194304 5064252 140736014174000 140736014172912 219513775694 0 65536 4100 65538 18446744071579302229 0 0 17 3 0 0 0 0 0
/proc/23831/statm: 2287 275 233 213 0 72 0
[pid=23832] ppid=23831 vsize=241596 CPUtime=18.38 cores=1,3,5,7
/proc/23832/stat : 23832 (npSolver-pbo) S 23831 23831 21157 0 -1 4202496 20188 66047 0 0 1211 155 424 48 20 0 1 0 280609356 247394304 55899 33554432000 4194304 5992684 140737468580064 140737468572384 5175646 0 65536 4102 0 18446744071579302229 0 0 17 1 0 0 11 0 0
/proc/23832/statm: 60399 55899 181 440 0 59955 0
[pid=23844] ppid=23832 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/23844/stat : 23844 (satsolver.sh) S 23832 23831 21157 0 -1 4202496 598 0 0 0 0 0 0 0 20 0 1 0 280611299 9367552 267 33554432000 4194304 5064252 140735618741968 140735618740880 219513775694 0 65536 4100 65538 18446744071579302229 0 0 17 7 0 0 0 0 0
/proc/23844/statm: 2287 267 226 213 0 72 0
[pid=23845] ppid=23844 vsize=707612 CPUtime=1522.59 cores=1,3,5,7
/proc/23845/stat : 23845 (glucose) R 23844 23831 21157 0 -1 4202496 119200 0 0 0 152148 111 0 0 20 0 1 0 280611300 724594688 156565 33554432000 4194304 5208918 140734689302496 140734689300248 4211605 0 0 4096 0 0 0 0 17 3 0 0 0 0 0
/proc/23845/statm: 176903 156565 105 248 0 176652 0
Current children cumulated CPU time (s) 1540.97
Current children cumulated vsize (KiB) 967504

[startup+1602.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/184 23934
/proc/meminfo: memFree=27282692/32873648 swapFree=7116/7116
[pid=23831] ppid=23829 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/23831/stat : 23831 (npSolver-pbo.sh) S 23829 23831 21157 0 -1 4202496 358 0 0 0 0 0 0 0 20 0 1 0 280609356 9367552 275 33554432000 4194304 5064252 140736014174000 140736014172912 219513775694 0 65536 4100 65538 18446744071579302229 0 0 17 3 0 0 0 0 0
/proc/23831/statm: 2287 275 233 213 0 72 0
[pid=23832] ppid=23831 vsize=241596 CPUtime=18.38 cores=1,3,5,7
/proc/23832/stat : 23832 (npSolver-pbo) S 23831 23831 21157 0 -1 4202496 20188 66047 0 0 1211 155 424 48 20 0 1 0 280609356 247394304 55899 33554432000 4194304 5992684 140737468580064 140737468572384 5175646 0 65536 4102 0 18446744071579302229 0 0 17 1 0 0 11 0 0
/proc/23832/statm: 60399 55899 181 440 0 59955 0
[pid=23844] ppid=23832 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/23844/stat : 23844 (satsolver.sh) S 23832 23831 21157 0 -1 4202496 598 0 0 0 0 0 0 0 20 0 1 0 280611299 9367552 267 33554432000 4194304 5064252 140735618741968 140735618740880 219513775694 0 65536 4100 65538 18446744071579302229 0 0 17 7 0 0 0 0 0
/proc/23844/statm: 2287 267 226 213 0 72 0
[pid=23845] ppid=23844 vsize=710224 CPUtime=1582.57 cores=1,3,5,7
/proc/23845/stat : 23845 (glucose) R 23844 23831 21157 0 -1 4202496 119898 0 0 0 158146 111 0 0 20 0 1 0 280611300 727269376 162373 33554432000 4194304 5208918 140734689302496 140734689300344 4211901 0 0 4096 0 0 0 0 17 3 0 0 0 0 0
/proc/23845/statm: 177556 162373 105 248 0 177305 0
Current children cumulated CPU time (s) 1600.95
Current children cumulated vsize (KiB) 970116

[startup+1662.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/183 23934
/proc/meminfo: memFree=27328896/32873648 swapFree=7116/7116
[pid=23831] ppid=23829 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/23831/stat : 23831 (npSolver-pbo.sh) S 23829 23831 21157 0 -1 4202496 358 0 0 0 0 0 0 0 20 0 1 0 280609356 9367552 275 33554432000 4194304 5064252 140736014174000 140736014172912 219513775694 0 65536 4100 65538 18446744071579302229 0 0 17 3 0 0 0 0 0
/proc/23831/statm: 2287 275 233 213 0 72 0
[pid=23832] ppid=23831 vsize=241596 CPUtime=18.38 cores=1,3,5,7
/proc/23832/stat : 23832 (npSolver-pbo) S 23831 23831 21157 0 -1 4202496 20188 66047 0 0 1211 155 424 48 20 0 1 0 280609356 247394304 55899 33554432000 4194304 5992684 140737468580064 140737468572384 5175646 0 65536 4102 0 18446744071579302229 0 0 17 1 0 0 11 0 0
/proc/23832/statm: 60399 55899 181 440 0 59955 0
[pid=23844] ppid=23832 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/23844/stat : 23844 (satsolver.sh) S 23832 23831 21157 0 -1 4202496 598 0 0 0 0 0 0 0 20 0 1 0 280611299 9367552 267 33554432000 4194304 5064252 140735618741968 140735618740880 219513775694 0 65536 4100 65538 18446744071579302229 0 0 17 7 0 0 0 0 0
/proc/23844/statm: 2287 267 226 213 0 72 0
[pid=23845] ppid=23844 vsize=715176 CPUtime=1642.57 cores=1,3,5,7
/proc/23845/stat : 23845 (glucose) R 23844 23831 21157 0 -1 4202496 121641 0 0 0 164141 116 0 0 20 0 1 0 280611300 732340224 152854 33554432000 4194304 5208918 140734689302496 140734689300344 4211553 0 0 4096 0 0 0 0 17 3 0 0 0 0 0
/proc/23845/statm: 178794 152854 105 248 0 178543 0
Current children cumulated CPU time (s) 1660.95
Current children cumulated vsize (KiB) 975068

[startup+1722.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/183 23934
/proc/meminfo: memFree=27280328/32873648 swapFree=7116/7116
[pid=23831] ppid=23829 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/23831/stat : 23831 (npSolver-pbo.sh) S 23829 23831 21157 0 -1 4202496 358 0 0 0 0 0 0 0 20 0 1 0 280609356 9367552 275 33554432000 4194304 5064252 140736014174000 140736014172912 219513775694 0 65536 4100 65538 18446744071579302229 0 0 17 3 0 0 0 0 0
/proc/23831/statm: 2287 275 233 213 0 72 0
[pid=23832] ppid=23831 vsize=241596 CPUtime=18.38 cores=1,3,5,7
/proc/23832/stat : 23832 (npSolver-pbo) S 23831 23831 21157 0 -1 4202496 20188 66047 0 0 1211 155 424 48 20 0 1 0 280609356 247394304 55899 33554432000 4194304 5992684 140737468580064 140737468572384 5175646 0 65536 4102 0 18446744071579302229 0 0 17 1 0 0 11 0 0
/proc/23832/statm: 60399 55899 181 440 0 59955 0
[pid=23844] ppid=23832 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/23844/stat : 23844 (satsolver.sh) S 23832 23831 21157 0 -1 4202496 598 0 0 0 0 0 0 0 20 0 1 0 280611299 9367552 267 33554432000 4194304 5064252 140735618741968 140735618740880 219513775694 0 65536 4100 65538 18446744071579302229 0 0 17 7 0 0 0 0 0
/proc/23844/statm: 2287 267 226 213 0 72 0
[pid=23845] ppid=23844 vsize=718472 CPUtime=1702.56 cores=1,3,5,7
/proc/23845/stat : 23845 (glucose) R 23844 23831 21157 0 -1 4202496 122444 0 0 0 170139 117 0 0 20 0 1 0 280611300 735715328 157745 33554432000 4194304 5208918 140734689302496 140734689300248 4211553 0 0 4096 0 0 0 0 17 3 0 0 0 0 0
/proc/23845/statm: 179618 157745 105 248 0 179367 0
Current children cumulated CPU time (s) 1720.94
Current children cumulated vsize (KiB) 978364

[startup+1782.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/182 23934
/proc/meminfo: memFree=27279560/32873648 swapFree=7116/7116
[pid=23831] ppid=23829 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/23831/stat : 23831 (npSolver-pbo.sh) S 23829 23831 21157 0 -1 4202496 358 0 0 0 0 0 0 0 20 0 1 0 280609356 9367552 275 33554432000 4194304 5064252 140736014174000 140736014172912 219513775694 0 65536 4100 65538 18446744071579302229 0 0 17 3 0 0 0 0 0
/proc/23831/statm: 2287 275 233 213 0 72 0
[pid=23832] ppid=23831 vsize=241596 CPUtime=18.38 cores=1,3,5,7
/proc/23832/stat : 23832 (npSolver-pbo) S 23831 23831 21157 0 -1 4202496 20188 66047 0 0 1211 155 424 48 20 0 1 0 280609356 247394304 55899 33554432000 4194304 5992684 140737468580064 140737468572384 5175646 0 65536 4102 0 18446744071579302229 0 0 17 1 0 0 11 0 0
/proc/23832/statm: 60399 55899 181 440 0 59955 0
[pid=23844] ppid=23832 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/23844/stat : 23844 (satsolver.sh) S 23832 23831 21157 0 -1 4202496 598 0 0 0 0 0 0 0 20 0 1 0 280611299 9367552 267 33554432000 4194304 5064252 140735618741968 140735618740880 219513775694 0 65536 4100 65538 18446744071579302229 0 0 17 7 0 0 0 0 0
/proc/23844/statm: 2287 267 226 213 0 72 0
[pid=23845] ppid=23844 vsize=728324 CPUtime=1762.55 cores=1,3,5,7
/proc/23845/stat : 23845 (glucose) R 23844 23831 21157 0 -1 4202496 125055 0 0 0 176134 121 0 0 20 0 1 0 280611300 745803776 159376 33554432000 4194304 5208918 140734689302496 140734689300344 4213264 0 0 4096 0 0 0 0 17 3 0 0 0 0 0
/proc/23845/statm: 182081 159376 105 248 0 181830 0
Current children cumulated CPU time (s) 1780.93
Current children cumulated vsize (KiB) 988216



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1801.4 s]
/proc/loadavg: 2.00 2.00 2.00 3/183 23935
/proc/meminfo: memFree=27253508/32873648 swapFree=7116/7116
[pid=23831] ppid=23829 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/23831/stat : 23831 (npSolver-pbo.sh) S 23829 23831 21157 0 -1 4202496 358 0 0 0 0 0 0 0 20 0 1 0 280609356 9367552 275 33554432000 4194304 5064252 140736014174000 140736014172912 219513775694 0 65536 4100 65538 18446744071579302229 0 0 17 3 0 0 0 0 0
/proc/23831/statm: 2287 275 233 213 0 72 0
[pid=23832] ppid=23831 vsize=241596 CPUtime=18.38 cores=1,3,5,7
/proc/23832/stat : 23832 (npSolver-pbo) S 23831 23831 21157 0 -1 4202496 20188 66047 0 0 1211 155 424 48 20 0 1 0 280609356 247394304 55899 33554432000 4194304 5992684 140737468580064 140737468572384 5175646 0 65536 4102 0 18446744071579302229 0 0 17 1 0 0 11 0 0
/proc/23832/statm: 60399 55899 181 440 0 59955 0
[pid=23844] ppid=23832 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/23844/stat : 23844 (satsolver.sh) S 23832 23831 21157 0 -1 4202496 598 0 0 0 0 0 0 0 20 0 1 0 280611299 9367552 267 33554432000 4194304 5064252 140735618741968 140735618740880 219513775694 0 65536 4100 65538 18446744071579302229 0 0 17 7 0 0 0 0 0
/proc/23844/statm: 2287 267 226 213 0 72 0
[pid=23845] ppid=23844 vsize=729660 CPUtime=1781.65 cores=1,3,5,7
/proc/23845/stat : 23845 (glucose) R 23844 23831 21157 0 -1 4202496 125386 0 0 0 178044 121 0 0 20 0 1 0 280611300 747171840 162262 33554432000 4194304 5208918 140734689302496 140734689298872 4229319 0 0 4096 0 0 0 0 17 3 0 0 0 0 0
/proc/23845/statm: 182415 162262 105 248 0 182164 0
Current children cumulated CPU time (s) 1800.03
Current children cumulated vsize (KiB) 989552

Sending SIGTERM to process tree (bottom up)

Solver just ended. Dumping a history of the last processes samples

Child status: 0

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 23831 and gives
#  childrusage.ru_utime.tv_sec=16
#  childrusage.ru_utime.tv_usec=362512
#  childrusage.ru_stime.tv_sec=2
#  childrusage.ru_stime.tv_usec=51688
# CPU time returned by wait4() is 18.4142
# while last known CPU time is 1800.03
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 1801.42
CPU time (s): 1800.03
CPU user time (s): 1796.79
CPU system time (s): 3.24
CPU usage (%): 99.9231
Max. virtual memory (cumulated for all children) (KiB): 1197280

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 16.3625
system time used= 2.05169
maximum resident set size= 345808
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 87213
page faults= 0
swaps= 0
block input operations= 0
block output operations= 450496
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 715
involuntary context switches= 52

runsolver used 5.14222 second user time and 15.0257 second system time

The end

Launcher Data 

Begin job on node114 at 2012-05-27 20:53:40
IDJOB=3700659
IDBENCH=92807
IDSOLVER=2277
FILE ID=node114/3700659-1338144818
RUNJOBID= node114-1338123068-21174
PBS_JOBID= 14624495
Free space on /tmp= 71388 MiB

SOLVER NAME= npSolver 1.0
BENCH NAME= PB12/normalized-PB12/OPT-BIGINT-LIN/graca/normalized-ped2.G.recomb5-0.10-9.opb
COMMAND LINE= DIR/npSolver-pbo.sh BENCHNAME RANDOMSEED TMPDIR DIR
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3700659-1338144818/watcher-3700659-1338144818 -o /tmp/evaluation-result-3700659-1338144818/solver-3700659-1338144818 -C 1800 -W 1900 -M 15500  HOME/npSolver-pbo.sh HOME/instance-3700659-1338144818.opb 1983189677 HOME HOME

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= eb1486293241c3bbd58eaf083201528e
RANDOM SEED=1983189677

node114.alineos.net Linux 2.6.32-71.29.1.el6.x86_64 #1 SMP Mon Jun 27 19:49:27 BST 2011

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.242
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.48
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.242
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.242
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5451.90
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.242
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.242
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.242
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.242
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.242
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32873648 kB
MemFree:        29403588 kB
Buffers:          520416 kB
Cached:          2048248 kB
SwapCached:         2128 kB
Active:          1351708 kB
Inactive:        1267364 kB
Active(anon):      44092 kB
Inactive(anon):     7892 kB
Active(file):    1307616 kB
Inactive(file):  1259472 kB
Unevictable:        7116 kB
Mlocked:            7116 kB
SwapTotal:      67108856 kB
SwapFree:       67103892 kB
Dirty:             94108 kB
Writeback:             0 kB
AnonPages:         56944 kB
Mapped:            15600 kB
Shmem:               116 kB
Slab:             713596 kB
SReclaimable:     157416 kB
SUnreclaim:       556180 kB
KernelStack:        1472 kB
PageTables:         4292 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83545680 kB
Committed_AS:     170452 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      346400 kB
VmallocChunk:   34341988052 kB
HardwareCorrupted:     0 kB
AnonHugePages:     10240 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:        7680 kB
DirectMap2M:    33538048 kB

Free space on /tmp at the end= 70968 MiB
End job on node114 at 2012-05-27 21:23:41