Trace number 3733908

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
PB10: pb_cplex 2010-06-29? (TO) 1800.21 543.824

General information on the benchmark

Namenormalized-PB06/OPT-SMALLINT/submitted-PB06/
manquiho/golomb-rulers/normalized-OGR_19.opb
MD5SUM5a1b3155d98b6c4d8f9ab1b869fece67
Bench CategoryOPT-SMALLINT (optimisation, small integers)
Best result obtained on this benchmarkSAT
Best value of the objective obtained on this benchmark355
Best CPU time to get the best result obtained on this benchmark1783.01
Has Objective FunctionYES
SatisfiableYES
(Un)Satisfiability was provedYES
Best value of the objective function 355
Optimality of the best value was proved NO
Number of variables11001
Total number of constraints21678
Number of constraints which are clauses0
Number of constraints which are cardinality constraints (but not clauses)0
Number of constraints which are nor clauses,nor cardinality constraints21678
Minimum length of a constraint18
Maximum length of a constraint37
Number of terms in the objective function 9
Biggest coefficient in the objective function 256
Number of bits for the biggest coefficient in the objective function 9
Sum of the numbers in the objective function 511
Number of bits of the sum of numbers in the objective function 9
Biggest number in a constraint 512
Number of bits of the biggest number in a constraint 10
Biggest sum of numbers in a constraint 2765
Number of bits of the biggest sum of numbers12
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Solver Data 

0.00/0.00	c pb_cplex 1.0 - 20100701
0.00/0.00	c Parsing opb file format. File HOME/instance-3733908-1339247488.opb.
0.00/0.00	c Instance file HOME/instance-3733908-1339247488.opb
0.00/0.00	c File size is 6306000 bytes.
2.99/3.06	c Highest Coefficient sum: 2765
2.99/3.06	c  IBM ILOG License Manager: "IBM ILOG Optimization Suite for Academic Initiative" is accessing CPLEX 12 with option(s): "e m b q ".
3.09/3.10	c ============================[ Problem Statistics ]=============================
3.09/3.10	c |                                                                             |
3.09/3.10	c |  Parsing time:          3.09         s                                      |
3.09/3.10	c |  Number Variables:      11001                                               |
3.09/3.13	c |  Number Constraints:    21678                                               |
3.09/3.13	c ===============================================================================
1800.21/543.81	c Remaining time 1796.89 sec.
1800.21/543.81	c 
1800.21/543.81	c *** INTERRUPTED ***
1800.21/543.81	s UNKNOWN
1800.21/543.81	c Total CPU time              : 1798.13 s
1800.21/543.81	c Memory used           : 1378.85 MB
1800.21/543.81	c CPU time              : 1798.13 s
1800.21/543.81	c 
1800.21/543.81	c *** INTERRUPTED ***

Verifier Data 

ERROR: no interpretation found !

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.1 (svn: 989)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3733908-1339247488/watcher-3733908-1339247488 -o /tmp/evaluation-result-3733908-1339247488/solver-3733908-1339247488 -C 1800 -W 1900 -M 15500 run HOME/instance-3733908-1339247488.opb 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1900 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 7.66 9.03 5.32 3/177 32342
/proc/meminfo: memFree=29735100/32873648 swapFree=7112/7112
[pid=32342] ppid=32340 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/32342/stat : 32342 (run) S 32340 32342 31871 0 -1 4202496 356 0 0 0 0 0 0 0 20 0 1 0 390874762 9367552 270 33554432000 4194304 5064252 140736273154688 140736273153600 242167211598 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/32342/statm: 2287 270 229 213 0 72 0

[startup+0.089935 s]
/proc/loadavg: 7.66 9.03 5.32 3/177 32342
/proc/meminfo: memFree=29735100/32873648 swapFree=7112/7112
[pid=32342] ppid=32340 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/32342/stat : 32342 (run) S 32340 32342 31871 0 -1 4202496 356 0 0 0 0 0 0 0 20 0 1 0 390874762 9367552 270 33554432000 4194304 5064252 140736273154688 140736273153600 242167211598 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/32342/statm: 2287 270 229 213 0 72 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 9148

[startup+0.100147 s]
/proc/loadavg: 7.66 9.03 5.32 3/177 32342
/proc/meminfo: memFree=29735100/32873648 swapFree=7112/7112
[pid=32342] ppid=32340 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/32342/stat : 32342 (run) S 32340 32342 31871 0 -1 4202496 356 0 0 0 0 0 0 0 20 0 1 0 390874762 9367552 270 33554432000 4194304 5064252 140736273154688 140736273153600 242167211598 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/32342/statm: 2287 270 229 213 0 72 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 9148

[startup+0.300163 s]
/proc/loadavg: 7.66 9.03 5.32 3/177 32342
/proc/meminfo: memFree=29735100/32873648 swapFree=7112/7112
[pid=32342] ppid=32340 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/32342/stat : 32342 (run) S 32340 32342 31871 0 -1 4202496 356 0 0 0 0 0 0 0 20 0 1 0 390874762 9367552 270 33554432000 4194304 5064252 140736273154688 140736273153600 242167211598 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/32342/statm: 2287 270 229 213 0 72 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 9148

[startup+0.700177 s]
/proc/loadavg: 7.66 9.03 5.32 3/177 32342
/proc/meminfo: memFree=29735100/32873648 swapFree=7112/7112
[pid=32342] ppid=32340 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/32342/stat : 32342 (run) S 32340 32342 31871 0 -1 4202496 356 0 0 0 0 0 0 0 20 0 1 0 390874762 9367552 270 33554432000 4194304 5064252 140736273154688 140736273153600 242167211598 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/32342/statm: 2287 270 229 213 0 72 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 9148

[startup+1.50021 s]
/proc/loadavg: 7.66 9.03 5.32 3/179 32344
/proc/meminfo: memFree=29729380/32873648 swapFree=7112/7112
[pid=32342] ppid=32340 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/32342/stat : 32342 (run) S 32340 32342 31871 0 -1 4202496 356 0 0 0 0 0 0 0 20 0 1 0 390874762 9367552 270 33554432000 4194304 5064252 140736273154688 140736273153600 242167211598 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/32342/statm: 2287 270 229 213 0 72 0
[pid=32343] ppid=32342 vsize=26796 CPUtime=1.49 cores=0,2,4,6
/proc/32343/stat : 32343 (pb_cplex) R 32342 32342 31871 0 -1 4202496 3091 0 0 0 149 0 0 0 20 0 1 0 390874762 27439104 3047 33554432000 134512640 146736320 4288783040 4288781152 140723555 0 0 4096 16387 0 0 0 17 4 0 0 0 0 0
/proc/32343/statm: 6699 3047 1026 2985 0 2093 0
Current children cumulated CPU time (s) 1.49
Current children cumulated vsize (KiB) 35944

[startup+3.10017 s]
/proc/loadavg: 7.66 9.03 5.32 3/179 32344
/proc/meminfo: memFree=29723412/32873648 swapFree=7112/7112
[pid=32342] ppid=32340 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/32342/stat : 32342 (run) S 32340 32342 31871 0 -1 4202496 356 0 0 0 0 0 0 0 20 0 1 0 390874762 9367552 270 33554432000 4194304 5064252 140736273154688 140736273153600 242167211598 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/32342/statm: 2287 270 229 213 0 72 0
[pid=32343] ppid=32342 vsize=49612 CPUtime=3.09 cores=0,2,4,6
/proc/32343/stat : 32343 (pb_cplex) R 32342 32342 31871 0 -1 4202496 10289 0 0 0 308 1 0 0 20 0 1 0 390874762 50802688 8445 33554432000 134512640 146736320 4288783040 4288781392 134993670 0 0 4096 16387 0 0 0 17 4 0 0 0 0 0
/proc/32343/statm: 12403 8446 530 2985 0 9337 0
Current children cumulated CPU time (s) 3.09
Current children cumulated vsize (KiB) 58760

[startup+6.30021 s]
/proc/loadavg: 7.21 8.91 5.30 3/179 32344
/proc/meminfo: memFree=29652836/32873648 swapFree=7112/7112
[pid=32342] ppid=32340 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/32342/stat : 32342 (run) S 32340 32342 31871 0 -1 4202496 356 0 0 0 0 0 0 0 20 0 1 0 390874762 9367552 270 33554432000 4194304 5064252 140736273154688 140736273153600 242167211598 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/32342/statm: 2287 270 229 213 0 72 0
[pid=32343] ppid=32342 vsize=129976 CPUtime=6.29 cores=0,2,4,6
/proc/32343/stat : 32343 (pb_cplex) R 32342 32342 31871 0 -1 4202496 36561 0 0 0 623 6 0 0 20 0 1 0 390874762 133095424 23609 33554432000 134512640 146736320 4288783040 4288778736 135983225 0 0 4096 16387 0 0 0 17 4 0 0 0 0 0
/proc/32343/statm: 32494 23609 806 2985 0 29428 0
Current children cumulated CPU time (s) 6.29
Current children cumulated vsize (KiB) 139124

[startup+12.7001 s]
/proc/loadavg: 6.79 8.79 5.28 3/179 32344
/proc/meminfo: memFree=29621304/32873648 swapFree=7112/7112
[pid=32342] ppid=32340 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/32342/stat : 32342 (run) S 32340 32342 31871 0 -1 4202496 356 0 0 0 0 0 0 0 20 0 1 0 390874762 9367552 270 33554432000 4194304 5064252 140736273154688 140736273153600 242167211598 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/32342/statm: 2287 270 229 213 0 72 0
[pid=32343] ppid=32342 vsize=130640 CPUtime=12.69 cores=0,2,4,6
/proc/32343/stat : 32343 (pb_cplex) R 32342 32342 31871 0 -1 4202496 67492 0 0 0 1255 14 0 0 20 0 1 0 390874762 133775360 23476 33554432000 134512640 146736320 4288783040 4288779424 136207916 0 0 4096 16387 0 0 0 17 4 0 0 0 0 0
/proc/32343/statm: 32660 23476 886 2985 0 29594 0
Current children cumulated CPU time (s) 12.69
Current children cumulated vsize (KiB) 139788

[startup+25.5003 s]
/proc/loadavg: 5.73 8.46 5.23 3/179 32344
/proc/meminfo: memFree=29633164/32873648 swapFree=7112/7112
[pid=32342] ppid=32340 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/32342/stat : 32342 (run) S 32340 32342 31871 0 -1 4202496 356 0 0 0 0 0 0 0 20 0 1 0 390874762 9367552 270 33554432000 4194304 5064252 140736273154688 140736273153600 242167211598 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/32342/statm: 2287 270 229 213 0 72 0
[pid=32343] ppid=32342 vsize=132840 CPUtime=25.48 cores=0,2,4,6
/proc/32343/stat : 32343 (pb_cplex) R 32342 32342 31871 0 -1 4202496 81958 0 0 0 2531 17 0 0 20 0 1 0 390874762 136028160 25279 33554432000 134512640 146736320 4288783040 4288779424 136207916 0 0 4096 16387 0 0 0 17 4 0 0 0 0 0
/proc/32343/statm: 33210 25279 886 2985 0 30144 0
Current children cumulated CPU time (s) 25.48
Current children cumulated vsize (KiB) 141988

[startup+51.1003 s]
/proc/loadavg: 4.46 7.94 5.14 3/179 32344
/proc/meminfo: memFree=29598400/32873648 swapFree=7112/7112
[pid=32342] ppid=32340 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/32342/stat : 32342 (run) S 32340 32342 31871 0 -1 4202496 356 0 0 0 0 0 0 0 20 0 1 0 390874762 9367552 270 33554432000 4194304 5064252 140736273154688 140736273153600 242167211598 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/32342/statm: 2287 270 229 213 0 72 0
[pid=32343] ppid=32342 vsize=174036 CPUtime=51.08 cores=0,2,4,6
/proc/32343/stat : 32343 (pb_cplex) R 32342 32342 31871 0 -1 4202496 120172 0 0 0 5080 28 0 0 20 0 1 0 390874762 178212864 32506 33554432000 134512640 146736320 4288783040 4288779144 137419268 0 0 4096 16387 0 0 0 17 4 0 0 0 0 0
/proc/32343/statm: 43509 32506 886 2985 0 40443 0
Current children cumulated CPU time (s) 51.08
Current children cumulated vsize (KiB) 183184

[startup+102.307 s]
/proc/loadavg: 3.06 7.02 4.97 3/186 32351
/proc/meminfo: memFree=29285136/32873648 swapFree=7112/7112
[pid=32342] ppid=32340 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/32342/stat : 32342 (run) S 32340 32342 31871 0 -1 4202496 356 0 0 0 0 0 0 0 20 0 1 0 390874762 9367552 270 33554432000 4194304 5064252 140736273154688 140736273153600 242167211598 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/32342/statm: 2287 270 229 213 0 72 0
[pid=32343] ppid=32342 vsize=625384 CPUtime=102.27 cores=0,2,4,6
/proc/32343/stat : 32343 (pb_cplex) R 32342 32342 31871 0 -1 4202496 252456 0 0 0 10165 62 0 0 20 0 8 0 390874762 640393216 111706 33554432000 134512640 146736320 4288783040 4288774664 139042901 0 0 4096 16387 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/32343/statm: 156346 111706 941 2985 0 153280 0
[pid=32343/tid=32345] ppid=32342 vsize=625384 CPUtime=0 cores=0,2,4,6
/proc/32343/task/32345/stat : 32345 (pb_cplex) S 32342 32342 31871 0 -1 4202560 5 0 0 0 0 0 0 0 20 0 8 0 390883891 640393216 111706 33554432000 134512640 146736320 4288783040 3737829008 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 6 0 0 0 0 0
[pid=32343/tid=32346] ppid=32342 vsize=625384 CPUtime=0 cores=0,2,4,6
/proc/32343/task/32346/stat : 32346 (pb_cplex) S 32342 32342 31871 0 -1 4202560 3 0 0 0 0 0 0 0 20 0 8 0 390883891 640393216 111706 33554432000 134512640 146736320 4288783040 3727343248 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 0 0 0 0 0 0
[pid=32343/tid=32347] ppid=32342 vsize=625384 CPUtime=0 cores=0,2,4,6
/proc/32343/task/32347/stat : 32347 (pb_cplex) S 32342 32342 31871 0 -1 4202560 3 0 0 0 0 0 0 0 20 0 8 0 390883891 640393216 111706 33554432000 134512640 146736320 4288783040 3716857488 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 2 0 0 0 0 0
[pid=32343/tid=32348] ppid=32342 vsize=625384 CPUtime=0 cores=0,2,4,6
/proc/32343/task/32348/stat : 32348 (pb_cplex) S 32342 32342 31871 0 -1 4202560 4 0 0 0 0 0 0 0 20 0 8 0 390883891 640393216 111706 33554432000 134512640 146736320 4288783040 3706371728 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 0 0 0 0 0 0
[pid=32343/tid=32349] ppid=32342 vsize=625384 CPUtime=0 cores=0,2,4,6
/proc/32343/task/32349/stat : 32349 (pb_cplex) S 32342 32342 31871 0 -1 4202560 3 0 0 0 0 0 0 0 20 0 8 0 390883891 640393216 111706 33554432000 134512640 146736320 4288783040 3695885968 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 6 0 0 0 0 0
[pid=32343/tid=32350] ppid=32342 vsize=625384 CPUtime=0 cores=0,2,4,6
/proc/32343/task/32350/stat : 32350 (pb_cplex) S 32342 32342 31871 0 -1 4202560 3 0 0 0 0 0 0 0 20 0 8 0 390883891 640393216 111706 33554432000 134512640 146736320 4288783040 3685400208 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 2 0 0 0 0 0
[pid=32343/tid=32351] ppid=32342 vsize=625384 CPUtime=0 cores=0,2,4,6
/proc/32343/task/32351/stat : 32351 (pb_cplex) S 32342 32342 31871 0 -1 4202560 3 0 0 0 0 0 0 0 20 0 8 0 390883891 640393216 111706 33554432000 134512640 146736320 4288783040 3674914448 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 0 0 0 0 0 0
Current children cumulated CPU time (s) 102.27
Current children cumulated vsize (KiB) 634532

[startup+162.3 s]
/proc/loadavg: 5.12 6.91 5.06 6/186 32351
/proc/meminfo: memFree=29078188/32873648 swapFree=7112/7112
[pid=32342] ppid=32340 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/32342/stat : 32342 (run) S 32340 32342 31871 0 -1 4202496 356 0 0 0 0 0 0 0 20 0 1 0 390874762 9367552 270 33554432000 4194304 5064252 140736273154688 140736273153600 242167211598 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/32342/statm: 2287 270 229 213 0 72 0
[pid=32343] ppid=32342 vsize=847696 CPUtime=336.47 cores=0,2,4,6
/proc/32343/stat : 32343 (pb_cplex) S 32342 32342 31871 0 -1 4202496 349086 0 0 0 33551 96 0 0 20 0 8 0 390874762 868040704 163454 33554432000 134512640 146736320 4288783040 4288779408 144580073 0 0 4096 16387 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/32343/statm: 211924 163454 965 2985 0 208858 0
[pid=32343/tid=32345] ppid=32342 vsize=847696 CPUtime=40.7 cores=0,2,4,6
/proc/32343/task/32345/stat : 32345 (pb_cplex) R 32342 32342 31871 0 -1 4202560 13938 0 0 0 4065 5 0 0 20 0 8 0 390883891 868040704 163454 33554432000 134512640 146736320 4288783040 3737825352 139042888 0 2 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=32343/tid=32346] ppid=32342 vsize=847696 CPUtime=0 cores=0,2,4,6
/proc/32343/task/32346/stat : 32346 (pb_cplex) S 32342 32342 31871 0 -1 4202560 149 0 0 0 0 0 0 0 20 0 8 0 390883891 868040704 163454 33554432000 134512640 146736320 4288783040 3727343248 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 0 0 0 0 0 0
[pid=32343/tid=32347] ppid=32342 vsize=847696 CPUtime=39.86 cores=0,2,4,6
/proc/32343/task/32347/stat : 32347 (pb_cplex) R 32342 32342 31871 0 -1 4202560 17352 0 0 0 3980 6 0 0 20 0 8 0 390883891 868040704 163454 33554432000 134512640 146736320 4288783040 3716853968 136008259 0 2 4096 16387 0 0 0 -1 0 0 0 0 0 0
[pid=32343/tid=32348] ppid=32342 vsize=847696 CPUtime=40.85 cores=0,2,4,6
/proc/32343/task/32348/stat : 32348 (pb_cplex) R 32342 32342 31871 0 -1 4202560 16498 0 0 0 4080 5 0 0 20 0 8 0 390883891 868040704 163454 33554432000 134512640 146736320 4288783040 3706368960 144757825 0 2 4096 16387 0 0 0 -1 2 0 0 0 0 0
[pid=32343/tid=32349] ppid=32342 vsize=847696 CPUtime=38.7 cores=0,2,4,6
/proc/32343/task/32349/stat : 32349 (pb_cplex) S 32342 32342 31871 0 -1 4202560 13178 0 0 0 3867 3 0 0 20 0 8 0 390883891 868040704 163454 33554432000 134512640 146736320 4288783040 3695885968 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 0 0 0 0 0 0
[pid=32343/tid=32350] ppid=32342 vsize=847696 CPUtime=17.02 cores=0,2,4,6
/proc/32343/task/32350/stat : 32350 (pb_cplex) S 32342 32342 31871 0 -1 4202560 12010 0 0 0 1698 4 0 0 20 0 8 0 390883891 868040704 163454 33554432000 134512640 146736320 4288783040 3685400208 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 2 0 0 0 0 0
[pid=32343/tid=32351] ppid=32342 vsize=847696 CPUtime=39.31 cores=0,2,4,6
/proc/32343/task/32351/stat : 32351 (pb_cplex) R 32342 32342 31871 0 -1 4202560 14661 0 0 0 3927 4 0 0 20 0 8 0 390883891 868040704 163454 33554432000 134512640 146736320 4288783040 3674910760 139044557 0 2 4096 16387 0 0 0 -1 6 0 0 0 0 0
Current children cumulated CPU time (s) 336.47
Current children cumulated vsize (KiB) 856844

[startup+222.3 s]
/proc/loadavg: 6.41 6.86 5.15 10/186 32351
/proc/meminfo: memFree=28673372/32873648 swapFree=7112/7112
[pid=32342] ppid=32340 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/32342/stat : 32342 (run) S 32340 32342 31871 0 -1 4202496 356 0 0 0 0 0 0 0 20 0 1 0 390874762 9367552 270 33554432000 4194304 5064252 140736273154688 140736273153600 242167211598 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/32342/statm: 2287 270 229 213 0 72 0
[pid=32343] ppid=32342 vsize=1348516 CPUtime=530.27 cores=0,2,4,6
/proc/32343/stat : 32343 (pb_cplex) R 32342 32342 31871 0 -1 4202496 477666 0 0 0 52874 153 0 0 20 0 8 0 390874762 1380880384 264381 33554432000 134512640 146736320 4288783040 4288775888 136008242 0 0 4096 16387 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/32343/statm: 337129 264381 965 2985 0 334063 0
[pid=32343/tid=32345] ppid=32342 vsize=1348516 CPUtime=82.64 cores=0,2,4,6
/proc/32343/task/32345/stat : 32345 (pb_cplex) R 32342 32342 31871 0 -1 4202560 29539 0 0 0 8252 12 0 0 20 0 8 0 390883891 1380880384 264381 33554432000 134512640 146736320 4288783040 3737825488 136008050 0 2 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=32343/tid=32346] ppid=32342 vsize=1348516 CPUtime=17.53 cores=0,2,4,6

################
# More data... #
################

/proc/32343/statm: 342996 274000 965 2985 0 339930 0
[pid=32343/tid=32345] ppid=32342 vsize=1371984 CPUtime=112.59 cores=0,2,4,6
/proc/32343/task/32345/stat : 32345 (pb_cplex) R 32342 32342 31871 0 -1 4202560 32253 0 0 0 11246 13 0 0 20 0 8 0 390883891 1404911616 274000 33554432000 134512640 146736320 4288783040 3737825280 136018922 0 2 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=32343/tid=32346] ppid=32342 vsize=1371984 CPUtime=47.38 cores=0,2,4,6
/proc/32343/task/32346/stat : 32346 (pb_cplex) R 32342 32342 31871 0 -1 4202560 15301 0 0 0 4729 9 0 0 20 0 8 0 390883891 1404911616 274000 33554432000 134512640 146736320 4288783040 3727339592 139042977 0 2 4096 16387 0 0 0 -1 0 0 0 0 0 0
[pid=32343/tid=32347] ppid=32342 vsize=1371984 CPUtime=99.43 cores=0,2,4,6
/proc/32343/task/32347/stat : 32347 (pb_cplex) R 32342 32342 31871 0 -1 4202560 40419 0 0 0 9926 17 0 0 20 0 8 0 390883891 1404911616 274000 33554432000 134512640 146736320 4288783040 3716853968 136008053 0 2 4096 16387 0 0 0 -1 2 0 0 0 0 0
[pid=32343/tid=32348] ppid=32342 vsize=1371984 CPUtime=89.03 cores=0,2,4,6
/proc/32343/task/32348/stat : 32348 (pb_cplex) R 32342 32342 31871 0 -1 4202560 35500 0 0 0 8890 13 0 0 20 0 8 0 390883891 1404911616 274000 33554432000 134512640 146736320 4288783040 3706368072 139042901 0 2 4096 16387 0 0 0 -1 6 0 0 0 0 0
[pid=32343/tid=32349] ppid=32342 vsize=1371984 CPUtime=86.34 cores=0,2,4,6
/proc/32343/task/32349/stat : 32349 (pb_cplex) R 32342 32342 31871 0 -1 4202560 34319 0 0 0 8619 15 0 0 20 0 8 0 390883891 1404911616 274000 33554432000 134512640 146736320 4288783040 3695882240 136018896 0 2 4096 16387 0 0 0 -1 0 0 0 0 0 0
[pid=32343/tid=32350] ppid=32342 vsize=1371984 CPUtime=64.62 cores=0,2,4,6
/proc/32343/task/32350/stat : 32350 (pb_cplex) R 32342 32342 31871 0 -1 4202560 29267 0 0 0 6450 12 0 0 20 0 8 0 390883891 1404911616 274000 33554432000 134512640 146736320 4288783040 3685396688 136008050 0 2 4096 16387 0 0 0 -1 2 0 0 0 0 0
[pid=32343/tid=32351] ppid=32342 vsize=1371984 CPUtime=102.6 cores=0,2,4,6
/proc/32343/task/32351/stat : 32351 (pb_cplex) R 32342 32342 31871 0 -1 4202560 39149 0 0 0 10244 16 0 0 20 0 8 0 390883891 1404911616 274000 33554432000 134512640 146736320 4288783040 3674910928 136008065 0 2 4096 16387 0 0 0 -1 6 0 0 0 0 0
Current children cumulated CPU time (s) 769.85
Current children cumulated vsize (KiB) 1381132

[startup+342.3 s]
/proc/loadavg: 8.65 7.56 5.61 10/193 32359
/proc/meminfo: memFree=28495092/32873648 swapFree=7112/7112
[pid=32342] ppid=32340 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/32342/stat : 32342 (run) S 32340 32342 31871 0 -1 4202496 356 0 0 0 0 0 0 0 20 0 1 0 390874762 9367552 270 33554432000 4194304 5064252 140736273154688 140736273153600 242167211598 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/32342/statm: 2287 270 229 213 0 72 0
[pid=32343] ppid=32342 vsize=1379944 CPUtime=1009.42 cores=0,2,4,6
/proc/32343/stat : 32343 (pb_cplex) R 32342 32342 31871 0 -1 4202496 533908 0 0 0 100763 179 0 0 20 0 8 0 390874762 1413062656 281656 33554432000 134512640 146736320 4288783040 4288775888 136008039 0 0 4096 16387 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/32343/statm: 344986 281656 965 2985 0 341920 0
[pid=32343/tid=32345] ppid=32342 vsize=1379944 CPUtime=142.28 cores=0,2,4,6
/proc/32343/task/32345/stat : 32345 (pb_cplex) R 32342 32342 31871 0 -1 4202560 35585 0 0 0 14213 15 0 0 20 0 8 0 390883891 1413062656 281656 33554432000 134512640 146736320 4288783040 3737825488 136008065 0 2 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=32343/tid=32346] ppid=32342 vsize=1379944 CPUtime=77.72 cores=0,2,4,6
/proc/32343/task/32346/stat : 32346 (pb_cplex) R 32342 32342 31871 0 -1 4202560 17667 0 0 0 7761 11 0 0 20 0 8 0 390883891 1413062656 281656 33554432000 134512640 146736320 4288783040 3727339728 136008050 0 2 4096 16387 0 0 0 -1 0 0 0 0 0 0
[pid=32343/tid=32347] ppid=32342 vsize=1379944 CPUtime=129.32 cores=0,2,4,6
/proc/32343/task/32347/stat : 32347 (pb_cplex) R 32342 32342 31871 0 -1 4202560 43233 0 0 0 12914 18 0 0 20 0 8 0 390883891 1413062656 281656 33554432000 134512640 146736320 4288783040 3716853760 136018931 0 2 4096 16387 0 0 0 -1 0 0 0 0 0 0
[pid=32343/tid=32348] ppid=32342 vsize=1379944 CPUtime=119.11 cores=0,2,4,6
/proc/32343/task/32348/stat : 32348 (pb_cplex) R 32342 32342 31871 0 -1 4202560 38438 0 0 0 11897 14 0 0 20 0 8 0 390883891 1413062656 281656 33554432000 134512640 146736320 4288783040 3706368392 136388073 0 2 4096 16387 0 0 0 -1 0 0 0 0 0 0
[pid=32343/tid=32349] ppid=32342 vsize=1379944 CPUtime=116.23 cores=0,2,4,6
/proc/32343/task/32349/stat : 32349 (pb_cplex) R 32342 32342 31871 0 -1 4202560 39027 0 0 0 11607 16 0 0 20 0 8 0 390883891 1413062656 281656 33554432000 134512640 146736320 4288783040 3695882448 136008050 0 2 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=32343/tid=32350] ppid=32342 vsize=1379944 CPUtime=94.52 cores=0,2,4,6
/proc/32343/task/32350/stat : 32350 (pb_cplex) R 32342 32342 31871 0 -1 4202560 35104 0 0 0 9436 16 0 0 20 0 8 0 390883891 1413062656 281656 33554432000 134512640 146736320 4288783040 3685396688 136008450 0 2 4096 16387 0 0 0 -1 2 0 0 0 0 0
[pid=32343/tid=32351] ppid=32342 vsize=1379944 CPUtime=132.76 cores=0,2,4,6
/proc/32343/task/32351/stat : 32351 (pb_cplex) R 32342 32342 31871 0 -1 4202560 42049 0 0 0 13258 18 0 0 20 0 8 0 390883891 1413062656 281656 33554432000 134512640 146736320 4288783040 3674910928 136008039 0 2 4096 16387 0 0 0 -1 6 0 0 0 0 0
Current children cumulated CPU time (s) 1009.42
Current children cumulated vsize (KiB) 1389092

[startup+402.3 s]
/proc/loadavg: 8.87 7.82 5.82 10/193 32359
/proc/meminfo: memFree=28461516/32873648 swapFree=7112/7112
[pid=32342] ppid=32340 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/32342/stat : 32342 (run) S 32340 32342 31871 0 -1 4202496 356 0 0 0 0 0 0 0 20 0 1 0 390874762 9367552 270 33554432000 4194304 5064252 140736273154688 140736273153600 242167211598 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/32342/statm: 2287 270 229 213 0 72 0
[pid=32343] ppid=32342 vsize=1384132 CPUtime=1248.99 cores=0,2,4,6
/proc/32343/stat : 32343 (pb_cplex) R 32342 32342 31871 0 -1 4202496 561286 0 0 0 124709 190 0 0 20 0 8 0 390874762 1417351168 289851 33554432000 134512640 146736320 4288783040 4288775720 139044581 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/32343/statm: 346033 289851 965 2985 0 342967 0
[pid=32343/tid=32345] ppid=32342 vsize=1384132 CPUtime=172.42 cores=0,2,4,6
/proc/32343/task/32345/stat : 32345 (pb_cplex) R 32342 32342 31871 0 -1 4202560 42007 0 0 0 17225 17 0 0 20 0 8 0 390883891 1417351168 289851 33554432000 134512640 146736320 4288783040 3737825488 136008065 0 2 4096 16387 0 0 0 -1 0 0 0 0 0 0
[pid=32343/tid=32346] ppid=32342 vsize=1384132 CPUtime=108.26 cores=0,2,4,6
/proc/32343/task/32346/stat : 32346 (pb_cplex) R 32342 32342 31871 0 -1 4202560 20216 0 0 0 10814 12 0 0 20 0 8 0 390883891 1417351168 289851 33554432000 134512640 146736320 4288783040 3727339336 135526137 0 2 4096 16387 0 0 0 -1 2 0 0 0 0 0
[pid=32343/tid=32347] ppid=32342 vsize=1384132 CPUtime=159.44 cores=0,2,4,6
/proc/32343/task/32347/stat : 32347 (pb_cplex) R 32342 32342 31871 0 -1 4202560 46011 0 0 0 15924 20 0 0 20 0 8 0 390883891 1417351168 289851 33554432000 134512640 146736320 4288783040 3716853760 136018935 0 2 4096 16387 0 0 0 -1 0 0 0 0 0 0
[pid=32343/tid=32348] ppid=32342 vsize=1384132 CPUtime=148.37 cores=0,2,4,6
/proc/32343/task/32348/stat : 32348 (pb_cplex) R 32342 32342 31871 0 -1 4202560 41901 0 0 0 14821 16 0 0 20 0 8 0 390883891 1417351168 289851 33554432000 134512640 146736320 4288783040 3706368208 136008065 0 2 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=32343/tid=32349] ppid=32342 vsize=1384132 CPUtime=145.85 cores=0,2,4,6
/proc/32343/task/32349/stat : 32349 (pb_cplex) R 32342 32342 31871 0 -1 4202560 42107 0 0 0 14566 19 0 0 20 0 8 0 390883891 1417351168 289851 33554432000 134512640 146736320 4288783040 3695882448 136008446 0 2 4096 16387 0 0 0 -1 2 0 0 0 0 0
[pid=32343/tid=32350] ppid=32342 vsize=1384132 CPUtime=123.57 cores=0,2,4,6
/proc/32343/task/32350/stat : 32350 (pb_cplex) R 32342 32342 31871 0 -1 4202560 38078 0 0 0 12339 18 0 0 20 0 8 0 390883891 1417351168 289851 33554432000 134512640 146736320 4288783040 3685396688 136008170 0 2 4096 16387 0 0 0 -1 6 0 0 0 0 0
[pid=32343/tid=32351] ppid=32342 vsize=1384132 CPUtime=162.99 cores=0,2,4,6
/proc/32343/task/32351/stat : 32351 (pb_cplex) R 32342 32342 31871 0 -1 4202560 44916 0 0 0 16280 19 0 0 20 0 8 0 390883891 1417351168 289851 33554432000 134512640 146736320 4288783040 3674910928 136008065 0 2 4096 16387 0 0 0 -1 6 0 0 0 0 0
Current children cumulated CPU time (s) 1248.99
Current children cumulated vsize (KiB) 1393280

[startup+462.3 s]
/proc/loadavg: 8.67 7.97 6.00 9/193 32359
/proc/meminfo: memFree=28454068/32873648 swapFree=7112/7112
[pid=32342] ppid=32340 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/32342/stat : 32342 (run) S 32340 32342 31871 0 -1 4202496 356 0 0 0 0 0 0 0 20 0 1 0 390874762 9367552 270 33554432000 4194304 5064252 140736273154688 140736273153600 242167211598 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/32342/statm: 2287 270 229 213 0 72 0
[pid=32343] ppid=32342 vsize=1390192 CPUtime=1488.57 cores=0,2,4,6
/proc/32343/stat : 32343 (pb_cplex) R 32342 32342 31871 0 -1 4202496 591682 0 0 0 148658 199 0 0 20 0 8 0 390874762 1423556608 291628 33554432000 134512640 146736320 4288783040 4288774844 135526870 0 0 4096 16387 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/32343/statm: 347548 291628 965 2985 0 344482 0
[pid=32343/tid=32345] ppid=32342 vsize=1390192 CPUtime=203.85 cores=0,2,4,6
/proc/32343/task/32345/stat : 32345 (pb_cplex) R 32342 32342 31871 0 -1 4202560 45499 0 0 0 20366 19 0 0 20 0 8 0 390883891 1423556608 291628 33554432000 134512640 146736320 4288783040 3737825872 136403129 0 2 4096 16387 0 0 0 -1 2 0 0 0 0 0
[pid=32343/tid=32346] ppid=32342 vsize=1390192 CPUtime=139.19 cores=0,2,4,6
/proc/32343/task/32346/stat : 32346 (pb_cplex) R 32342 32342 31871 0 -1 4202560 22944 0 0 0 13905 14 0 0 20 0 8 0 390883891 1423556608 291628 33554432000 134512640 146736320 4288783040 3727339728 136008065 0 2 4096 16387 0 0 0 -1 6 0 0 0 0 0
[pid=32343/tid=32347] ppid=32342 vsize=1390192 CPUtime=190.6 cores=0,2,4,6
/proc/32343/task/32347/stat : 32347 (pb_cplex) R 32342 32342 31871 0 -1 4202560 49439 0 0 0 19038 22 0 0 20 0 8 0 390883891 1423556608 291628 33554432000 134512640 146736320 4288783040 3716853968 136008053 0 2 4096 16387 0 0 0 -1 0 0 0 0 0 0
[pid=32343/tid=32348] ppid=32342 vsize=1390192 CPUtime=179.79 cores=0,2,4,6
/proc/32343/task/32348/stat : 32348 (pb_cplex) R 32342 32342 31871 0 -1 4202560 45813 0 0 0 17961 18 0 0 20 0 8 0 390883891 1423556608 291628 33554432000 134512640 146736320 4288783040 3706368208 136008065 0 2 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=32343/tid=32349] ppid=32342 vsize=1390192 CPUtime=166.77 cores=0,2,4,6
/proc/32343/task/32349/stat : 32349 (pb_cplex) S 32342 32342 31871 0 -1 4202560 47262 0 0 0 16656 21 0 0 20 0 8 0 390883891 1423556608 291628 33554432000 134512640 146736320 4288783040 3695885968 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 6 0 0 0 0 0
[pid=32343/tid=32350] ppid=32342 vsize=1390192 CPUtime=154.4 cores=0,2,4,6
/proc/32343/task/32350/stat : 32350 (pb_cplex) R 32342 32342 31871 0 -1 4202560 40870 0 0 0 15421 19 0 0 20 0 8 0 390883891 1423556608 291628 33554432000 134512640 146736320 4288783040 3685397072 136403117 0 2 4096 16387 0 0 0 -1 0 0 0 0 0 0
[pid=32343/tid=32351] ppid=32342 vsize=1390192 CPUtime=193.95 cores=0,2,4,6
/proc/32343/task/32351/stat : 32351 (pb_cplex) R 32342 32342 31871 0 -1 4202560 47964 0 0 0 19375 20 0 0 20 0 8 0 390883891 1423556608 291628 33554432000 134512640 146736320 4288783040 3674910760 139044552 0 2 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 1488.57
Current children cumulated vsize (KiB) 1399340

[startup+522.3 s]
/proc/loadavg: 11.69 8.89 6.43 14/194 32362
/proc/meminfo: memFree=28290908/32873648 swapFree=7112/7112
[pid=32342] ppid=32340 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/32342/stat : 32342 (run) S 32340 32342 31871 0 -1 4202496 356 0 0 0 0 0 0 0 20 0 1 0 390874762 9367552 270 33554432000 4194304 5064252 140736273154688 140736273153600 242167211598 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/32342/statm: 2287 270 229 213 0 72 0
[pid=32343] ppid=32342 vsize=1407528 CPUtime=1728.12 cores=0,2,4,6
/proc/32343/stat : 32343 (pb_cplex) S 32342 32342 31871 0 -1 4202496 617834 0 0 0 172605 207 0 0 20 0 8 0 390874762 1441308672 293815 33554432000 134512640 146736320 4288783040 4288779408 144580073 0 0 4096 16387 18446744073709551615 0 0 17 6 0 0 0 0 0
/proc/32343/statm: 351882 293815 965 2985 0 348816 0
[pid=32343/tid=32345] ppid=32342 vsize=1407528 CPUtime=238.57 cores=0,2,4,6
/proc/32343/task/32345/stat : 32345 (pb_cplex) R 32342 32342 31871 0 -1 4202560 49842 0 0 0 23836 21 0 0 20 0 8 0 390883891 1441308672 293815 33554432000 134512640 146736320 4288783040 3737826352 135983217 0 2 4096 16387 0 0 0 -1 6 0 0 0 0 0
[pid=32343/tid=32346] ppid=32342 vsize=1407528 CPUtime=174.28 cores=0,2,4,6
/proc/32343/task/32346/stat : 32346 (pb_cplex) R 32342 32342 31871 0 -1 4202560 25691 0 0 0 17413 15 0 0 20 0 8 0 390883891 1441308672 293815 33554432000 134512640 146736320 4288783040 3727339728 136008050 0 2 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=32343/tid=32347] ppid=32342 vsize=1407528 CPUtime=226.07 cores=0,2,4,6
/proc/32343/task/32347/stat : 32347 (pb_cplex) R 32342 32342 31871 0 -1 4202560 53232 0 0 0 22583 24 0 0 20 0 8 0 390883891 1441308672 293815 33554432000 134512640 146736320 4288783040 3716854352 136403112 0 2 4096 16387 0 0 0 -1 2 0 0 0 0 0
[pid=32343/tid=32348] ppid=32342 vsize=1407528 CPUtime=211.17 cores=0,2,4,6
/proc/32343/task/32348/stat : 32348 (pb_cplex) S 32342 32342 31871 0 -1 4202560 50143 0 0 0 21097 20 0 0 20 0 8 0 390883891 1441308672 293815 33554432000 134512640 146736320 4288783040 3706371728 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 2 0 0 0 0 0
[pid=32343/tid=32349] ppid=32342 vsize=1407528 CPUtime=166.77 cores=0,2,4,6
/proc/32343/task/32349/stat : 32349 (pb_cplex) S 32342 32342 31871 0 -1 4202560 47262 0 0 0 16656 21 0 0 20 0 8 0 390883891 1441308672 293815 33554432000 134512640 146736320 4288783040 3695885968 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 6 0 0 0 0 0
[pid=32343/tid=32350] ppid=32342 vsize=1407528 CPUtime=190.35 cores=0,2,4,6
/proc/32343/task/32350/stat : 32350 (pb_cplex) R 32342 32342 31871 0 -1 4202560 44185 0 0 0 19014 21 0 0 20 0 8 0 390883891 1441308672 293815 33554432000 134512640 146736320 4288783040 3685396688 136008042 0 2 4096 16387 0 0 0 -1 0 0 0 0 0 0
[pid=32343/tid=32351] ppid=32342 vsize=1407528 CPUtime=229.43 cores=0,2,4,6
/proc/32343/task/32351/stat : 32351 (pb_cplex) R 32342 32342 31871 0 -1 4202560 51214 0 0 0 22921 22 0 0 20 0 8 0 390883891 1441308672 293815 33554432000 134512640 146736320 4288783040 3674910928 136008050 0 2 4096 16387 0 0 0 -1 0 0 0 0 0 0
Current children cumulated CPU time (s) 1728.12
Current children cumulated vsize (KiB) 1416676



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+543.8 s]
/proc/loadavg: 11.69 9.07 6.54 12/194 32362
/proc/meminfo: memFree=28285368/32873648 swapFree=7112/7112
[pid=32342] ppid=32340 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/32342/stat : 32342 (run) S 32340 32342 31871 0 -1 4202496 356 0 0 0 0 0 0 0 20 0 1 0 390874762 9367552 270 33554432000 4194304 5064252 140736273154688 140736273153600 242167211598 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/32342/statm: 2287 270 229 213 0 72 0
[pid=32343] ppid=32342 vsize=1411940 CPUtime=1800.21 cores=0,2,4,6
/proc/32343/stat : 32343 (pb_cplex) S 32342 32342 31871 0 -1 4202496 627278 0 0 0 179811 210 0 0 20 0 8 0 390874762 1445826560 294492 33554432000 134512640 146736320 4288783040 4288779408 144580073 0 0 4096 16387 18446744073709551615 0 0 17 6 0 0 0 0 0
/proc/32343/statm: 352985 294492 965 2985 0 349919 0
[pid=32343/tid=32345] ppid=32342 vsize=1411940 CPUtime=241.47 cores=0,2,4,6
/proc/32343/task/32345/stat : 32345 (pb_cplex) S 32342 32342 31871 0 -1 4202560 50030 0 0 0 24126 21 0 0 20 0 8 0 390883891 1445826560 294492 33554432000 134512640 146736320 4288783040 3737829008 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 6 0 0 0 0 0
[pid=32343/tid=32346] ppid=32342 vsize=1411940 CPUtime=194.83 cores=0,2,4,6
/proc/32343/task/32346/stat : 32346 (pb_cplex) R 32342 32342 31871 0 -1 4202560 27334 0 0 0 19467 16 0 0 20 0 8 0 390883891 1445826560 294492 33554432000 134512640 146736320 4288783040 3727339520 136018936 0 2 4096 16387 0 0 0 -1 0 0 0 0 0 0
[pid=32343/tid=32347] ppid=32342 vsize=1411940 CPUtime=232.92 cores=0,2,4,6
/proc/32343/task/32347/stat : 32347 (pb_cplex) S 32342 32342 31871 0 -1 4202560 54939 0 0 0 23268 24 0 0 20 0 8 0 390883891 1445826560 294492 33554432000 134512640 146736320 4288783040 3716857488 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 6 0 0 0 0 0
[pid=32343/tid=32348] ppid=32342 vsize=1411940 CPUtime=211.17 cores=0,2,4,6
/proc/32343/task/32348/stat : 32348 (pb_cplex) S 32342 32342 31871 0 -1 4202560 50143 0 0 0 21097 20 0 0 20 0 8 0 390883891 1445826560 294492 33554432000 134512640 146736320 4288783040 3706371728 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 2 0 0 0 0 0
[pid=32343/tid=32349] ppid=32342 vsize=1411940 CPUtime=166.77 cores=0,2,4,6
/proc/32343/task/32349/stat : 32349 (pb_cplex) S 32342 32342 31871 0 -1 4202560 47262 0 0 0 16656 21 0 0 20 0 8 0 390883891 1445826560 294492 33554432000 134512640 146736320 4288783040 3695885968 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 6 0 0 0 0 0
[pid=32343/tid=32350] ppid=32342 vsize=1411940 CPUtime=211.01 cores=0,2,4,6
/proc/32343/task/32350/stat : 32350 (pb_cplex) R 32342 32342 31871 0 -1 4202560 46050 0 0 0 21079 22 0 0 20 0 8 0 390883891 1445826560 294492 33554432000 134512640 146736320 4288783040 3685396520 139044505 0 2 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=32343/tid=32351] ppid=32342 vsize=1411940 CPUtime=250.55 cores=0,2,4,6
/proc/32343/task/32351/stat : 32351 (pb_cplex) R 32342 32342 31871 0 -1 4202560 55255 0 0 0 25033 22 0 0 20 0 8 0 390883891 1445826560 294492 33554432000 134512640 146736320 4288783040 3674909840 136008450 0 2 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 1800.21
Current children cumulated vsize (KiB) 1421088

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 32342 and gives
#  childrusage.ru_utime.tv_sec=0
#  childrusage.ru_utime.tv_usec=0
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=999
# CPU time returned by wait4() is 0.000999
# while last known CPU time is 1800.21
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 543.824
CPU time (s): 1800.21
CPU user time (s): 1798.11
CPU system time (s): 2.1
CPU usage (%): 331.028
Max. virtual memory (cumulated for all children) (KiB): 1428332

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 0
system time used= 0.000999
maximum resident set size= 1080
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 356
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 2
involuntary context switches= 1

runsolver used 1.36079 second user time and 3.87541 second system time

The end

Launcher Data 

Begin job on node126 at 2012-06-09 15:11:28
IDJOB=3733908
IDBENCH=2633
IDSOLVER=2325
FILE ID=node126/3733908-1339247488
RUNJOBID= node126-1339246833-31888
PBS_JOBID= 14644355
Free space on /tmp= 70924 MiB

SOLVER NAME= PB10: pb_cplex 2010-06-29
BENCH NAME= PB06/final/normalized-PB06/OPT-SMALLINT/submitted-PB06/manquiho/golomb-rulers/normalized-OGR_19.opb
COMMAND LINE= run BENCHNAME
CONVERSION SCRIPT= PBconversionToLinear BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3733908-1339247488/watcher-3733908-1339247488 -o /tmp/evaluation-result-3733908-1339247488/solver-3733908-1339247488 -C 1800 -W 1900 -M 15500  run HOME/instance-3733908-1339247488.opb

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 5a1b3155d98b6c4d8f9ab1b869fece67
RANDOM SEED=2018897968

node126.alineos.net Linux 2.6.32-71.29.1.el6.x86_64 #1 SMP Mon Jun 27 19:49:27 BST 2011

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.456
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.456
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.456
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.92
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.456
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.456
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.92
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.456
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.456
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.90
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.456
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.92
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32873648 kB
MemFree:        29735892 kB
Buffers:          596156 kB
Cached:          1475952 kB
SwapCached:         8292 kB
Active:          2054408 kB
Inactive:         121144 kB
Active(anon):      90632 kB
Inactive(anon):    11060 kB
Active(file):    1963776 kB
Inactive(file):   110084 kB
Unevictable:        7112 kB
Mlocked:            7112 kB
SwapTotal:      67108856 kB
SwapFree:       67095016 kB
Dirty:             22532 kB
Writeback:             0 kB
AnonPages:         98708 kB
Mapped:            12964 kB
Shmem:                 0 kB
Slab:             823928 kB
SReclaimable:     268020 kB
SUnreclaim:       555908 kB
KernelStack:        1472 kB
PageTables:         3984 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83545680 kB
Committed_AS:     261548 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      346400 kB
VmallocChunk:   34341988052 kB
HardwareCorrupted:     0 kB
AnonHugePages:     10240 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:        7680 kB
DirectMap2M:    33538048 kB

CONVERSION COMMAND LINE= PBconversionToLinear HOME/instance-3733908-1339247488.opb

Free space on /tmp at the end= 70908 MiB
End job on node126 at 2012-06-09 15:20:34