Trace number 3731884

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
PB10: pb_cplex 2010-06-29? (TO) 1800.35 509.716

General information on the benchmark

Namenormalized-PB06/OPT-SMALLINT/submitted-PB05/
manquinho/ttp/normalized-circ6_3.opb
MD5SUMff9be653d1d3ea3b1a82846016e94df6
Bench CategoryOPT-SMALLINT (optimisation, small integers)
Best result obtained on this benchmarkSAT
Best value of the objective obtained on this benchmark64
Best CPU time to get the best result obtained on this benchmark1800.03
Has Objective FunctionYES
SatisfiableYES
(Un)Satisfiability was provedYES
Best value of the objective function 64
Optimality of the best value was proved NO
Number of variables540
Total number of constraints4476
Number of constraints which are clauses2532
Number of constraints which are cardinality constraints (but not clauses)264
Number of constraints which are nor clauses,nor cardinality constraints1680
Minimum length of a constraint2
Maximum length of a constraint20
Number of terms in the objective function 180
Biggest coefficient in the objective function 3
Number of bits for the biggest coefficient in the objective function 2
Sum of the numbers in the objective function 324
Number of bits of the sum of numbers in the objective function 9
Biggest number in a constraint 16
Number of bits of the biggest number in a constraint 5
Biggest sum of numbers in a constraint 324
Number of bits of the biggest sum of numbers9
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Solver Data

0.00/0.00	c pb_cplex 1.0 - 20100701
0.00/0.00	c Parsing opb file format. File HOME/instance-3731884-1339247154.opb.
0.00/0.00	c Instance file HOME/instance-3731884-1339247154.opb
0.00/0.00	c File size is 202558 bytes.
0.00/0.04	c Highest Coefficient sum: 40
0.00/0.04	c  IBM ILOG License Manager: "IBM ILOG Optimization Suite for Academic Initiative" is accessing CPLEX 12 with option(s): "e m b q ".
0.00/0.04	c ============================[ Problem Statistics ]=============================
0.00/0.04	c |                                                                             |
0.00/0.04	c |  Parsing time:          0.04         s                                      |
0.00/0.04	c |  Number Variables:      540                                                 |
0.00/0.04	c |  Number Constraints:    4476                                                |
0.00/0.04	c ===============================================================================
1800.35/509.71	c Remaining time 1799.96 sec.
1800.35/509.71	c 
1800.35/509.71	c *** INTERRUPTED ***
1800.35/509.71	s UNKNOWN
1800.35/509.71	c Total CPU time              : 1798.98 s
1800.35/509.71	c Memory used           : 310.02 MB
1800.35/509.71	c CPU time              : 1798.98 s
1800.35/509.71	c 
1800.35/509.71	c *** INTERRUPTED ***

Verifier Data

ERROR: no interpretation found !

Watcher Data

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.1 (svn: 989)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3731884-1339247154/watcher-3731884-1339247154 -o /tmp/evaluation-result-3731884-1339247154/solver-3731884-1339247154 -C 1800 -W 1900 -M 15500 run HOME/instance-3731884-1339247154.opb 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1900 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 12.26 7.09 2.98 3/184 20243
/proc/meminfo: memFree=31162016/32873648 swapFree=7376/7376
[pid=20243] ppid=20241 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/20243/stat : 20243 (run) S 20241 20243 20024 0 -1 4202496 356 0 0 0 0 0 0 0 20 0 1 0 390841394 9367552 270 33554432000 4194304 5064252 140733620982736 140733620981648 226084152910 0 65536 4100 65538 18446744071579302229 0 0 17 2 0 0 0 0 0
/proc/20243/statm: 2287 270 229 213 0 72 0

[startup+0.061252 s]
/proc/loadavg: 12.26 7.09 2.98 3/184 20243
/proc/meminfo: memFree=31162016/32873648 swapFree=7376/7376
[pid=20243] ppid=20241 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/20243/stat : 20243 (run) S 20241 20243 20024 0 -1 4202496 356 0 0 0 0 0 0 0 20 0 1 0 390841394 9367552 270 33554432000 4194304 5064252 140733620982736 140733620981648 226084152910 0 65536 4100 65538 18446744071579302229 0 0 17 2 0 0 0 0 0
/proc/20243/statm: 2287 270 229 213 0 72 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 9148

[startup+0.100226 s]
/proc/loadavg: 12.26 7.09 2.98 3/184 20243
/proc/meminfo: memFree=31162016/32873648 swapFree=7376/7376
[pid=20243] ppid=20241 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/20243/stat : 20243 (run) S 20241 20243 20024 0 -1 4202496 356 0 0 0 0 0 0 0 20 0 1 0 390841394 9367552 270 33554432000 4194304 5064252 140733620982736 140733620981648 226084152910 0 65536 4100 65538 18446744071579302229 0 0 17 2 0 0 0 0 0
/proc/20243/statm: 2287 270 229 213 0 72 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 9148

[startup+0.300177 s]
/proc/loadavg: 12.26 7.09 2.98 3/184 20243
/proc/meminfo: memFree=31162016/32873648 swapFree=7376/7376
[pid=20243] ppid=20241 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/20243/stat : 20243 (run) S 20241 20243 20024 0 -1 4202496 356 0 0 0 0 0 0 0 20 0 1 0 390841394 9367552 270 33554432000 4194304 5064252 140733620982736 140733620981648 226084152910 0 65536 4100 65538 18446744071579302229 0 0 17 2 0 0 0 0 0
/proc/20243/statm: 2287 270 229 213 0 72 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 9148

[startup+0.700177 s]
/proc/loadavg: 12.26 7.09 2.98 3/184 20243
/proc/meminfo: memFree=31162016/32873648 swapFree=7376/7376
[pid=20243] ppid=20241 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/20243/stat : 20243 (run) S 20241 20243 20024 0 -1 4202496 356 0 0 0 0 0 0 0 20 0 1 0 390841394 9367552 270 33554432000 4194304 5064252 140733620982736 140733620981648 226084152910 0 65536 4100 65538 18446744071579302229 0 0 17 2 0 0 0 0 0
/proc/20243/statm: 2287 270 229 213 0 72 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 9148

[startup+1.50021 s]
/proc/loadavg: 12.26 7.09 2.98 10/186 20245
/proc/meminfo: memFree=31149368/32873648 swapFree=7376/7376
[pid=20243] ppid=20241 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/20243/stat : 20243 (run) S 20241 20243 20024 0 -1 4202496 356 0 0 0 0 0 0 0 20 0 1 0 390841394 9367552 270 33554432000 4194304 5064252 140733620982736 140733620981648 226084152910 0 65536 4100 65538 18446744071579302229 0 0 17 2 0 0 0 0 0
/proc/20243/statm: 2287 270 229 213 0 72 0
[pid=20244] ppid=20243 vsize=27340 CPUtime=1.48 cores=0,2,4,6
/proc/20244/stat : 20244 (pb_cplex) R 20243 20243 20024 0 -1 4202496 6752 0 0 0 148 0 0 0 20 0 1 0 390841394 27996160 3709 33554432000 134512640 146736320 4290330144 4290324752 136403103 0 0 4096 16387 0 0 0 17 0 0 0 0 0 0
/proc/20244/statm: 6835 3709 895 2985 0 3769 0
Current children cumulated CPU time (s) 1.48
Current children cumulated vsize (KiB) 36488

[startup+3.10016 s]
/proc/loadavg: 12.26 7.09 2.98 3/186 20245
/proc/meminfo: memFree=31150600/32873648 swapFree=7376/7376
[pid=20243] ppid=20241 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/20243/stat : 20243 (run) S 20241 20243 20024 0 -1 4202496 356 0 0 0 0 0 0 0 20 0 1 0 390841394 9367552 270 33554432000 4194304 5064252 140733620982736 140733620981648 226084152910 0 65536 4100 65538 18446744071579302229 0 0 17 2 0 0 0 0 0
/proc/20243/statm: 2287 270 229 213 0 72 0
[pid=20244] ppid=20243 vsize=27360 CPUtime=3.08 cores=0,2,4,6
/proc/20244/stat : 20244 (pb_cplex) R 20243 20243 20024 0 -1 4202496 7261 0 0 0 308 0 0 0 20 0 1 0 390841394 28016640 3732 33554432000 134512640 146736320 4290330144 4290324160 136018927 0 0 4096 16387 0 0 0 17 0 0 0 0 0 0
/proc/20244/statm: 6840 3732 896 2985 0 3774 0
Current children cumulated CPU time (s) 3.08
Current children cumulated vsize (KiB) 36508

[startup+6.30021 s]
/proc/loadavg: 12.00 7.12 3.01 10/186 20245
/proc/meminfo: memFree=31146016/32873648 swapFree=7376/7376
[pid=20243] ppid=20241 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/20243/stat : 20243 (run) S 20241 20243 20024 0 -1 4202496 356 0 0 0 0 0 0 0 20 0 1 0 390841394 9367552 270 33554432000 4194304 5064252 140733620982736 140733620981648 226084152910 0 65536 4100 65538 18446744071579302229 0 0 17 2 0 0 0 0 0
/proc/20243/statm: 2287 270 229 213 0 72 0
[pid=20244] ppid=20243 vsize=30752 CPUtime=6.29 cores=0,2,4,6
/proc/20244/stat : 20244 (pb_cplex) R 20243 20243 20024 0 -1 4202496 9565 0 0 0 628 1 0 0 20 0 1 0 390841394 31490048 4585 33554432000 134512640 146736320 4290330144 4290323668 136017880 0 0 4096 16387 0 0 0 17 0 0 0 0 0 0
/proc/20244/statm: 7688 4585 911 2985 0 4622 0
Current children cumulated CPU time (s) 6.29
Current children cumulated vsize (KiB) 39900

[startup+12.7004 s]
/proc/loadavg: 11.76 7.15 3.05 16/193 20259
/proc/meminfo: memFree=31099152/32873648 swapFree=7376/7376
[pid=20243] ppid=20241 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/20243/stat : 20243 (run) S 20241 20243 20024 0 -1 4202496 356 0 0 0 0 0 0 0 20 0 1 0 390841394 9367552 270 33554432000 4194304 5064252 140733620982736 140733620981648 226084152910 0 65536 4100 65538 18446744071579302229 0 0 17 2 0 0 0 0 0
/proc/20243/statm: 2287 270 229 213 0 72 0
[pid=20244] ppid=20243 vsize=153188 CPUtime=20.57 cores=0,2,4,6
/proc/20244/stat : 20244 (pb_cplex) R 20243 20243 20024 0 -1 4202496 22502 0 0 0 2053 4 0 0 20 0 8 0 390841394 156864512 16422 33554432000 134512640 146736320 4290330144 4290323024 136008259 0 0 4096 16387 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/20244/statm: 38297 16422 957 2985 0 35231 0
[pid=20244/tid=20253] ppid=20243 vsize=153188 CPUtime=1.38 cores=0,2,4,6
/proc/20244/task/20253/stat : 20253 (pb_cplex) R 20243 20243 20024 0 -1 4202560 766 0 0 0 138 0 0 0 20 0 8 0 390842247 156864512 16422 33554432000 134512640 146736320 4290330144 4082618824 136002042 0 2 4096 16387 0 0 0 -1 0 0 0 0 0 0
[pid=20244/tid=20254] ppid=20243 vsize=153188 CPUtime=1.3 cores=0,2,4,6
/proc/20244/task/20254/stat : 20254 (pb_cplex) R 20243 20243 20024 0 -1 4202560 564 0 0 0 130 0 0 0 20 0 8 0 390842247 156864512 16422 33554432000 134512640 146736320 4290330144 4093104040 144757825 0 2 4096 16387 0 0 0 -1 0 0 0 0 0 0
[pid=20244/tid=20255] ppid=20243 vsize=153188 CPUtime=1.31 cores=0,2,4,6
/proc/20244/task/20255/stat : 20255 (pb_cplex) R 20243 20243 20024 0 -1 4202560 278 0 0 0 131 0 0 0 20 0 8 0 390842247 156864512 16422 33554432000 134512640 146736320 4290330144 4103590096 136008234 0 2 4096 16387 0 0 0 -1 6 0 0 0 0 0
[pid=20244/tid=20256] ppid=20243 vsize=153188 CPUtime=1.4 cores=0,2,4,6
/proc/20244/task/20256/stat : 20256 (pb_cplex) R 20243 20243 20024 0 -1 4202560 908 0 0 0 140 0 0 0 20 0 8 0 390842247 156864512 16422 33554432000 134512640 146736320 4290330144 4114075540 136017760 0 2 4096 16387 0 0 0 -1 2 0 0 0 0 0
[pid=20244/tid=20257] ppid=20243 vsize=153188 CPUtime=1.38 cores=0,2,4,6
/proc/20244/task/20257/stat : 20257 (pb_cplex) R 20243 20243 20024 0 -1 4202560 397 0 0 0 138 0 0 0 20 0 8 0 390842247 156864512 16422 33554432000 134512640 146736320 4290330144 4070563912 139042902 0 2 4096 16387 0 0 0 -1 2 0 0 0 0 0
[pid=20244/tid=20258] ppid=20243 vsize=153188 CPUtime=1.43 cores=0,2,4,6
/proc/20244/task/20258/stat : 20258 (pb_cplex) R 20243 20243 20024 0 -1 4202560 1011 0 0 0 143 0 0 0 20 0 8 0 390842247 156864512 16422 33554432000 134512640 146736320 4290330144 4060078128 136384852 0 2 4096 16387 0 0 0 -1 6 0 0 0 0 0
[pid=20244/tid=20259] ppid=20243 vsize=153188 CPUtime=0.88 cores=0,2,4,6
/proc/20244/task/20259/stat : 20259 (pb_cplex) S 20243 20243 20024 0 -1 4202560 207 0 0 0 88 0 0 0 20 0 8 0 390842247 156864512 16422 33554432000 134512640 146736320 4290330144 4049596048 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 20.57
Current children cumulated vsize (KiB) 162336

[startup+25.5004 s]
/proc/loadavg: 12.63 7.57 3.25 11/193 20259
/proc/meminfo: memFree=31090664/32873648 swapFree=7376/7376
[pid=20243] ppid=20241 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/20243/stat : 20243 (run) S 20241 20243 20024 0 -1 4202496 356 0 0 0 0 0 0 0 20 0 1 0 390841394 9367552 270 33554432000 4194304 5064252 140733620982736 140733620981648 226084152910 0 65536 4100 65538 18446744071579302229 0 0 17 2 0 0 0 0 0
/proc/20243/statm: 2287 270 229 213 0 72 0
[pid=20244] ppid=20243 vsize=163680 CPUtime=65.53 cores=0,2,4,6
/proc/20244/stat : 20244 (pb_cplex) S 20243 20243 20024 0 -1 4202496 26209 0 0 0 6546 7 0 0 20 0 8 0 390841394 167608320 18655 33554432000 134512640 146736320 4290330144 4290326544 144580073 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/20244/statm: 40920 18655 959 2985 0 37854 0
[pid=20244/tid=20253] ppid=20243 vsize=163680 CPUtime=6.56 cores=0,2,4,6
/proc/20244/task/20253/stat : 20253 (pb_cplex) R 20243 20243 20024 0 -1 4202560 1060 0 0 0 656 0 0 0 20 0 8 0 390842247 167608320 18655 33554432000 134512640 146736320 4290330144 4082618436 136385175 0 2 4096 16387 0 0 0 -1 0 0 0 0 0 0
[pid=20244/tid=20254] ppid=20243 vsize=163680 CPUtime=8.17 cores=0,2,4,6
/proc/20244/task/20254/stat : 20254 (pb_cplex) S 20243 20243 20024 0 -1 4202560 713 0 0 0 817 0 0 0 20 0 8 0 390842247 167608320 18655 33554432000 134512640 146736320 4290330144 4093107856 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 4 0 0 0 0 0
[pid=20244/tid=20255] ppid=20243 vsize=163680 CPUtime=6.89 cores=0,2,4,6
/proc/20244/task/20255/stat : 20255 (pb_cplex) S 20243 20243 20024 0 -1 4202560 740 0 0 0 689 0 0 0 20 0 8 0 390842247 167608320 18655 33554432000 134512640 146736320 4290330144 4103593616 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 2 0 0 0 0 0
[pid=20244/tid=20256] ppid=20243 vsize=163680 CPUtime=7.27 cores=0,2,4,6
/proc/20244/task/20256/stat : 20256 (pb_cplex) S 20243 20243 20024 0 -1 4202560 1856 0 0 0 726 1 0 0 20 0 8 0 390842247 167608320 18655 33554432000 134512640 146736320 4290330144 4114079376 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 6 0 0 0 0 0
[pid=20244/tid=20257] ppid=20243 vsize=163680 CPUtime=6.78 cores=0,2,4,6
/proc/20244/task/20257/stat : 20257 (pb_cplex) S 20243 20243 20024 0 -1 4202560 507 0 0 0 678 0 0 0 20 0 8 0 390842247 167608320 18655 33554432000 134512640 146736320 4290330144 4070567568 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 4 0 0 0 0 0
[pid=20244/tid=20258] ppid=20243 vsize=163680 CPUtime=7.1 cores=0,2,4,6
/proc/20244/task/20258/stat : 20258 (pb_cplex) S 20243 20243 20024 0 -1 4202560 1904 0 0 0 710 0 0 0 20 0 8 0 390842247 167608320 18655 33554432000 134512640 146736320 4290330144 4060081808 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 0 0 0 0 0 0
[pid=20244/tid=20259] ppid=20243 vsize=163680 CPUtime=6.16 cores=0,2,4,6
/proc/20244/task/20259/stat : 20259 (pb_cplex) S 20243 20243 20024 0 -1 4202560 974 0 0 0 616 0 0 0 20 0 8 0 390842247 167608320 18655 33554432000 134512640 146736320 4290330144 4049596048 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 65.53
Current children cumulated vsize (KiB) 172828

[startup+51.1002 s]
/proc/loadavg: 11.93 7.83 3.45 10/186 20259
/proc/meminfo: memFree=31108020/32873648 swapFree=7376/7376
[pid=20243] ppid=20241 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/20243/stat : 20243 (run) S 20241 20243 20024 0 -1 4202496 356 0 0 0 0 0 0 0 20 0 1 0 390841394 9367552 270 33554432000 4194304 5064252 140733620982736 140733620981648 226084152910 0 65536 4100 65538 18446744071579302229 0 0 17 2 0 0 0 0 0
/proc/20243/statm: 2287 270 229 213 0 72 0
[pid=20244] ppid=20243 vsize=104640 CPUtime=139.05 cores=0,2,4,6
/proc/20244/stat : 20244 (pb_cplex) R 20243 20243 20024 0 -1 4202496 37380 0 0 0 13885 20 0 0 20 0 1 0 390841394 107151360 14043 33554432000 134512640 146736320 4290330144 4290323252 135450734 0 0 4096 16387 0 0 0 17 4 0 0 0 0 0
/proc/20244/statm: 26160 14043 966 2985 0 23094 0
Current children cumulated CPU time (s) 139.05
Current children cumulated vsize (KiB) 113788

[startup+102.306 s]
/proc/loadavg: 12.14 8.43 3.88 10/193 20280
/proc/meminfo: memFree=30949920/32873648 swapFree=7376/7376
[pid=20243] ppid=20241 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/20243/stat : 20243 (run) S 20241 20243 20024 0 -1 4202496 356 0 0 0 0 0 0 0 20 0 1 0 390841394 9367552 270 33554432000 4194304 5064252 140733620982736 140733620981648 226084152910 0 65536 4100 65538 18446744071579302229 0 0 17 2 0 0 0 0 0
/proc/20243/statm: 2287 270 229 213 0 72 0
[pid=20244] ppid=20243 vsize=277232 CPUtime=284.78 cores=0,2,4,6
/proc/20244/stat : 20244 (pb_cplex) S 20243 20243 20024 0 -1 4202496 112624 0 0 0 28431 47 0 0 20 0 8 0 390841394 283885568 40679 33554432000 134512640 146736320 4290330144 4290326544 144580073 0 0 4096 16387 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/20244/statm: 69308 40679 974 2985 0 66242 0
[pid=20244/tid=20274] ppid=20243 vsize=277232 CPUtime=19 cores=0,2,4,6
/proc/20244/task/20274/stat : 20274 (pb_cplex) S 20243 20243 20024 0 -1 4202560 1995 0 0 0 1899 1 0 0 20 0 8 0 390847448 283885568 40679 33554432000 134512640 146736320 4290330144 4070567568 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 2 0 0 0 0 0
[pid=20244/tid=20275] ppid=20243 vsize=277232 CPUtime=15.99 cores=0,2,4,6
/proc/20244/task/20275/stat : 20275 (pb_cplex) S 20243 20243 20024 0 -1 4202560 7186 0 0 0 1597 2 0 0 20 0 8 0 390847448 283885568 40679 33554432000 134512640 146736320 4290330144 4140994192 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 6 0 0 0 0 0
[pid=20244/tid=20276] ppid=20243 vsize=277232 CPUtime=14.66 cores=0,2,4,6
/proc/20244/task/20276/stat : 20276 (pb_cplex) R 20243 20243 20024 0 -1 4202560 6739 0 0 0 1464 2 0 0 20 0 8 0 390847448 283885568 40679 33554432000 134512640 146736320 4290330144 4151476296 139042904 0 2 4096 16387 0 0 0 -1 0 0 0 0 0 0
[pid=20244/tid=20277] ppid=20243 vsize=277232 CPUtime=14.9 cores=0,2,4,6
/proc/20244/task/20277/stat : 20277 (pb_cplex) S 20243 20243 20024 0 -1 4202560 3636 0 0 0 1488 2 0 0 20 0 8 0 390847448 283885568 40679 33554432000 134512640 146736320 4290330144 4114079376 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 0 0 0 0 0 0
[pid=20244/tid=20278] ppid=20243 vsize=277232 CPUtime=14.97 cores=0,2,4,6
/proc/20244/task/20278/stat : 20278 (pb_cplex) S 20243 20243 20024 0 -1 4202560 4527 0 0 0 1496 1 0 0 20 0 8 0 390847448 283885568 40679 33554432000 134512640 146736320 4290330144 3975102096 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 0 0 0 0 0 0
[pid=20244/tid=20279] ppid=20243 vsize=277232 CPUtime=17.68 cores=0,2,4,6
/proc/20244/task/20279/stat : 20279 (pb_cplex) S 20243 20243 20024 0 -1 4202560 5416 0 0 0 1766 2 0 0 20 0 8 0 390847448 283885568 40679 33554432000 134512640 146736320 4290330144 3964616336 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 6 0 0 0 0 0
[pid=20244/tid=20280] ppid=20243 vsize=277232 CPUtime=16.29 cores=0,2,4,6
/proc/20244/task/20280/stat : 20280 (pb_cplex) S 20243 20243 20024 0 -1 4202560 5134 0 0 0 1627 2 0 0 20 0 8 0 390847448 283885568 40679 33554432000 134512640 146736320 4290330144 3954130576 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 284.78
Current children cumulated vsize (KiB) 286380

[startup+162.3 s]
/proc/loadavg: 12.82 9.33 4.47 16/193 20280
/proc/meminfo: memFree=30923924/32873648 swapFree=7376/7376
[pid=20243] ppid=20241 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/20243/stat : 20243 (run) S 20241 20243 20024 0 -1 4202496 356 0 0 0 0 0 0 0 20 0 1 0 390841394 9367552 270 33554432000 4194304 5064252 140733620982736 140733620981648 226084152910 0 65536 4100 65538 18446744071579302229 0 0 17 2 0 0 0 0 0
/proc/20243/statm: 2287 270 229 213 0 72 0
[pid=20244] ppid=20243 vsize=286816 CPUtime=508.71 cores=0,2,4,6
/proc/20244/stat : 20244 (pb_cplex) R 20243 20243 20024 0 -1 4202496 138763 0 0 0 50808 63 0 0 20 0 8 0 390841394 293699584 46514 33554432000 134512640 146736320 4290330144 4290323020 136388825 0 0 4096 16387 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/20244/statm: 71704 46514 975 2985 0 68638 0
[pid=20244/tid=20274] ppid=20243 vsize=286816 CPUtime=47.7 cores=0,2,4,6

################
# More data... #
################

/proc/20244/statm: 75023 49166 977 2985 0 71957 0
[pid=20244/tid=20274] ppid=20243 vsize=300092 CPUtime=103.35 cores=0,2,4,6
/proc/20244/task/20274/stat : 20274 (pb_cplex) R 20243 20243 20024 0 -1 4202560 4014 0 0 0 10328 7 0 0 20 0 8 0 390847448 307294208 49166 33554432000 134512640 146736320 4290330144 4070562932 135450818 0 2 4096 16387 0 0 0 -1 2 0 0 0 0 0
[pid=20244/tid=20275] ppid=20243 vsize=300092 CPUtime=102.3 cores=0,2,4,6
/proc/20244/task/20275/stat : 20275 (pb_cplex) R 20243 20243 20024 0 -1 4202560 11963 0 0 0 10222 8 0 0 20 0 8 0 390847448 307294208 49166 33554432000 134512640 146736320 4290330144 4140990920 135999693 0 2 4096 16387 0 0 0 -1 0 0 0 0 0 0
[pid=20244/tid=20276] ppid=20243 vsize=300092 CPUtime=99.59 cores=0,2,4,6
/proc/20244/task/20276/stat : 20276 (pb_cplex) R 20243 20243 20024 0 -1 4202560 12805 0 0 0 9951 8 0 0 20 0 8 0 390847448 307294208 49166 33554432000 134512640 146736320 4290330144 4151476392 135467712 0 2 4096 16387 0 0 0 -1 6 0 0 0 0 0
[pid=20244/tid=20277] ppid=20243 vsize=300092 CPUtime=96.85 cores=0,2,4,6
/proc/20244/task/20277/stat : 20277 (pb_cplex) R 20243 20243 20024 0 -1 4202560 21731 0 0 0 9674 11 0 0 20 0 8 0 390847448 307294208 49166 33554432000 134512640 146736320 4290330144 4114075720 139042980 0 2 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=20244/tid=20278] ppid=20243 vsize=300092 CPUtime=100.31 cores=0,2,4,6
/proc/20244/task/20278/stat : 20278 (pb_cplex) R 20243 20243 20024 0 -1 4202560 11522 0 0 0 10024 7 0 0 20 0 8 0 390847448 307294208 49166 33554432000 134512640 146736320 4290330144 3975098576 136008234 0 2 4096 16387 0 0 0 -1 2 0 0 0 0 0
[pid=20244/tid=20279] ppid=20243 vsize=300092 CPUtime=101.67 cores=0,2,4,6
/proc/20244/task/20279/stat : 20279 (pb_cplex) R 20243 20243 20024 0 -1 4202560 9443 0 0 0 10160 7 0 0 20 0 8 0 390847448 307294208 49166 33554432000 134512640 146736320 4290330144 3964612816 136008356 0 2 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=20244/tid=20280] ppid=20243 vsize=300092 CPUtime=102.39 cores=0,2,4,6
/proc/20244/task/20280/stat : 20280 (pb_cplex) R 20243 20243 20024 0 -1 4202560 9547 0 0 0 10231 8 0 0 20 0 8 0 390847448 307294208 49166 33554432000 134512640 146736320 4290330144 3954125264 135460550 0 2 4096 16387 0 0 0 -1 6 0 0 0 0 0
Current children cumulated CPU time (s) 958.63
Current children cumulated vsize (KiB) 309240

[startup+342.3 s]
/proc/loadavg: 12.58 10.92 5.95 15/193 20341
/proc/meminfo: memFree=30874972/32873648 swapFree=7376/7376
[pid=20243] ppid=20241 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/20243/stat : 20243 (run) S 20241 20243 20024 0 -1 4202496 356 0 0 0 0 0 0 0 20 0 1 0 390841394 9367552 270 33554432000 4194304 5064252 140733620982736 140733620981648 226084152910 0 65536 4100 65538 18446744071579302229 0 0 17 2 0 0 0 0 0
/proc/20243/statm: 2287 270 229 213 0 72 0
[pid=20244] ppid=20243 vsize=301084 CPUtime=1180.95 cores=0,2,4,6
/proc/20244/stat : 20244 (pb_cplex) R 20243 20243 20024 0 -1 4202496 170862 0 0 0 117990 105 0 0 20 0 8 0 390841394 308310016 49418 33554432000 134512640 146736320 4290330144 4290323272 136001936 0 0 4096 16387 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/20244/statm: 75271 49418 999 2985 0 72205 0
[pid=20244/tid=20274] ppid=20243 vsize=301084 CPUtime=130.99 cores=0,2,4,6
/proc/20244/task/20274/stat : 20274 (pb_cplex) R 20243 20243 20024 0 -1 4202560 4266 0 0 0 13091 8 0 0 20 0 8 0 390847448 308310016 49418 33554432000 134512640 146736320 4290330144 4070564296 136000532 0 2 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=20244/tid=20275] ppid=20243 vsize=301084 CPUtime=129.99 cores=0,2,4,6
/proc/20244/task/20275/stat : 20275 (pb_cplex) R 20243 20243 20024 0 -1 4202560 12096 0 0 0 12990 9 0 0 20 0 8 0 390847448 308310016 49418 33554432000 134512640 146736320 4290330144 4140990672 136008339 0 2 4096 16387 0 0 0 -1 6 0 0 0 0 0
[pid=20244/tid=20276] ppid=20243 vsize=301084 CPUtime=126.21 cores=0,2,4,6
/proc/20244/task/20276/stat : 20276 (pb_cplex) R 20243 20243 20024 0 -1 4202560 13353 0 0 0 12611 10 0 0 20 0 8 0 390847448 308310016 49418 33554432000 134512640 146736320 4290330144 4151476296 139042980 0 2 4096 16387 0 0 0 -1 2 0 0 0 0 0
[pid=20244/tid=20277] ppid=20243 vsize=301084 CPUtime=126.62 cores=0,2,4,6
/proc/20244/task/20277/stat : 20277 (pb_cplex) R 20243 20243 20024 0 -1 4202560 25127 0 0 0 12649 13 0 0 20 0 8 0 390847448 308310016 49418 33554432000 134512640 146736320 4290330144 4114076104 136000404 0 2 4096 16387 0 0 0 -1 6 0 0 0 0 0
[pid=20244/tid=20278] ppid=20243 vsize=301084 CPUtime=128.03 cores=0,2,4,6
/proc/20244/task/20278/stat : 20278 (pb_cplex) R 20243 20243 20024 0 -1 4202560 11710 0 0 0 12794 9 0 0 20 0 8 0 390847448 308310016 49418 33554432000 134512640 146736320 4290330144 3975098824 135999691 0 2 4096 16387 0 0 0 -1 0 0 0 0 0 0
[pid=20244/tid=20279] ppid=20243 vsize=301084 CPUtime=130.22 cores=0,2,4,6
/proc/20244/task/20279/stat : 20279 (pb_cplex) R 20243 20243 20024 0 -1 4202560 9632 0 0 0 13014 8 0 0 20 0 8 0 390847448 308310016 49418 33554432000 134512640 146736320 4290330144 3964612480 136400554 0 2 4096 16387 0 0 0 -1 6 0 0 0 0 0
[pid=20244/tid=20280] ppid=20243 vsize=301084 CPUtime=129.69 cores=0,2,4,6
/proc/20244/task/20280/stat : 20280 (pb_cplex) R 20243 20243 20024 0 -1 4202560 10135 0 0 0 12959 10 0 0 20 0 8 0 390847448 308310016 49418 33554432000 134512640 146736320 4290330144 3954125940 135451440 0 2 4096 16387 0 0 0 -1 0 0 0 0 0 0
Current children cumulated CPU time (s) 1180.95
Current children cumulated vsize (KiB) 310232

[startup+402.3 s]
/proc/loadavg: 13.12 11.37 6.41 17/193 20341
/proc/meminfo: memFree=30742180/32873648 swapFree=7376/7376
[pid=20243] ppid=20241 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/20243/stat : 20243 (run) S 20241 20243 20024 0 -1 4202496 356 0 0 0 0 0 0 0 20 0 1 0 390841394 9367552 270 33554432000 4194304 5064252 140733620982736 140733620981648 226084152910 0 65536 4100 65538 18446744071579302229 0 0 17 2 0 0 0 0 0
/proc/20243/statm: 2287 270 229 213 0 72 0
[pid=20244] ppid=20243 vsize=308724 CPUtime=1403.73 cores=0,2,4,6
/proc/20244/stat : 20244 (pb_cplex) R 20243 20243 20024 0 -1 4202496 178561 0 0 0 140256 117 0 0 20 0 8 0 390841394 316133376 51038 33554432000 134512640 146736320 4290330144 4290323816 144757825 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/20244/statm: 77181 51038 999 2985 0 74115 0
[pid=20244/tid=20274] ppid=20243 vsize=308724 CPUtime=159.19 cores=0,2,4,6
/proc/20244/task/20274/stat : 20274 (pb_cplex) R 20243 20243 20024 0 -1 4202560 5762 0 0 0 15907 12 0 0 20 0 8 0 390847448 316133376 51038 33554432000 134512640 146736320 4290330144 4070565760 137084996 0 2 4096 16387 0 0 0 -1 6 0 0 0 0 0
[pid=20244/tid=20275] ppid=20243 vsize=308724 CPUtime=156.82 cores=0,2,4,6
/proc/20244/task/20275/stat : 20275 (pb_cplex) R 20243 20243 20024 0 -1 4202560 13481 0 0 0 15670 12 0 0 20 0 8 0 390847448 316133376 51038 33554432000 134512640 146736320 4290330144 4140991056 136403117 0 2 4096 16387 0 0 0 -1 6 0 0 0 0 0
[pid=20244/tid=20276] ppid=20243 vsize=308724 CPUtime=154.76 cores=0,2,4,6
/proc/20244/task/20276/stat : 20276 (pb_cplex) R 20243 20243 20024 0 -1 4202560 13354 0 0 0 15464 12 0 0 20 0 8 0 390847448 316133376 51038 33554432000 134512640 146736320 4290330144 4151476116 136017665 0 2 4096 16387 0 0 0 -1 6 0 0 0 0 0
[pid=20244/tid=20277] ppid=20243 vsize=308724 CPUtime=153.56 cores=0,2,4,6
/proc/20244/task/20277/stat : 20277 (pb_cplex) R 20243 20243 20024 0 -1 4202560 26764 0 0 0 15341 15 0 0 20 0 8 0 390847448 316133376 51038 33554432000 134512640 146736320 4290330144 4114075856 136008441 0 2 4096 16387 0 0 0 -1 0 0 0 0 0 0
[pid=20244/tid=20278] ppid=20243 vsize=308724 CPUtime=156.29 cores=0,2,4,6
/proc/20244/task/20278/stat : 20278 (pb_cplex) R 20243 20243 20024 0 -1 4202560 12464 0 0 0 15617 12 0 0 20 0 8 0 390847448 316133376 51038 33554432000 134512640 146736320 4290330144 3975098520 136007065 0 2 4096 16387 0 0 0 -1 2 0 0 0 0 0
[pid=20244/tid=20279] ppid=20243 vsize=308724 CPUtime=157.8 cores=0,2,4,6
/proc/20244/task/20279/stat : 20279 (pb_cplex) R 20243 20243 20024 0 -1 4202560 9632 0 0 0 15770 10 0 0 20 0 8 0 390847448 316133376 51038 33554432000 134512640 146736320 4290330144 3964612816 136008069 0 2 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=20244/tid=20280] ppid=20243 vsize=308724 CPUtime=158.15 cores=0,2,4,6
/proc/20244/task/20280/stat : 20280 (pb_cplex) R 20243 20243 20024 0 -1 4202560 10578 0 0 0 15803 12 0 0 20 0 8 0 390847448 316133376 51038 33554432000 134512640 146736320 4290330144 3954127056 136008450 0 2 4096 16387 0 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 1403.73
Current children cumulated vsize (KiB) 317872

[startup+462.3 s]
/proc/loadavg: 13.17 11.70 6.83 12/193 20341
/proc/meminfo: memFree=30713720/32873648 swapFree=7376/7376
[pid=20243] ppid=20241 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/20243/stat : 20243 (run) S 20241 20243 20024 0 -1 4202496 356 0 0 0 0 0 0 0 20 0 1 0 390841394 9367552 270 33554432000 4194304 5064252 140733620982736 140733620981648 226084152910 0 65536 4100 65538 18446744071579302229 0 0 17 2 0 0 0 0 0
/proc/20243/statm: 2287 270 229 213 0 72 0
[pid=20244] ppid=20243 vsize=313368 CPUtime=1624.23 cores=0,2,4,6
/proc/20244/stat : 20244 (pb_cplex) R 20243 20243 20024 0 -1 4202496 183003 0 0 0 162295 128 0 0 20 0 8 0 390841394 320888832 52052 33554432000 134512640 146736320 4290330144 4290323024 136008042 0 0 4096 16387 18446744073709551615 0 0 17 6 0 0 0 0 0
/proc/20244/statm: 78342 52052 999 2985 0 75276 0
[pid=20244/tid=20274] ppid=20243 vsize=313368 CPUtime=186 cores=0,2,4,6
/proc/20244/task/20274/stat : 20274 (pb_cplex) R 20243 20243 20024 0 -1 4202560 6671 0 0 0 18587 13 0 0 20 0 8 0 390847448 320888832 52052 33554432000 134512640 146736320 4290330144 4070564432 136403109 0 2 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=20244/tid=20275] ppid=20243 vsize=313368 CPUtime=183.54 cores=0,2,4,6
/proc/20244/task/20275/stat : 20275 (pb_cplex) R 20243 20243 20024 0 -1 4202560 13488 0 0 0 18341 13 0 0 20 0 8 0 390847448 320888832 52052 33554432000 134512640 146736320 4290330144 4140990892 136400604 0 2 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=20244/tid=20276] ppid=20243 vsize=313368 CPUtime=183.94 cores=0,2,4,6
/proc/20244/task/20276/stat : 20276 (pb_cplex) R 20243 20243 20024 0 -1 4202560 14355 0 0 0 18380 14 0 0 20 0 8 0 390847448 320888832 52052 33554432000 134512640 146736320 4290330144 4151476264 139044581 0 2 4096 16387 0 0 0 -1 2 0 0 0 0 0
[pid=20244/tid=20277] ppid=20243 vsize=313368 CPUtime=182.23 cores=0,2,4,6
/proc/20244/task/20277/stat : 20277 (pb_cplex) R 20243 20243 20024 0 -1 4202560 26838 0 0 0 18207 16 0 0 20 0 8 0 390847448 320888832 52052 33554432000 134512640 146736320 4290330144 4114075720 139042902 0 2 4096 16387 0 0 0 -1 0 0 0 0 0 0
[pid=20244/tid=20278] ppid=20243 vsize=313368 CPUtime=183.48 cores=0,2,4,6
/proc/20244/task/20278/stat : 20278 (pb_cplex) R 20243 20243 20024 0 -1 4202560 12614 0 0 0 18334 14 0 0 20 0 8 0 390847448 320888832 52052 33554432000 134512640 146736320 4290330144 3975098576 136008259 0 2 4096 16387 0 0 0 -1 2 0 0 0 0 0
[pid=20244/tid=20279] ppid=20243 vsize=313368 CPUtime=185.13 cores=0,2,4,6
/proc/20244/task/20279/stat : 20279 (pb_cplex) R 20243 20243 20024 0 -1 4202560 9634 0 0 0 18502 11 0 0 20 0 8 0 390847448 320888832 52052 33554432000 134512640 146736320 4290330144 3964612480 136400550 0 2 4096 16387 0 0 0 -1 6 0 0 0 0 0
[pid=20244/tid=20280] ppid=20243 vsize=313368 CPUtime=185.18 cores=0,2,4,6
/proc/20244/task/20280/stat : 20280 (pb_cplex) R 20243 20243 20024 0 -1 4202560 12875 0 0 0 18504 14 0 0 20 0 8 0 390847448 320888832 52052 33554432000 134512640 146736320 4290330144 3954126920 139042974 0 2 4096 16387 0 0 0 -1 0 0 0 0 0 0
Current children cumulated CPU time (s) 1624.23
Current children cumulated vsize (KiB) 322516



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+509.7 s]
/proc/loadavg: 12.65 11.79 7.12 17/193 20341
/proc/meminfo: memFree=30693220/32873648 swapFree=7376/7376
[pid=20243] ppid=20241 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/20243/stat : 20243 (run) S 20241 20243 20024 0 -1 4202496 356 0 0 0 0 0 0 0 20 0 1 0 390841394 9367552 270 33554432000 4194304 5064252 140733620982736 140733620981648 226084152910 0 65536 4100 65538 18446744071579302229 0 0 17 2 0 0 0 0 0
/proc/20243/statm: 2287 270 229 213 0 72 0
[pid=20244] ppid=20243 vsize=317460 CPUtime=1800.35 cores=0,2,4,6
/proc/20244/stat : 20244 (pb_cplex) R 20243 20243 20024 0 -1 4202496 190838 0 0 0 179896 139 0 0 20 0 8 0 390841394 325079040 52948 33554432000 134512640 146736320 4290330144 4290322888 139042981 0 0 4096 16387 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/20244/statm: 79365 52948 999 2985 0 76299 0
[pid=20244/tid=20274] ppid=20243 vsize=317460 CPUtime=207.34 cores=0,2,4,6
/proc/20244/task/20274/stat : 20274 (pb_cplex) R 20243 20243 20024 0 -1 4202560 6790 0 0 0 20718 16 0 0 20 0 8 0 390847448 325079040 52948 33554432000 134512640 146736320 4290330144 4070564432 136403129 0 2 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=20244/tid=20275] ppid=20243 vsize=317460 CPUtime=205.41 cores=0,2,4,6
/proc/20244/task/20275/stat : 20275 (pb_cplex) R 20243 20243 20024 0 -1 4202560 13955 0 0 0 20526 15 0 0 20 0 8 0 390847448 325079040 52948 33554432000 134512640 146736320 4290330144 4140990920 136000488 0 2 4096 16387 0 0 0 -1 0 0 0 0 0 0
[pid=20244/tid=20276] ppid=20243 vsize=317460 CPUtime=207.67 cores=0,2,4,6
/proc/20244/task/20276/stat : 20276 (pb_cplex) R 20243 20243 20024 0 -1 4202560 15646 0 0 0 20751 16 0 0 20 0 8 0 390847448 325079040 52948 33554432000 134512640 146736320 4290330144 4151476432 136008050 0 2 4096 16387 0 0 0 -1 6 0 0 0 0 0
[pid=20244/tid=20277] ppid=20243 vsize=317460 CPUtime=204.5 cores=0,2,4,6
/proc/20244/task/20277/stat : 20277 (pb_cplex) R 20243 20243 20024 0 -1 4202560 28600 0 0 0 20431 19 0 0 20 0 8 0 390847448 325079040 52948 33554432000 134512640 146736320 4290330144 4114076240 136403103 0 2 4096 16387 0 0 0 -1 6 0 0 0 0 0
[pid=20244/tid=20278] ppid=20243 vsize=317460 CPUtime=203.98 cores=0,2,4,6
/proc/20244/task/20278/stat : 20278 (pb_cplex) R 20243 20243 20024 0 -1 4202560 12617 0 0 0 20382 16 0 0 20 0 8 0 390847448 325079040 52948 33554432000 134512640 146736320 4290330144 3975098184 135525292 0 2 4096 16387 0 0 0 -1 2 0 0 0 0 0
[pid=20244/tid=20279] ppid=20243 vsize=317460 CPUtime=206.12 cores=0,2,4,6
/proc/20244/task/20279/stat : 20279 (pb_cplex) R 20243 20243 20024 0 -1 4202560 9654 0 0 0 20598 14 0 0 20 0 8 0 390847448 325079040 52948 33554432000 134512640 146736320 4290330144 3964612824 136008606 0 2 4096 16387 0 0 0 -1 2 0 0 0 0 0
[pid=20244/tid=20280] ppid=20243 vsize=317460 CPUtime=208.96 cores=0,2,4,6
/proc/20244/task/20280/stat : 20280 (pb_cplex) R 20243 20243 20024 0 -1 4202560 13333 0 0 0 20880 16 0 0 20 0 8 0 390847448 325079040 52948 33554432000 134512640 146736320 4290330144 3954126740 136017777 0 2 4096 16387 0 0 0 -1 0 0 0 0 0 0
Current children cumulated CPU time (s) 1800.35
Current children cumulated vsize (KiB) 326608

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+509.7 s]
/proc/loadavg: 12.65 11.79 7.12 17/193 20341
/proc/meminfo: memFree=30693220/32873648 swapFree=7376/7376
[pid=20243] ppid=20241 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/20243/stat : 20243 (run) S 20241 20243 20024 0 -1 4202496 356 0 0 0 0 0 0 0 20 0 1 0 390841394 9367552 270 33554432000 4194304 5064252 140733620982736 140733620981648 226084152910 0 65536 4100 65538 18446744071579302229 0 0 17 2 0 0 0 0 0
/proc/20243/statm: 2287 270 229 213 0 72 0
[pid=20244] ppid=20243 vsize=317460 CPUtime=1800.35 cores=0,2,4,6
/proc/20244/stat : 20244 (pb_cplex) R 20243 20243 20024 0 -1 4202496 190838 0 0 0 179896 139 0 0 20 0 8 0 390841394 325079040 52948 33554432000 134512640 146736320 4290330144 4290322888 139042981 0 0 4096 16387 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/20244/statm: 79365 52948 999 2985 0 76299 0
[pid=20244/tid=20274] ppid=20243 vsize=317460 CPUtime=207.34 cores=0,2,4,6
/proc/20244/task/20274/stat : 20274 (pb_cplex) R 20243 20243 20024 0 -1 4202560 6790 0 0 0 20718 16 0 0 20 0 8 0 390847448 325079040 52948 33554432000 134512640 146736320 4290330144 4070564432 136403129 0 2 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=20244/tid=20275] ppid=20243 vsize=317460 CPUtime=205.41 cores=0,2,4,6
/proc/20244/task/20275/stat : 20275 (pb_cplex) R 20243 20243 20024 0 -1 4202560 13955 0 0 0 20526 15 0 0 20 0 8 0 390847448 325079040 52948 33554432000 134512640 146736320 4290330144 4140990920 136000488 0 2 4096 16387 0 0 0 -1 0 0 0 0 0 0
[pid=20244/tid=20276] ppid=20243 vsize=317460 CPUtime=207.67 cores=0,2,4,6
/proc/20244/task/20276/stat : 20276 (pb_cplex) R 20243 20243 20024 0 -1 4202560 15646 0 0 0 20751 16 0 0 20 0 8 0 390847448 325079040 52948 33554432000 134512640 146736320 4290330144 4151476432 136008050 0 2 4096 16387 0 0 0 -1 6 0 0 0 0 0
[pid=20244/tid=20277] ppid=20243 vsize=317460 CPUtime=204.5 cores=0,2,4,6
/proc/20244/task/20277/stat : 20277 (pb_cplex) R 20243 20243 20024 0 -1 4202560 28600 0 0 0 20431 19 0 0 20 0 8 0 390847448 325079040 52948 33554432000 134512640 146736320 4290330144 4114076240 136403103 0 2 4096 16387 0 0 0 -1 6 0 0 0 0 0
[pid=20244/tid=20278] ppid=20243 vsize=317460 CPUtime=203.98 cores=0,2,4,6
/proc/20244/task/20278/stat : 20278 (pb_cplex) R 20243 20243 20024 0 -1 4202560 12617 0 0 0 20382 16 0 0 20 0 8 0 390847448 325079040 52948 33554432000 134512640 146736320 4290330144 3975098184 135525292 0 2 4096 16387 0 0 0 -1 2 0 0 0 0 0
[pid=20244/tid=20279] ppid=20243 vsize=317460 CPUtime=206.12 cores=0,2,4,6
/proc/20244/task/20279/stat : 20279 (pb_cplex) R 20243 20243 20024 0 -1 4202560 9654 0 0 0 20598 14 0 0 20 0 8 0 390847448 325079040 52948 33554432000 134512640 146736320 4290330144 3964612824 136008606 0 2 4096 16387 0 0 0 -1 2 0 0 0 0 0
[pid=20244/tid=20280] ppid=20243 vsize=317460 CPUtime=208.96 cores=0,2,4,6
/proc/20244/task/20280/stat : 20280 (pb_cplex) R 20243 20243 20024 0 -1 4202560 13333 0 0 0 20880 16 0 0 20 0 8 0 390847448 325079040 52948 33554432000 134512640 146736320 4290330144 3954126740 136017777 0 2 4096 16387 0 0 0 -1 0 0 0 0 0 0
Current children cumulated CPU time (s) 1800.35
Current children cumulated vsize (KiB) 326608

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 20243 and gives
#  childrusage.ru_utime.tv_sec=0
#  childrusage.ru_utime.tv_usec=0
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=0
# CPU time returned by wait4() is 0
# while last known CPU time is 1800.35
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 509.716
CPU time (s): 1800.35
CPU user time (s): 1798.96
CPU system time (s): 1.39
CPU usage (%): 353.207
Max. virtual memory (cumulated for all children) (KiB): 332640

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 0
system time used= 0
maximum resident set size= 1080
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 356
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 2
involuntary context switches= 2

runsolver used 1.24081 second user time and 3.33449 second system time

The end

Launcher Data

Begin job on node120 at 2012-06-09 15:05:54
IDJOB=3731884
IDBENCH=2007
IDSOLVER=2325
FILE ID=node120/3731884-1339247154
RUNJOBID= node120-1339246833-20041
PBS_JOBID= 14644361
Free space on /tmp= 70828 MiB

SOLVER NAME= PB10: pb_cplex 2010-06-29
BENCH NAME= PB06//final/normalized-PB06/OPT-SMALLINT/submitted-PB05/manquinho/ttp/normalized-circ6_3.opb
COMMAND LINE= run BENCHNAME
CONVERSION SCRIPT= PBconversionToLinear BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3731884-1339247154/watcher-3731884-1339247154 -o /tmp/evaluation-result-3731884-1339247154/solver-3731884-1339247154 -C 1800 -W 1900 -M 15500  run HOME/instance-3731884-1339247154.opb

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= ff9be653d1d3ea3b1a82846016e94df6
RANDOM SEED=64361512

node120.alineos.net Linux 2.6.32-71.29.1.el6.x86_64 #1 SMP Mon Jun 27 19:49:27 BST 2011

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.456
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.456
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.456
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.92
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.456
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.88
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.456
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.456
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.456
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.456
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32873648 kB
MemFree:        31162932 kB
Buffers:          439060 kB
Cached:           342836 kB
SwapCached:         5856 kB
Active:           559956 kB
Inactive:         331088 kB
Active(anon):      92612 kB
Inactive(anon):    10444 kB
Active(file):     467344 kB
Inactive(file):   320644 kB
Unevictable:        7376 kB
Mlocked:            7376 kB
SwapTotal:      67108856 kB
SwapFree:       67096152 kB
Dirty:             16716 kB
Writeback:             0 kB
AnonPages:        101752 kB
Mapped:            12572 kB
Shmem:                 0 kB
Slab:             683124 kB
SReclaimable:     127480 kB
SUnreclaim:       555644 kB
KernelStack:        1544 kB
PageTables:         3960 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83545680 kB
Committed_AS:     262832 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      346400 kB
VmallocChunk:   34341988052 kB
HardwareCorrupted:     0 kB
AnonHugePages:     67584 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:        7680 kB
DirectMap2M:    33538048 kB

CONVERSION COMMAND LINE= PBconversionToLinear HOME/instance-3731884-1339247154.opb

Free space on /tmp at the end= 70812 MiB
End job on node120 at 2012-06-09 15:14:26