Trace number 3730921

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
PB10: pb_cplex 2010-06-29? (TO) 1800.1 725.222

General information on the benchmark

Namenormalized-PB06/SATUNSAT-SMALLINT/web/
uclid_pb_benchmarks/normalized-ooo.rf10.ucl.opb
MD5SUM631c705feb60dcd8a1b144825a73a754
Bench CategoryDEC-SMALLINT (no optimisation, small integers)
Best result obtained on this benchmarkUNSAT
Best value of the objective obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark2.68759
Has Objective FunctionNO
SatisfiableNO
(Un)Satisfiability was provedYES
Best value of the objective function
Optimality of the best value was proved
Number of variables18069
Total number of constraints52475
Number of constraints which are clauses51555
Number of constraints which are cardinality constraints (but not clauses)0
Number of constraints which are nor clauses,nor cardinality constraints920
Minimum length of a constraint1
Maximum length of a constraint11
Number of terms in the objective function 0
Biggest coefficient in the objective function 0
Number of bits for the biggest coefficient in the objective function 0
Sum of the numbers in the objective function 0
Number of bits of the sum of numbers in the objective function 0
Biggest number in a constraint 39
Number of bits of the biggest number in a constraint 6
Biggest sum of numbers in a constraint 132
Number of bits of the biggest sum of numbers8
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Solver Data

0.00/0.00	c pb_cplex 1.0 - 20100701
0.00/0.00	c Parsing opb file format. File HOME/instance-3730921-1339246856.opb.
0.00/0.00	c Instance file HOME/instance-3730921-1339246856.opb
0.00/0.00	c File size is 1577317 bytes.
0.00/0.19	c Highest Coefficient sum: 132
0.00/0.19	c  IBM ILOG License Manager: "IBM ILOG Optimization Suite for Academic Initiative" is accessing CPLEX 12 with option(s): "e m b q ".
0.00/0.23	c ============================[ Problem Statistics ]=============================
0.00/0.23	c |                                                                             |
0.00/0.23	c |  Parsing time:          0.21         s                                      |
0.00/0.23	c |  Number Variables:      18069                                               |
0.00/0.23	c |  Number Constraints:    52475                                               |
0.00/0.23	c ===============================================================================
1800.10/725.21	c Remaining time 1799.78 sec.
1800.10/725.21	c 
1800.10/725.21	c *** INTERRUPTED ***
1800.10/725.21	s UNKNOWN
1800.10/725.21	c Total CPU time              : 1796.97 s
1800.10/725.21	c Memory used           : 840.61 MB
1800.10/725.21	c CPU time              : 1796.97 s
1800.10/725.21	c 
1800.10/725.21	c *** INTERRUPTED ***

Verifier Data

ERROR: no interpretation found !

Watcher Data

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.1 (svn: 989)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3730921-1339246856/watcher-3730921-1339246856 -o /tmp/evaluation-result-3730921-1339246856/solver-3730921-1339246856 -C 1800 -W 1900 -M 15500 run HOME/instance-3730921-1339246856.opb 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1900 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 0.20 0.05 0.01 2/170 16764
/proc/meminfo: memFree=29018756/32873624 swapFree=7112/7112
[pid=16764] ppid=16762 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/16764/stat : 16764 (run) S 16762 16764 16516 0 -1 4202496 355 0 0 0 0 0 0 0 20 0 1 0 390811095 9367552 270 33554432000 4194304 5064252 140733285233408 140733285232320 227512313422 0 65536 4100 65538 18446744071579302229 0 0 17 1 0 0 0 0 0
/proc/16764/statm: 2287 270 229 213 0 72 0

[startup+0.038619 s]
/proc/loadavg: 0.20 0.05 0.01 2/170 16764
/proc/meminfo: memFree=29018756/32873624 swapFree=7112/7112
[pid=16764] ppid=16762 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/16764/stat : 16764 (run) S 16762 16764 16516 0 -1 4202496 355 0 0 0 0 0 0 0 20 0 1 0 390811095 9367552 270 33554432000 4194304 5064252 140733285233408 140733285232320 227512313422 0 65536 4100 65538 18446744071579302229 0 0 17 1 0 0 0 0 0
/proc/16764/statm: 2287 270 229 213 0 72 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 9148

[startup+0.100212 s]
/proc/loadavg: 0.20 0.05 0.01 2/170 16764
/proc/meminfo: memFree=29018756/32873624 swapFree=7112/7112
[pid=16764] ppid=16762 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/16764/stat : 16764 (run) S 16762 16764 16516 0 -1 4202496 355 0 0 0 0 0 0 0 20 0 1 0 390811095 9367552 270 33554432000 4194304 5064252 140733285233408 140733285232320 227512313422 0 65536 4100 65538 18446744071579302229 0 0 17 1 0 0 0 0 0
/proc/16764/statm: 2287 270 229 213 0 72 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 9148

[startup+0.300218 s]
/proc/loadavg: 0.20 0.05 0.01 2/170 16764
/proc/meminfo: memFree=29018756/32873624 swapFree=7112/7112
[pid=16764] ppid=16762 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/16764/stat : 16764 (run) S 16762 16764 16516 0 -1 4202496 355 0 0 0 0 0 0 0 20 0 1 0 390811095 9367552 270 33554432000 4194304 5064252 140733285233408 140733285232320 227512313422 0 65536 4100 65538 18446744071579302229 0 0 17 1 0 0 0 0 0
/proc/16764/statm: 2287 270 229 213 0 72 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 9148

[startup+0.700192 s]
/proc/loadavg: 0.20 0.05 0.01 2/170 16764
/proc/meminfo: memFree=29018756/32873624 swapFree=7112/7112
[pid=16764] ppid=16762 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/16764/stat : 16764 (run) S 16762 16764 16516 0 -1 4202496 355 0 0 0 0 0 0 0 20 0 1 0 390811095 9367552 270 33554432000 4194304 5064252 140733285233408 140733285232320 227512313422 0 65536 4100 65538 18446744071579302229 0 0 17 1 0 0 0 0 0
/proc/16764/statm: 2287 270 229 213 0 72 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 9148

[startup+1.50022 s]
/proc/loadavg: 0.27 0.06 0.02 2/172 16766
/proc/meminfo: memFree=28971344/32873624 swapFree=7112/7112
[pid=16764] ppid=16762 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/16764/stat : 16764 (run) S 16762 16764 16516 0 -1 4202496 355 0 0 0 0 0 0 0 20 0 1 0 390811095 9367552 270 33554432000 4194304 5064252 140733285233408 140733285232320 227512313422 0 65536 4100 65538 18446744071579302229 0 0 17 1 0 0 0 0 0
/proc/16764/statm: 2287 270 229 213 0 72 0
[pid=16765] ppid=16764 vsize=139944 CPUtime=1.48 cores=1,3,5,7
/proc/16765/stat : 16765 (pb_cplex) R 16764 16764 16516 0 -1 4202496 27835 0 0 0 143 5 0 0 20 0 1 0 390811095 143302656 18652 33554432000 134512640 146736320 4290619664 4290614360 136007612 0 0 4096 16387 0 0 0 17 5 0 0 0 0 0
/proc/16765/statm: 34986 18652 730 2985 0 31920 0
Current children cumulated CPU time (s) 1.48
Current children cumulated vsize (KiB) 149092

[startup+3.10022 s]
/proc/loadavg: 0.27 0.06 0.02 2/172 16766
/proc/meminfo: memFree=28945980/32873624 swapFree=7112/7112
[pid=16764] ppid=16762 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/16764/stat : 16764 (run) S 16762 16764 16516 0 -1 4202496 355 0 0 0 0 0 0 0 20 0 1 0 390811095 9367552 270 33554432000 4194304 5064252 140733285233408 140733285232320 227512313422 0 65536 4100 65538 18446744071579302229 0 0 17 1 0 0 0 0 0
/proc/16764/statm: 2287 270 229 213 0 72 0
[pid=16765] ppid=16764 vsize=140196 CPUtime=3.09 cores=1,3,5,7
/proc/16765/stat : 16765 (pb_cplex) R 16764 16764 16516 0 -1 4202496 29826 0 0 0 303 6 0 0 20 0 1 0 390811095 143560704 18721 33554432000 134512640 146736320 4290619664 4290614360 136007053 0 0 4096 16387 0 0 0 17 5 0 0 0 0 0
/proc/16765/statm: 35049 18721 730 2985 0 31983 0
Current children cumulated CPU time (s) 3.09
Current children cumulated vsize (KiB) 149344

[startup+6.30016 s]
/proc/loadavg: 0.27 0.06 0.02 2/172 16830
/proc/meminfo: memFree=28940944/32873624 swapFree=7112/7112
[pid=16764] ppid=16762 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/16764/stat : 16764 (run) S 16762 16764 16516 0 -1 4202496 355 0 0 0 0 0 0 0 20 0 1 0 390811095 9367552 270 33554432000 4194304 5064252 140733285233408 140733285232320 227512313422 0 65536 4100 65538 18446744071579302229 0 0 17 1 0 0 0 0 0
/proc/16764/statm: 2287 270 229 213 0 72 0
[pid=16765] ppid=16764 vsize=143956 CPUtime=6.28 cores=1,3,5,7
/proc/16765/stat : 16765 (pb_cplex) R 16764 16764 16516 0 -1 4202496 38471 0 0 0 621 7 0 0 20 0 1 0 390811095 147410944 20177 33554432000 134512640 146736320 4290619664 4290614632 144757825 0 0 4096 16387 0 0 0 17 5 0 0 0 0 0
/proc/16765/statm: 35989 20177 794 2985 0 32923 0
Current children cumulated CPU time (s) 6.28
Current children cumulated vsize (KiB) 153104

[startup+12.7002 s]
/proc/loadavg: 0.46 0.11 0.03 3/178 16874
/proc/meminfo: memFree=28876188/32873624 swapFree=7112/7112
[pid=16764] ppid=16762 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/16764/stat : 16764 (run) S 16762 16764 16516 0 -1 4202496 355 0 0 0 0 0 0 0 20 0 1 0 390811095 9367552 270 33554432000 4194304 5064252 140733285233408 140733285232320 227512313422 0 65536 4100 65538 18446744071579302229 0 0 17 1 0 0 0 0 0
/proc/16764/statm: 2287 270 229 213 0 72 0
[pid=16765] ppid=16764 vsize=176684 CPUtime=12.69 cores=1,3,5,7
/proc/16765/stat : 16765 (pb_cplex) R 16764 16764 16516 0 -1 4202496 58626 0 0 0 1258 11 0 0 20 0 1 0 390811095 180924416 28611 33554432000 134512640 146736320 4290619664 4290614688 135767031 0 0 4096 16387 0 0 0 17 5 0 0 0 0 0
/proc/16765/statm: 44171 28612 830 2985 0 41105 0
Current children cumulated CPU time (s) 12.69
Current children cumulated vsize (KiB) 185832

[startup+25.5003 s]
/proc/loadavg: 0.70 0.17 0.06 3/178 16874
/proc/meminfo: memFree=28875640/32873624 swapFree=7112/7112
[pid=16764] ppid=16762 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/16764/stat : 16764 (run) S 16762 16764 16516 0 -1 4202496 355 0 0 0 0 0 0 0 20 0 1 0 390811095 9367552 270 33554432000 4194304 5064252 140733285233408 140733285232320 227512313422 0 65536 4100 65538 18446744071579302229 0 0 17 1 0 0 0 0 0
/proc/16764/statm: 2287 270 229 213 0 72 0
[pid=16765] ppid=16764 vsize=165972 CPUtime=25.48 cores=1,3,5,7
/proc/16765/stat : 16765 (pb_cplex) R 16764 16764 16516 0 -1 4202496 85383 0 0 0 2532 16 0 0 20 0 1 0 390811095 169955328 27066 33554432000 134512640 146736320 4290619664 4290614272 139046528 0 0 4096 16387 0 0 0 17 5 0 0 0 0 0
/proc/16765/statm: 41493 27066 842 2985 0 38427 0
Current children cumulated CPU time (s) 25.48
Current children cumulated vsize (KiB) 175120

[startup+51.1002 s]
/proc/loadavg: 1.14 0.32 0.11 3/178 16874
/proc/meminfo: memFree=28870092/32873624 swapFree=7112/7112
[pid=16764] ppid=16762 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/16764/stat : 16764 (run) S 16762 16764 16516 0 -1 4202496 355 0 0 0 0 0 0 0 20 0 1 0 390811095 9367552 270 33554432000 4194304 5064252 140733285233408 140733285232320 227512313422 0 65536 4100 65538 18446744071579302229 0 0 17 1 0 0 0 0 0
/proc/16764/statm: 2287 270 229 213 0 72 0
[pid=16765] ppid=16764 vsize=169208 CPUtime=51.07 cores=1,3,5,7
/proc/16765/stat : 16765 (pb_cplex) R 16764 16764 16516 0 -1 4202496 118973 0 0 0 5085 22 0 0 20 0 1 0 390811095 173268992 28376 33554432000 134512640 146736320 4290619664 4290613672 139044527 0 0 4096 16387 0 0 0 17 5 0 0 0 0 0
/proc/16765/statm: 42302 28376 843 2985 0 39236 0
Current children cumulated CPU time (s) 51.07
Current children cumulated vsize (KiB) 178356

[startup+102.307 s]
/proc/loadavg: 1.65 0.60 0.21 3/177 16874
/proc/meminfo: memFree=28848244/32873624 swapFree=7112/7112
[pid=16764] ppid=16762 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/16764/stat : 16764 (run) S 16762 16764 16516 0 -1 4202496 355 0 0 0 0 0 0 0 20 0 1 0 390811095 9367552 270 33554432000 4194304 5064252 140733285233408 140733285232320 227512313422 0 65536 4100 65538 18446744071579302229 0 0 17 1 0 0 0 0 0
/proc/16764/statm: 2287 270 229 213 0 72 0
[pid=16765] ppid=16764 vsize=182116 CPUtime=102.27 cores=1,3,5,7
/proc/16765/stat : 16765 (pb_cplex) R 16764 16764 16516 0 -1 4202496 168992 0 0 0 10195 32 0 0 20 0 1 0 390811095 186486784 33649 33554432000 134512640 146736320 4290619664 4290613744 136384861 0 0 4096 16387 0 0 0 17 5 0 0 0 0 0
/proc/16765/statm: 45529 33649 843 2985 0 42463 0
Current children cumulated CPU time (s) 102.27
Current children cumulated vsize (KiB) 191264

[startup+162.3 s]
/proc/loadavg: 1.87 0.85 0.32 3/177 16874
/proc/meminfo: memFree=28846684/32873624 swapFree=7112/7112
[pid=16764] ppid=16762 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/16764/stat : 16764 (run) S 16762 16764 16516 0 -1 4202496 355 0 0 0 0 0 0 0 20 0 1 0 390811095 9367552 270 33554432000 4194304 5064252 140733285233408 140733285232320 227512313422 0 65536 4100 65538 18446744071579302229 0 0 17 1 0 0 0 0 0
/proc/16764/statm: 2287 270 229 213 0 72 0
[pid=16765] ppid=16764 vsize=182468 CPUtime=162.26 cores=1,3,5,7
/proc/16765/stat : 16765 (pb_cplex) R 16764 16764 16516 0 -1 4202496 202417 0 0 0 16188 38 0 0 20 0 1 0 390811095 186847232 33746 33554432000 134512640 146736320 4290619664 4290613704 139043579 0 0 4096 16387 0 0 0 17 5 0 0 0 0 0
/proc/16765/statm: 45617 33746 843 2985 0 42551 0
Current children cumulated CPU time (s) 162.26
Current children cumulated vsize (KiB) 191616

[startup+222.3 s]
/proc/loadavg: 1.95 1.06 0.42 3/177 16874
/proc/meminfo: memFree=28852856/32873624 swapFree=7112/7112
[pid=16764] ppid=16762 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/16764/stat : 16764 (run) S 16762 16764 16516 0 -1 4202496 355 0 0 0 0 0 0 0 20 0 1 0 390811095 9367552 270 33554432000 4194304 5064252 140733285233408 140733285232320 227512313422 0 65536 4100 65538 18446744071579302229 0 0 17 1 0 0 0 0 0
/proc/16764/statm: 2287 270 229 213 0 72 0
[pid=16765] ppid=16764 vsize=178136 CPUtime=222.25 cores=1,3,5,7
/proc/16765/stat : 16765 (pb_cplex) R 16764 16764 16516 0 -1 4202496 285033 0 0 0 22171 54 0 0 20 0 1 0 390811095 182411264 32291 33554432000 134512640 146736320 4290619664 4290613452 136017757 0 0 4096 16387 0 0 0 17 5 0 0 0 0 0
/proc/16765/statm: 44534 32291 846 2985 0 41468 0
Current children cumulated CPU time (s) 222.25
Current children cumulated vsize (KiB) 187284

[startup+282.3 s]
/proc/loadavg: 1.98 1.23 0.52 3/176 16874
/proc/meminfo: memFree=28851184/32873624 swapFree=7112/7112
[pid=16764] ppid=16762 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/16764/stat : 16764 (run) S 16762 16764 16516 0 -1 4202496 355 0 0 0 0 0 0 0 20 0 1 0 390811095 9367552 270 33554432000 4194304 5064252 140733285233408 140733285232320 227512313422 0 65536 4100 65538 18446744071579302229 0 0 17 1 0 0 0 0 0
/proc/16764/statm: 2287 270 229 213 0 72 0
[pid=16765] ppid=16764 vsize=176408 CPUtime=282.23 cores=1,3,5,7
/proc/16765/stat : 16765 (pb_cplex) R 16764 16764 16516 0 -1 4202496 411096 0 0 0 28146 77 0 0 20 0 1 0 390811095 180641792 32287 33554432000 134512640 146736320 4290619664 4290613736 139044550 0 0 4096 16387 0 0 0 17 5 0 0 0 0 0
/proc/16765/statm: 44102 32287 857 2985 0 41036 0
Current children cumulated CPU time (s) 282.23
Current children cumulated vsize (KiB) 185556

[startup+342.301 s]
/proc/loadavg: 1.99 1.36 0.61 3/184 16882
/proc/meminfo: memFree=28677144/32873624 swapFree=7112/7112
[pid=16764] ppid=16762 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/16764/stat : 16764 (run) S 16762 16764 16516 0 -1 4202496 355 0 0 0 0 0 0 0 20 0 1 0 390811095 9367552 270 33554432000 4194304 5064252 140733285233408 140733285232320 227512313422 0 65536 4100 65538 18446744071579302229 0 0 17 1 0 0 0 0 0
/proc/16764/statm: 2287 270 229 213 0 72 0
[pid=16765] ppid=16764 vsize=494340 CPUtime=342.22 cores=1,3,5,7
/proc/16765/stat : 16765 (pb_cplex) R 16764 16764 16516 0 -1 4202496 538002 0 0 0 34122 100 0 0 20 0 8 0 390811095 506204160 75936 33554432000 134512640 146736320 4290619664 4290611352 136007289 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/16765/statm: 123585 75936 886 2985 0 120519 0
[pid=16765/tid=16876] ppid=16764 vsize=494340 CPUtime=0 cores=1,3,5,7
/proc/16765/task/16876/stat : 16876 (pb_cplex) S 16764 16764 16516 0 -1 4202560 4 0 0 0 0 0 0 0 20 0 8 0 390841397 506204160 75936 33554432000 134512640 146736320 4290619664 3930631824 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 7 0 0 0 0 0
[pid=16765/tid=16877] ppid=16764 vsize=494340 CPUtime=0 cores=1,3,5,7
/proc/16765/task/16877/stat : 16877 (pb_cplex) S 16764 16764 16516 0 -1 4202560 3 0 0 0 0 0 0 0 20 0 8 0 390841397 506204160 75936 33554432000 134512640 146736320 4290619664 3920146064 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 1 0 0 0 0 0
[pid=16765/tid=16878] ppid=16764 vsize=494340 CPUtime=0 cores=1,3,5,7
/proc/16765/task/16878/stat : 16878 (pb_cplex) S 16764 16764 16516 0 -1 4202560 3 0 0 0 0 0 0 0 20 0 8 0 390841397 506204160 75936 33554432000 134512640 146736320 4290619664 3909660304 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 7 0 0 0 0 0
[pid=16765/tid=16879] ppid=16764 vsize=494340 CPUtime=0 cores=1,3,5,7

################
# More data... #
################

/proc/16765/statm: 208928 150644 886 2985 0 205862 0
[pid=16765/tid=16876] ppid=16764 vsize=835712 CPUtime=73.26 cores=1,3,5,7
/proc/16765/task/16876/stat : 16876 (pb_cplex) R 16764 16764 16516 0 -1 4202560 31434 0 0 0 7316 10 0 0 20 0 8 0 390841397 855769088 150644 33554432000 134512640 146736320 4290619664 3930627160 136007083 0 2 4096 16387 0 0 0 -1 1 0 0 0 0 0
[pid=16765/tid=16877] ppid=16764 vsize=835712 CPUtime=58.83 cores=1,3,5,7
/proc/16765/task/16877/stat : 16877 (pb_cplex) S 16764 16764 16516 0 -1 4202560 28365 0 0 0 5873 10 0 0 20 0 8 0 390841397 855769088 150644 33554432000 134512640 146736320 4290619664 3920146064 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 7 0 0 0 0 0
[pid=16765/tid=16878] ppid=16764 vsize=835712 CPUtime=9.48 cores=1,3,5,7
/proc/16765/task/16878/stat : 16878 (pb_cplex) S 16764 16764 16516 0 -1 4202560 16738 0 0 0 943 5 0 0 20 0 8 0 390841397 855769088 150644 33554432000 134512640 146736320 4290619664 3909660304 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 5 0 0 0 0 0
[pid=16765/tid=16879] ppid=16764 vsize=835712 CPUtime=56.32 cores=1,3,5,7
/proc/16765/task/16879/stat : 16879 (pb_cplex) S 16764 16764 16516 0 -1 4202560 30164 0 0 0 5622 10 0 0 20 0 8 0 390841397 855769088 150644 33554432000 134512640 146736320 4290619664 3899174544 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 3 0 0 0 0 0
[pid=16765/tid=16880] ppid=16764 vsize=835712 CPUtime=51.14 cores=1,3,5,7
/proc/16765/task/16880/stat : 16880 (pb_cplex) S 16764 16764 16516 0 -1 4202560 24867 0 0 0 5106 8 0 0 20 0 8 0 390841397 855769088 150644 33554432000 134512640 146736320 4290619664 3888688784 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 5 0 0 0 0 0
[pid=16765/tid=16881] ppid=16764 vsize=835712 CPUtime=73.92 cores=1,3,5,7
/proc/16765/task/16881/stat : 16881 (pb_cplex) R 16764 16764 16516 0 -1 4202560 36731 0 0 0 7380 12 0 0 20 0 8 0 390841397 855769088 150644 33554432000 134512640 146736320 4290619664 3878198360 136007616 0 2 4096 16387 0 0 0 -1 5 0 0 0 0 0
[pid=16765/tid=16882] ppid=16764 vsize=835712 CPUtime=74.23 cores=1,3,5,7
/proc/16765/task/16882/stat : 16882 (pb_cplex) R 16764 16764 16516 0 -1 4202560 37975 0 0 0 7412 11 0 0 20 0 8 0 390841397 855769088 150644 33554432000 134512640 146736320 4290619664 3867712600 136007080 0 2 4096 16387 0 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 791.71
Current children cumulated vsize (KiB) 844860

[startup+522.3 s]
/proc/loadavg: 9.68 4.79 2.04 10/184 16917
/proc/meminfo: memFree=28180180/32873624 swapFree=7112/7112
[pid=16764] ppid=16762 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/16764/stat : 16764 (run) S 16762 16764 16516 0 -1 4202496 355 0 0 0 0 0 0 0 20 0 1 0 390811095 9367552 270 33554432000 4194304 5064252 140733285233408 140733285232320 227512313422 0 65536 4100 65538 18446744071579302229 0 0 17 1 0 0 0 0 0
/proc/16764/statm: 2287 270 229 213 0 72 0
[pid=16765] ppid=16764 vsize=845452 CPUtime=991.41 cores=1,3,5,7
/proc/16765/stat : 16765 (pb_cplex) R 16764 16764 16516 0 -1 4202496 878660 0 0 0 98930 211 0 0 20 0 8 0 390811095 865742848 155315 33554432000 134512640 146736320 4290619664 4290612724 136400534 0 0 4096 16387 18446744073709551615 0 0 17 7 0 0 0 0 0
/proc/16765/statm: 211363 155315 886 2985 0 208297 0
[pid=16765/tid=16876] ppid=16764 vsize=845452 CPUtime=112.85 cores=1,3,5,7
/proc/16765/task/16876/stat : 16876 (pb_cplex) R 16764 16764 16516 0 -1 4202560 57621 0 0 0 11267 18 0 0 20 0 8 0 390841397 865742848 155315 33554432000 134512640 146736320 4290619664 3930628248 136007670 0 2 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=16765/tid=16877] ppid=16764 vsize=845452 CPUtime=79.5 cores=1,3,5,7
/proc/16765/task/16877/stat : 16877 (pb_cplex) R 16764 16764 16516 0 -1 4202560 39610 0 0 0 7935 15 0 0 20 0 8 0 390841397 865742848 155315 33554432000 134512640 146736320 4290619664 3920141372 136400450 0 2 4096 16387 0 0 0 -1 7 0 0 0 0 0
[pid=16765/tid=16878] ppid=16764 vsize=845452 CPUtime=29.33 cores=1,3,5,7
/proc/16765/task/16878/stat : 16878 (pb_cplex) R 16764 16764 16516 0 -1 4202560 25665 0 0 0 2925 8 0 0 20 0 8 0 390841397 865742848 155315 33554432000 134512640 146736320 4290619664 3909656728 136007643 0 2 4096 16387 0 0 0 -1 1 0 0 0 0 0
[pid=16765/tid=16879] ppid=16764 vsize=845452 CPUtime=76.41 cores=1,3,5,7
/proc/16765/task/16879/stat : 16879 (pb_cplex) R 16764 16764 16516 0 -1 4202560 41534 0 0 0 7627 14 0 0 20 0 8 0 390841397 865742848 155315 33554432000 134512640 146736320 4290619664 3899169880 136007053 0 2 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=16765/tid=16880] ppid=16764 vsize=845452 CPUtime=71.57 cores=1,3,5,7
/proc/16765/task/16880/stat : 16880 (pb_cplex) R 16764 16764 16516 0 -1 4202560 32356 0 0 0 7144 13 0 0 20 0 8 0 390841397 865742848 155315 33554432000 134512640 146736320 4290619664 3888685208 136007039 0 2 4096 16387 0 0 0 -1 5 0 0 0 0 0
[pid=16765/tid=16881] ppid=16764 vsize=845452 CPUtime=96.83 cores=1,3,5,7
/proc/16765/task/16881/stat : 16881 (pb_cplex) R 16764 16764 16516 0 -1 4202560 51853 0 0 0 9666 17 0 0 20 0 8 0 390841397 865742848 155315 33554432000 134512640 146736320 4290619664 3878199448 136007674 0 2 4096 16387 0 0 0 -1 7 0 0 0 0 0
[pid=16765/tid=16882] ppid=16764 vsize=845452 CPUtime=109.92 cores=1,3,5,7
/proc/16765/task/16882/stat : 16882 (pb_cplex) R 16764 16764 16516 0 -1 4202560 64485 0 0 0 10973 19 0 0 20 0 8 0 390841397 865742848 155315 33554432000 134512640 146736320 4290619664 3867713688 136007065 0 2 4096 16387 0 0 0 -1 7 0 0 0 0 0
Current children cumulated CPU time (s) 991.41
Current children cumulated vsize (KiB) 854600

[startup+582.3 s]
/proc/loadavg: 12.89 6.51 2.79 17/192 16948
/proc/meminfo: memFree=27909196/32873624 swapFree=7112/7112
[pid=16764] ppid=16762 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/16764/stat : 16764 (run) S 16762 16764 16516 0 -1 4202496 355 0 0 0 0 0 0 0 20 0 1 0 390811095 9367552 270 33554432000 4194304 5064252 140733285233408 140733285232320 227512313422 0 65536 4100 65538 18446744071579302229 0 0 17 1 0 0 0 0 0
/proc/16764/statm: 2287 270 229 213 0 72 0
[pid=16765] ppid=16764 vsize=850248 CPUtime=1230.46 cores=1,3,5,7
/proc/16765/stat : 16765 (pb_cplex) R 16764 16764 16516 0 -1 4202496 952837 0 0 0 122808 238 0 0 20 0 8 0 390811095 870653952 158144 33554432000 134512640 146736320 4290619664 4290612440 136007605 0 0 4096 16387 18446744073709551615 0 0 17 7 0 0 0 0 0
/proc/16765/statm: 212562 158144 886 2985 0 209496 0
[pid=16765/tid=16876] ppid=16764 vsize=850248 CPUtime=142.55 cores=1,3,5,7
/proc/16765/task/16876/stat : 16876 (pb_cplex) R 16764 16764 16516 0 -1 4202560 64836 0 0 0 14234 21 0 0 20 0 8 0 390841397 870653952 158144 33554432000 134512640 146736320 4290619664 3930628248 136007053 0 2 4096 16387 0 0 0 -1 1 0 0 0 0 0
[pid=16765/tid=16877] ppid=16764 vsize=850248 CPUtime=109.16 cores=1,3,5,7
/proc/16765/task/16877/stat : 16877 (pb_cplex) R 16764 16764 16516 0 -1 4202560 58422 0 0 0 10894 22 0 0 20 0 8 0 390841397 870653952 158144 33554432000 134512640 146736320 4290619664 3920141400 136007313 0 2 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=16765/tid=16878] ppid=16764 vsize=850248 CPUtime=58.86 cores=1,3,5,7
/proc/16765/task/16878/stat : 16878 (pb_cplex) R 16764 16764 16516 0 -1 4202560 33066 0 0 0 5875 11 0 0 20 0 8 0 390841397 870653952 158144 33554432000 134512640 146736320 4290619664 3909656728 136007661 0 2 4096 16387 0 0 0 -1 5 0 0 0 0 0
[pid=16765/tid=16879] ppid=16764 vsize=850248 CPUtime=106.48 cores=1,3,5,7
/proc/16765/task/16879/stat : 16879 (pb_cplex) R 16764 16764 16516 0 -1 4202560 50446 0 0 0 10631 17 0 0 20 0 8 0 390841397 870653952 158144 33554432000 134512640 146736320 4290619664 3899170908 135854535 0 2 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=16765/tid=16880] ppid=16764 vsize=850248 CPUtime=101.53 cores=1,3,5,7
/proc/16765/task/16880/stat : 16880 (pb_cplex) R 16764 16764 16516 0 -1 4202560 43957 0 0 0 10136 17 0 0 20 0 8 0 390841397 870653952 158144 33554432000 134512640 146736320 4290619664 3888684560 136403109 0 2 4096 16387 0 0 0 -1 7 0 0 0 0 0
[pid=16765/tid=16881] ppid=16764 vsize=850248 CPUtime=127.09 cores=1,3,5,7
/proc/16765/task/16881/stat : 16881 (pb_cplex) R 16764 16764 16516 0 -1 4202560 59225 0 0 0 12688 21 0 0 20 0 8 0 390841397 870653952 158144 33554432000 134512640 146736320 4290619664 3878199448 136007616 0 2 4096 16387 0 0 0 -1 5 0 0 0 0 0
[pid=16765/tid=16882] ppid=16764 vsize=850248 CPUtime=139.59 cores=1,3,5,7
/proc/16765/task/16882/stat : 16882 (pb_cplex) R 16764 16764 16516 0 -1 4202560 72114 0 0 0 13937 22 0 0 20 0 8 0 390841397 870653952 158144 33554432000 134512640 146736320 4290619664 3867713664 135468704 0 2 4096 16387 0 0 0 -1 1 0 0 0 0 0
Current children cumulated CPU time (s) 1230.46
Current children cumulated vsize (KiB) 859396

[startup+642.3 s]
/proc/loadavg: 13.25 7.83 3.48 17/191 16949
/proc/meminfo: memFree=27835296/32873624 swapFree=7112/7112
[pid=16764] ppid=16762 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/16764/stat : 16764 (run) S 16762 16764 16516 0 -1 4202496 355 0 0 0 0 0 0 0 20 0 1 0 390811095 9367552 270 33554432000 4194304 5064252 140733285233408 140733285232320 227512313422 0 65536 4100 65538 18446744071579302229 0 0 17 1 0 0 0 0 0
/proc/16764/statm: 2287 270 229 213 0 72 0
[pid=16765] ppid=16764 vsize=853032 CPUtime=1469.58 cores=1,3,5,7
/proc/16765/stat : 16765 (pb_cplex) R 16764 16764 16516 0 -1 4202496 1039552 0 0 0 146684 274 0 0 20 0 8 0 390811095 873504768 163764 33554432000 134512640 146736320 4290619664 4290611352 136007605 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/16765/statm: 213258 163764 886 2985 0 210192 0
[pid=16765/tid=16876] ppid=16764 vsize=853032 CPUtime=172.47 cores=1,3,5,7
/proc/16765/task/16876/stat : 16876 (pb_cplex) R 16764 16764 16516 0 -1 4202560 75010 0 0 0 17221 26 0 0 20 0 8 0 390841397 873504768 163764 33554432000 134512640 146736320 4290619664 3930628136 139044505 0 2 4096 16387 0 0 0 -1 1 0 0 0 0 0
[pid=16765/tid=16877] ppid=16764 vsize=853032 CPUtime=139.09 cores=1,3,5,7
/proc/16765/task/16877/stat : 16877 (pb_cplex) R 16764 16764 16516 0 -1 4202560 70110 0 0 0 13882 27 0 0 20 0 8 0 390841397 873504768 163764 33554432000 134512640 146736320 4290619664 3920142488 136007616 0 2 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=16765/tid=16878] ppid=16764 vsize=853032 CPUtime=88.88 cores=1,3,5,7
/proc/16765/task/16878/stat : 16878 (pb_cplex) R 16764 16764 16516 0 -1 4202560 39864 0 0 0 8874 14 0 0 20 0 8 0 390841397 873504768 163764 33554432000 134512640 146736320 4290619664 3909655640 136007661 0 2 4096 16387 0 0 0 -1 5 0 0 0 0 0
[pid=16765/tid=16879] ppid=16764 vsize=853032 CPUtime=136.41 cores=1,3,5,7
/proc/16765/task/16879/stat : 16879 (pb_cplex) R 16764 16764 16516 0 -1 4202560 54251 0 0 0 13621 20 0 0 20 0 8 0 390841397 873504768 163764 33554432000 134512640 146736320 4290619664 3899170968 136007616 0 2 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=16765/tid=16880] ppid=16764 vsize=853032 CPUtime=131.28 cores=1,3,5,7
/proc/16765/task/16880/stat : 16880 (pb_cplex) R 16764 16764 16516 0 -1 4202560 70695 0 0 0 13101 27 0 0 20 0 8 0 390841397 873504768 163764 33554432000 134512640 146736320 4290619664 3888684008 139044564 0 2 4096 16387 0 0 0 -1 1 0 0 0 0 0
[pid=16765/tid=16881] ppid=16764 vsize=853032 CPUtime=156.73 cores=1,3,5,7
/proc/16765/task/16881/stat : 16881 (pb_cplex) R 16764 16764 16516 0 -1 4202560 70404 0 0 0 15647 26 0 0 20 0 8 0 390841397 873504768 163764 33554432000 134512640 146736320 4290619664 3878199448 136007605 0 2 4096 16387 0 0 0 -1 7 0 0 0 0 0
[pid=16765/tid=16882] ppid=16764 vsize=853032 CPUtime=169.44 cores=1,3,5,7
/proc/16765/task/16882/stat : 16882 (pb_cplex) R 16764 16764 16516 0 -1 4202560 81415 0 0 0 16917 27 0 0 20 0 8 0 390841397 873504768 163764 33554432000 134512640 146736320 4290619664 3867713688 136007097 0 2 4096 16387 0 0 0 -1 7 0 0 0 0 0
Current children cumulated CPU time (s) 1469.58
Current children cumulated vsize (KiB) 862180

[startup+702.3 s]
/proc/loadavg: 11.44 8.38 3.95 10/184 16998
/proc/meminfo: memFree=28184524/32873624 swapFree=7112/7112
[pid=16764] ppid=16762 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/16764/stat : 16764 (run) S 16762 16764 16516 0 -1 4202496 355 0 0 0 0 0 0 0 20 0 1 0 390811095 9367552 270 33554432000 4194304 5064252 140733285233408 140733285232320 227512313422 0 65536 4100 65538 18446744071579302229 0 0 17 1 0 0 0 0 0
/proc/16764/statm: 2287 270 229 213 0 72 0
[pid=16765] ppid=16764 vsize=853872 CPUtime=1708.73 cores=1,3,5,7
/proc/16765/stat : 16765 (pb_cplex) R 16764 16764 16516 0 -1 4202496 1098433 0 0 0 170567 306 0 0 20 0 8 0 390811095 874364928 164134 33554432000 134512640 146736320 4290619664 4290611092 136017481 0 0 4096 16387 18446744073709551615 0 0 17 7 0 0 0 0 0
/proc/16765/statm: 213468 164134 886 2985 0 210402 0
[pid=16765/tid=16876] ppid=16764 vsize=853872 CPUtime=202.39 cores=1,3,5,7
/proc/16765/task/16876/stat : 16876 (pb_cplex) R 16764 16764 16516 0 -1 4202560 85613 0 0 0 20208 31 0 0 20 0 8 0 390841397 874364928 164134 33554432000 134512640 146736320 4290619664 3930628248 136007053 0 2 4096 16387 0 0 0 -1 1 0 0 0 0 0
[pid=16765/tid=16877] ppid=16764 vsize=853872 CPUtime=168.95 cores=1,3,5,7
/proc/16765/task/16877/stat : 16877 (pb_cplex) R 16764 16764 16516 0 -1 4202560 86181 0 0 0 16861 34 0 0 20 0 8 0 390841397 874364928 164134 33554432000 134512640 146736320 4290619664 3920142488 136007065 0 2 4096 16387 0 0 0 -1 5 0 0 0 0 0
[pid=16765/tid=16878] ppid=16764 vsize=853872 CPUtime=118.91 cores=1,3,5,7
/proc/16765/task/16878/stat : 16878 (pb_cplex) R 16764 16764 16516 0 -1 4202560 43132 0 0 0 11874 17 0 0 20 0 8 0 390841397 874364928 164134 33554432000 134512640 146736320 4290619664 3909655640 136007083 0 2 4096 16387 0 0 0 -1 5 0 0 0 0 0
[pid=16765/tid=16879] ppid=16764 vsize=853872 CPUtime=166.39 cores=1,3,5,7
/proc/16765/task/16879/stat : 16879 (pb_cplex) R 16764 16764 16516 0 -1 4202560 62178 0 0 0 16615 24 0 0 20 0 8 0 390841397 874364928 164134 33554432000 134512640 146736320 4290619664 3899170940 136400463 0 2 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=16765/tid=16880] ppid=16764 vsize=853872 CPUtime=161.2 cores=1,3,5,7
/proc/16765/task/16880/stat : 16880 (pb_cplex) R 16764 16764 16516 0 -1 4202560 74305 0 0 0 16090 30 0 0 20 0 8 0 390841397 874364928 164134 33554432000 134512640 146736320 4290619664 3888685208 136007065 0 2 4096 16387 0 0 0 -1 1 0 0 0 0 0
[pid=16765/tid=16881] ppid=16764 vsize=853872 CPUtime=186.28 cores=1,3,5,7
/proc/16765/task/16881/stat : 16881 (pb_cplex) R 16764 16764 16516 0 -1 4202560 73814 0 0 0 18598 30 0 0 20 0 8 0 390841397 874364928 164134 33554432000 134512640 146736320 4290619664 3878198280 139042876 0 2 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=16765/tid=16882] ppid=16764 vsize=853872 CPUtime=199.15 cores=1,3,5,7
/proc/16765/task/16882/stat : 16882 (pb_cplex) R 16764 16764 16516 0 -1 4202560 88622 0 0 0 19883 32 0 0 20 0 8 0 390841397 874364928 164134 33554432000 134512640 146736320 4290619664 3867713688 136007612 0 2 4096 16387 0 0 0 -1 7 0 0 0 0 0
Current children cumulated CPU time (s) 1708.73
Current children cumulated vsize (KiB) 863020



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+725.2 s]
/proc/loadavg: 10.66 8.40 4.05 9/191 17005
/proc/meminfo: memFree=27900884/32873624 swapFree=7112/7112
[pid=16764] ppid=16762 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/16764/stat : 16764 (run) S 16762 16764 16516 0 -1 4202496 355 0 0 0 0 0 0 0 20 0 1 0 390811095 9367552 270 33554432000 4194304 5064252 140733285233408 140733285232320 227512313422 0 65536 4100 65538 18446744071579302229 0 0 17 1 0 0 0 0 0
/proc/16764/statm: 2287 270 229 213 0 72 0
[pid=16765] ppid=16764 vsize=860784 CPUtime=1800.1 cores=1,3,5,7
/proc/16765/stat : 16765 (pb_cplex) R 16764 16764 16516 0 -1 4202496 1125906 0 0 0 179692 318 0 0 20 0 8 0 390811095 881442816 165507 33554432000 134512640 146736320 4290619664 4290611352 136007065 0 0 4096 16387 18446744073709551615 0 0 17 7 0 0 0 0 0
/proc/16765/statm: 215196 165507 886 2985 0 212130 0
[pid=16765/tid=16876] ppid=16764 vsize=860784 CPUtime=210.73 cores=1,3,5,7
/proc/16765/task/16876/stat : 16876 (pb_cplex) S 16764 16764 16516 0 -1 4202560 87561 0 0 0 21041 32 0 0 20 0 8 0 390841397 881442816 165507 33554432000 134512640 146736320 4290619664 3930631824 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 1 0 0 0 0 0
[pid=16765/tid=16877] ppid=16764 vsize=860784 CPUtime=180.91 cores=1,3,5,7
/proc/16765/task/16877/stat : 16877 (pb_cplex) R 16764 16764 16516 0 -1 4202560 91698 0 0 0 18055 36 0 0 20 0 8 0 390841397 881442816 165507 33554432000 134512640 146736320 4290619664 3920142928 136403114 0 2 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=16765/tid=16878] ppid=16764 vsize=860784 CPUtime=130.75 cores=1,3,5,7
/proc/16765/task/16878/stat : 16878 (pb_cplex) R 16764 16764 16516 0 -1 4202560 45624 0 0 0 13057 18 0 0 20 0 8 0 390841397 881442816 165507 33554432000 134512640 146736320 4290619664 3909655640 136007053 0 2 4096 16387 0 0 0 -1 1 0 0 0 0 0
[pid=16765/tid=16879] ppid=16764 vsize=860784 CPUtime=178.38 cores=1,3,5,7
/proc/16765/task/16879/stat : 16879 (pb_cplex) R 16764 16764 16516 0 -1 4202560 63600 0 0 0 17813 25 0 0 20 0 8 0 390841397 881442816 165507 33554432000 134512640 146736320 4290619664 3899171272 136001929 0 2 4096 16387 0 0 0 -1 7 0 0 0 0 0
[pid=16765/tid=16880] ppid=16764 vsize=860784 CPUtime=173.06 cores=1,3,5,7
/proc/16765/task/16880/stat : 16880 (pb_cplex) R 16764 16764 16516 0 -1 4202560 76327 0 0 0 17275 31 0 0 20 0 8 0 390841397 881442816 165507 33554432000 134512640 146736320 4290619664 3888685512 136001965 0 2 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=16765/tid=16881] ppid=16764 vsize=860784 CPUtime=198.14 cores=1,3,5,7
/proc/16765/task/16881/stat : 16881 (pb_cplex) R 16764 16764 16516 0 -1 4202560 83907 0 0 0 19780 34 0 0 20 0 8 0 390841397 881442816 165507 33554432000 134512640 146736320 4290619664 3878199448 136007612 0 2 4096 16387 0 0 0 -1 5 0 0 0 0 0
[pid=16765/tid=16882] ppid=16764 vsize=860784 CPUtime=210.79 cores=1,3,5,7
/proc/16765/task/16882/stat : 16882 (pb_cplex) R 16764 16764 16516 0 -1 4202560 89712 0 0 0 21046 33 0 0 20 0 8 0 390841397 881442816 165507 33554432000 134512640 146736320 4290619664 3867713760 139028313 0 2 4096 16387 0 0 0 -1 1 0 0 0 0 0
Current children cumulated CPU time (s) 1800.1
Current children cumulated vsize (KiB) 869932

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 16764 and gives
#  childrusage.ru_utime.tv_sec=0
#  childrusage.ru_utime.tv_usec=0
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=999
# CPU time returned by wait4() is 0.000999
# while last known CPU time is 1800.1
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 725.222
CPU time (s): 1800.1
CPU user time (s): 1796.92
CPU system time (s): 3.18
CPU usage (%): 248.214
Max. virtual memory (cumulated for all children) (KiB): 881268

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 0
system time used= 0.000999
maximum resident set size= 1080
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 355
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 2
involuntary context switches= 1

runsolver used 2.03069 second user time and 4.33534 second system time

The end

Launcher Data

Begin job on node121 at 2012-06-09 15:00:56
IDJOB=3730921
IDBENCH=1493
IDSOLVER=2325
FILE ID=node121/3730921-1339246856
RUNJOBID= node121-1339246834-16533
PBS_JOBID= 14644360
Free space on /tmp= 70644 MiB

SOLVER NAME= PB10: pb_cplex 2010-06-29
BENCH NAME= PB06//final/normalized-PB06/SATUNSAT-SMALLINT/web/uclid_pb_benchmarks/normalized-ooo.rf10.ucl.opb
COMMAND LINE= run BENCHNAME
CONVERSION SCRIPT= PBconversionToLinear BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3730921-1339246856/watcher-3730921-1339246856 -o /tmp/evaluation-result-3730921-1339246856/solver-3730921-1339246856 -C 1800 -W 1900 -M 15500  run HOME/instance-3730921-1339246856.opb

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 631c705feb60dcd8a1b144825a73a754
RANDOM SEED=526829103

node121.alineos.net Linux 2.6.32-71.29.1.el6.x86_64 #1 SMP Mon Jun 27 19:49:27 BST 2011

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.042
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5334.08
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.042
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.042
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.92
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.042
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.042
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.042
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.042
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5438.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.042
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32873624 kB
MemFree:        29019684 kB
Buffers:         1018732 kB
Cached:          1847512 kB
SwapCached:          340 kB
Active:          2808468 kB
Inactive:          80932 kB
Active(anon):       2676 kB
Inactive(anon):     8164 kB
Active(file):    2805792 kB
Inactive(file):    72768 kB
Unevictable:        7112 kB
Mlocked:            7112 kB
SwapTotal:      67108856 kB
SwapFree:       67106508 kB
Dirty:             18264 kB
Writeback:             0 kB
AnonPages:         15236 kB
Mapped:            10976 kB
Shmem:                40 kB
Slab:             826488 kB
SReclaimable:     269884 kB
SUnreclaim:       556604 kB
KernelStack:        1384 kB
PageTables:         4076 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83545668 kB
Committed_AS:      92000 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      346400 kB
VmallocChunk:   34341988052 kB
HardwareCorrupted:     0 kB
AnonHugePages:         0 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:        7680 kB
DirectMap2M:    33538048 kB

CONVERSION COMMAND LINE= PBconversionToLinear HOME/instance-3730921-1339246856.opb

Free space on /tmp at the end= 70600 MiB
End job on node121 at 2012-06-09 15:13:02