Trace number 3737768

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
PB10: pb_cplex 2010-06-29? (TO) 1800.04 1124.23

General information on the benchmark

Namenormalized-PB07/SATUNSAT-SMALLINT-NLC/submittedPB07/
manquinho/dbsg/normalized-dbsg_200_25_5_40.opb
MD5SUMc1794605d16cd8196553c490f5507fd9
Bench CategoryDEC-SMALLINT-NLC (no optimisation, small integers, non linear constraints)
Best result obtained on this benchmark
Best value of the objective obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Has Objective FunctionNO
Satisfiable
(Un)Satisfiability was proved
Best value of the objective function
Optimality of the best value was proved
Number of variables400
Total number of constraints602
Number of constraints which are clauses200
Number of constraints which are cardinality constraints (but not clauses)1
Number of constraints which are nor clauses,nor cardinality constraints401
Minimum length of a constraint2
Maximum length of a constraint400
Number of terms in the objective function 0
Biggest coefficient in the objective function 0
Number of bits for the biggest coefficient in the objective function 0
Sum of the numbers in the objective function 0
Number of bits of the sum of numbers in the objective function 0
Biggest number in a constraint 40
Number of bits of the biggest number in a constraint 6
Biggest sum of numbers in a constraint 400
Number of bits of the biggest sum of numbers9
Number of products (including duplicates)12452
Sum of products size (including duplicates)24904
Number of different products6226
Sum of products size12452

Solver Data 

0.00/0.00	c pb_cplex 1.0 - 20100701
0.00/0.00	c Parsing opb file format. File HOME/instance-3737768-1339248789.opb.
0.00/0.00	c Instance file HOME/instance-3737768-1339248789.opb
0.00/0.00	c File size is 532481 bytes.
0.00/0.12	c Highest Coefficient sum: 400
0.00/0.12	c  IBM ILOG License Manager: "IBM ILOG Optimization Suite for Academic Initiative" is accessing CPLEX 12 with option(s): "e m b q ".
0.00/0.13	c ============================[ Problem Statistics ]=============================
0.00/0.13	c |                                                                             |
0.00/0.13	c |  Parsing time:          0.12         s                                      |
0.00/0.13	c |  Number Variables:      6626                                                |
0.00/0.13	c |  Number Constraints:    13054                                               |
0.00/0.13	c ===============================================================================

Verifier Data 

ERROR: no interpretation found !

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.1 (svn: 989)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3737768-1339248789/watcher-3737768-1339248789 -o /tmp/evaluation-result-3737768-1339248789/solver-3737768-1339248789 -C 1800 -W 1900 -M 15500 run HOME/instance-3737768-1339248789.opb 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1900 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 5.84 7.12 7.15 3/177 23978
/proc/meminfo: memFree=30226236/32873648 swapFree=7372/7372
[pid=23978] ppid=23976 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/23978/stat : 23978 (run) S 23976 23978 22465 0 -1 4202496 356 0 0 0 0 0 0 0 20 0 1 0 391004758 9367552 270 33554432000 4194304 5064252 140737312408160 140737312407072 259112199758 0 65536 4100 65538 18446744071579302229 0 0 17 5 0 0 0 0 0
/proc/23978/statm: 2287 270 229 213 0 72 0

[startup+0.0335741 s]
/proc/loadavg: 5.84 7.12 7.15 3/177 23978
/proc/meminfo: memFree=30226236/32873648 swapFree=7372/7372
[pid=23978] ppid=23976 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/23978/stat : 23978 (run) S 23976 23978 22465 0 -1 4202496 356 0 0 0 0 0 0 0 20 0 1 0 391004758 9367552 270 33554432000 4194304 5064252 140737312408160 140737312407072 259112199758 0 65536 4100 65538 18446744071579302229 0 0 17 5 0 0 0 0 0
/proc/23978/statm: 2287 270 229 213 0 72 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 9148

[startup+0.100213 s]
/proc/loadavg: 5.84 7.12 7.15 3/177 23978
/proc/meminfo: memFree=30226236/32873648 swapFree=7372/7372
[pid=23978] ppid=23976 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/23978/stat : 23978 (run) S 23976 23978 22465 0 -1 4202496 356 0 0 0 0 0 0 0 20 0 1 0 391004758 9367552 270 33554432000 4194304 5064252 140737312408160 140737312407072 259112199758 0 65536 4100 65538 18446744071579302229 0 0 17 5 0 0 0 0 0
/proc/23978/statm: 2287 270 229 213 0 72 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 9148

[startup+0.300215 s]
/proc/loadavg: 5.84 7.12 7.15 3/177 23978
/proc/meminfo: memFree=30226236/32873648 swapFree=7372/7372
[pid=23978] ppid=23976 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/23978/stat : 23978 (run) S 23976 23978 22465 0 -1 4202496 356 0 0 0 0 0 0 0 20 0 1 0 391004758 9367552 270 33554432000 4194304 5064252 140737312408160 140737312407072 259112199758 0 65536 4100 65538 18446744071579302229 0 0 17 5 0 0 0 0 0
/proc/23978/statm: 2287 270 229 213 0 72 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 9148

[startup+0.700259 s]
/proc/loadavg: 5.84 7.12 7.15 3/177 23978
/proc/meminfo: memFree=30226236/32873648 swapFree=7372/7372
[pid=23978] ppid=23976 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/23978/stat : 23978 (run) S 23976 23978 22465 0 -1 4202496 356 0 0 0 0 0 0 0 20 0 1 0 391004758 9367552 270 33554432000 4194304 5064252 140737312408160 140737312407072 259112199758 0 65536 4100 65538 18446744071579302229 0 0 17 5 0 0 0 0 0
/proc/23978/statm: 2287 270 229 213 0 72 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 9148

[startup+1.50028 s]
/proc/loadavg: 5.84 7.12 7.15 3/179 23980
/proc/meminfo: memFree=30191312/32873648 swapFree=7372/7372
[pid=23978] ppid=23976 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/23978/stat : 23978 (run) S 23976 23978 22465 0 -1 4202496 356 0 0 0 0 0 0 0 20 0 1 0 391004758 9367552 270 33554432000 4194304 5064252 140737312408160 140737312407072 259112199758 0 65536 4100 65538 18446744071579302229 0 0 17 5 0 0 0 0 0
/proc/23978/statm: 2287 270 229 213 0 72 0
[pid=23979] ppid=23978 vsize=67124 CPUtime=1.49 cores=1,3,5,7
/proc/23979/stat : 23979 (pb_cplex) R 23978 23978 22465 0 -1 4202496 15505 0 0 0 146 3 0 0 20 0 1 0 391004758 68734976 9648 33554432000 134512640 146736320 4293772768 4293766860 136017522 0 0 4096 16387 0 0 0 17 3 0 0 0 0 0
/proc/23979/statm: 16781 9648 816 2985 0 13715 0
Current children cumulated CPU time (s) 1.49
Current children cumulated vsize (KiB) 76272

[startup+3.10023 s]
/proc/loadavg: 5.84 7.12 7.15 3/179 23980
/proc/meminfo: memFree=30190628/32873648 swapFree=7372/7372
[pid=23978] ppid=23976 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/23978/stat : 23978 (run) S 23976 23978 22465 0 -1 4202496 356 0 0 0 0 0 0 0 20 0 1 0 391004758 9367552 270 33554432000 4194304 5064252 140737312408160 140737312407072 259112199758 0 65536 4100 65538 18446744071579302229 0 0 17 5 0 0 0 0 0
/proc/23978/statm: 2287 270 229 213 0 72 0
[pid=23979] ppid=23978 vsize=67200 CPUtime=3.09 cores=1,3,5,7
/proc/23979/stat : 23979 (pb_cplex) R 23978 23978 22465 0 -1 4202496 15534 0 0 0 306 3 0 0 20 0 1 0 391004758 68812800 9677 33554432000 134512640 146736320 4293772768 4293766728 139043587 0 0 4096 16387 0 0 0 17 3 0 0 0 0 0
/proc/23979/statm: 16800 9677 816 2985 0 13734 0
Current children cumulated CPU time (s) 3.09
Current children cumulated vsize (KiB) 76348

[startup+6.30028 s]
/proc/loadavg: 5.53 7.04 7.12 3/179 23980
/proc/meminfo: memFree=30189376/32873648 swapFree=7372/7372
[pid=23978] ppid=23976 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/23978/stat : 23978 (run) S 23976 23978 22465 0 -1 4202496 356 0 0 0 0 0 0 0 20 0 1 0 391004758 9367552 270 33554432000 4194304 5064252 140737312408160 140737312407072 259112199758 0 65536 4100 65538 18446744071579302229 0 0 17 5 0 0 0 0 0
/proc/23978/statm: 2287 270 229 213 0 72 0
[pid=23979] ppid=23978 vsize=67260 CPUtime=6.29 cores=1,3,5,7
/proc/23979/stat : 23979 (pb_cplex) R 23978 23978 22465 0 -1 4202496 15970 0 0 0 626 3 0 0 20 0 1 0 391004758 68874240 9763 33554432000 134512640 146736320 4293772768 4293766860 136017457 0 0 4096 16387 0 0 0 17 3 0 0 0 0 0
/proc/23979/statm: 16815 9763 817 2985 0 13749 0
Current children cumulated CPU time (s) 6.29
Current children cumulated vsize (KiB) 76408

[startup+12.7002 s]
/proc/loadavg: 5.33 6.97 7.10 3/179 23980
/proc/meminfo: memFree=30188784/32873648 swapFree=7372/7372
[pid=23978] ppid=23976 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/23978/stat : 23978 (run) S 23976 23978 22465 0 -1 4202496 356 0 0 0 0 0 0 0 20 0 1 0 391004758 9367552 270 33554432000 4194304 5064252 140737312408160 140737312407072 259112199758 0 65536 4100 65538 18446744071579302229 0 0 17 5 0 0 0 0 0
/proc/23978/statm: 2287 270 229 213 0 72 0
[pid=23979] ppid=23978 vsize=66556 CPUtime=12.69 cores=1,3,5,7
/proc/23979/stat : 23979 (pb_cplex) R 23978 23978 22465 0 -1 4202496 17334 0 0 0 1266 3 0 0 20 0 1 0 391004758 68153344 10013 33554432000 134512640 146736320 4293772768 4293766768 136384883 0 0 4096 16387 0 0 0 17 3 0 0 0 0 0
/proc/23979/statm: 16639 10013 832 2985 0 13573 0
Current children cumulated CPU time (s) 12.69
Current children cumulated vsize (KiB) 75704

[startup+25.5073 s]
/proc/loadavg: 4.59 6.73 7.02 3/179 23980
/proc/meminfo: memFree=30187104/32873648 swapFree=7372/7372
[pid=23978] ppid=23976 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/23978/stat : 23978 (run) S 23976 23978 22465 0 -1 4202496 356 0 0 0 0 0 0 0 20 0 1 0 391004758 9367552 270 33554432000 4194304 5064252 140737312408160 140737312407072 259112199758 0 65536 4100 65538 18446744071579302229 0 0 17 5 0 0 0 0 0
/proc/23978/statm: 2287 270 229 213 0 72 0
[pid=23979] ppid=23978 vsize=66704 CPUtime=25.49 cores=1,3,5,7
/proc/23979/stat : 23979 (pb_cplex) R 23978 23978 22465 0 -1 4202496 28528 0 0 0 2544 5 0 0 20 0 1 0 391004758 68304896 10325 33554432000 134512640 146736320 4293772768 4293766972 136017787 0 0 4096 16387 0 0 0 17 3 0 0 0 0 0
/proc/23979/statm: 16676 10325 839 2985 0 13610 0
Current children cumulated CPU time (s) 25.49
Current children cumulated vsize (KiB) 75852

[startup+51.1005 s]
/proc/loadavg: 4.62 6.54 6.95 5/186 23987
/proc/meminfo: memFree=30083060/32873648 swapFree=7372/7372
[pid=23978] ppid=23976 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/23978/stat : 23978 (run) S 23976 23978 22465 0 -1 4202496 356 0 0 0 0 0 0 0 20 0 1 0 391004758 9367552 270 33554432000 4194304 5064252 140737312408160 140737312407072 259112199758 0 65536 4100 65538 18446744071579302229 0 0 17 5 0 0 0 0 0
/proc/23978/statm: 2287 270 229 213 0 72 0
[pid=23979] ppid=23978 vsize=272908 CPUtime=74.03 cores=1,3,5,7
/proc/23979/stat : 23979 (pb_cplex) R 23978 23978 22465 0 -1 4202496 91897 0 0 0 7384 19 0 0 20 0 8 0 391004758 279457792 35893 33554432000 134512640 146736320 4293772768 4293765592 136007083 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0 0 0
/proc/23979/statm: 68227 35893 884 2985 0 65161 0
[pid=23979/tid=23981] ppid=23978 vsize=272908 CPUtime=1.75 cores=1,3,5,7
/proc/23979/task/23981/stat : 23981 (pb_cplex) S 23978 23978 22465 0 -1 4202560 5371 0 0 0 174 1 0 0 20 0 8 0 391008932 279457792 35893 33554432000 134512640 146736320 4293772768 4128034448 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 3 0 0 0 0 0
[pid=23979/tid=23982] ppid=23978 vsize=272908 CPUtime=4.27 cores=1,3,5,7
/proc/23979/task/23982/stat : 23982 (pb_cplex) R 23978 23978 22465 0 -1 4202560 4550 0 0 0 426 1 0 0 20 0 8 0 391008932 279457792 35893 33554432000 134512640 146736320 4293772768 4117545216 136400577 0 2 4096 16387 0 0 0 -1 5 0 0 0 0 0
[pid=23979/tid=23983] ppid=23978 vsize=272908 CPUtime=3.2 cores=1,3,5,7
/proc/23979/task/23983/stat : 23983 (pb_cplex) S 23978 23978 22465 0 -1 4202560 4383 0 0 0 319 1 0 0 20 0 8 0 391008932 279457792 35893 33554432000 134512640 146736320 4293772768 4107062928 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 5 0 0 0 0 0
[pid=23979/tid=23984] ppid=23978 vsize=272908 CPUtime=4.32 cores=1,3,5,7
/proc/23979/task/23984/stat : 23984 (pb_cplex) S 23978 23978 22465 0 -1 4202560 4970 0 0 0 431 1 0 0 20 0 8 0 391008932 279457792 35893 33554432000 134512640 146736320 4293772768 4096577168 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 1 0 0 0 0 0
[pid=23979/tid=23985] ppid=23978 vsize=272908 CPUtime=4.16 cores=1,3,5,7
/proc/23979/task/23985/stat : 23985 (pb_cplex) S 23978 23978 22465 0 -1 4202560 4112 0 0 0 416 0 0 0 20 0 8 0 391008932 279457792 35893 33554432000 134512640 146736320 4293772768 4086091408 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 1 0 0 0 0 0
[pid=23979/tid=23986] ppid=23978 vsize=272908 CPUtime=5.37 cores=1,3,5,7
/proc/23979/task/23986/stat : 23986 (pb_cplex) S 23978 23978 22465 0 -1 4202560 6913 0 0 0 536 1 0 0 20 0 8 0 391008932 279457792 35893 33554432000 134512640 146736320 4293772768 4075605648 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 3 0 0 0 0 0
[pid=23979/tid=23987] ppid=23978 vsize=272908 CPUtime=3.22 cores=1,3,5,7
/proc/23979/task/23987/stat : 23987 (pb_cplex) S 23978 23978 22465 0 -1 4202560 3233 0 0 0 321 1 0 0 20 0 8 0 391008932 279457792 35893 33554432000 134512640 146736320 4293772768 4065119888 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 74.03
Current children cumulated vsize (KiB) 282056

############
# WARNING:
# current cumulated CPU time (256.13 s) is less than in the last sample (256.61 s)
# The time of a child was probably not reported to its father.
# (see the two samples below)
# Adding the difference (0.47998 s) to the 'lost time'.

[startup+102.1 s]
/proc/loadavg: 6.08 6.63 6.95 4/186 23987
/proc/meminfo: memFree=30075220/32873648 swapFree=7372/7372
[pid=23978] ppid=23976 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/23978/stat : 23978 (run) S 23976 23978 22465 0 -1 4202496 356 0 0 0 0 0 0 0 20 0 1 0 391004758 9367552 270 33554432000 4194304 5064252 140737312408160 140737312407072 259112199758 0 65536 4100 65538 18446744071579302229 0 0 17 5 0 0 0 0 0
/proc/23978/statm: 2287 270 229 213 0 72 0
[pid=23979] ppid=23978 vsize=274816 CPUtime=256.61 cores=1,3,5,7
/proc/23979/stat : 23979 (pb_cplex) R 23978 23978 22465 0 -1 4202496 138031 0 0 0 25621 40 0 0 20 0 8 0 391004758 281411584 37964 33554432000 134512640 146736320 4293772768 4293764532 135450933 0 0 4096 16387 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/23979/statm: 68704 37964 900 2985 0 65638 0
[pid=23979/tid=23981] ppid=23978 vsize=274816 CPUtime=22.92 cores=1,3,5,7
/proc/23979/task/23981/stat : 23981 (pb_cplex) S 23978 23978 22465 0 -1 4202560 9803 0 0 0 2288 4 0 0 20 0 8 0 391008932 281411584 37964 33554432000 134512640 146736320 4293772768 4128034448 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 5 0 0 0 0 0
[pid=23979/tid=23982] ppid=23978 vsize=274816 CPUtime=24.7 cores=1,3,5,7
/proc/23979/task/23982/stat : 23982 (pb_cplex) S 23978 23978 22465 0 -1 4202560 8811 0 0 0 2467 3 0 0 20 0 8 0 391008932 281411584 37964 33554432000 134512640 146736320 4293772768 4117548688 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 7 0 0 0 0 0
[pid=23979/tid=23983] ppid=23978 vsize=274816 CPUtime=24.95 cores=1,3,5,7
/proc/23979/task/23983/stat : 23983 (pb_cplex) S 23978 23978 22465 0 -1 4202560 8112 0 0 0 2492 3 0 0 20 0 8 0 391008932 281411584 37964 33554432000 134512640 146736320 4293772768 4107062928 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 7 0 0 0 0 0
[pid=23979/tid=23984] ppid=23978 vsize=274816 CPUtime=28.78 cores=1,3,5,7
/proc/23979/task/23984/stat : 23984 (pb_cplex) R 23978 23978 22465 0 -1 4202560 13144 0 0 0 2874 4 0 0 20 0 8 0 391008932 281411584 37964 33554432000 134512640 146736320 4293772768 4096571856 135460025 0 2 4096 16387 0 0 0 -1 1 0 0 0 0 0
[pid=23979/tid=23985] ppid=23978 vsize=274816 CPUtime=25.01 cores=1,3,5,7
/proc/23979/task/23985/stat : 23985 (pb_cplex) S 23978 23978 22465 0 -1 4202560 7543 0 0 0 2499 2 0 0 20 0 8 0 391008932 281411584 37964 33554432000 134512640 146736320 4293772768 4086091408 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 3 0 0 0 0 0
[pid=23979/tid=23986] ppid=23978 vsize=274816 CPUtime=26.55 cores=1,3,5,7
/proc/23979/task/23986/stat : 23986 (pb_cplex) S 23978 23978 22465 0 -1 4202560 14899 0 0 0 2652 3 0 0 20 0 8 0 391008932 281411584 37964 33554432000 134512640 146736320 4293772768 4075605648 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 5 0 0 0 0 0
[pid=23979/tid=23987] ppid=23978 vsize=274816 CPUtime=29.42 cores=1,3,5,7
/proc/23979/task/23987/stat : 23987 (pb_cplex) S 23978 23978 22465 0 -1 4202560 7138 0 0 0 2939 3 0 0 20 0 8 0 391008932 281411584 37964 33554432000 134512640 146736320 4293772768 4065119888 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 256.61
Current children cumulated vsize (KiB) 283964

[startup+102.201 s]
/proc/loadavg: 6.08 6.63 6.95 4/186 23987
/proc/meminfo: memFree=30075220/32873648 swapFree=7372/7372
[pid=23978] ppid=23976 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/23978/stat : 23978 (run) S 23976 23978 22465 0 -1 4202496 356 0 0 0 0 0 0 0 20 0 1 0 391004758 9367552 270 33554432000 4194304 5064252 140737312408160 140737312407072 259112199758 0 65536 4100 65538 18446744071579302229 0 0 17 5 0 0 0 0 0
/proc/23978/statm: 2287 270 229 213 0 72 0
[pid=23979] ppid=23978 vsize=192540 CPUtime=256.13 cores=1,3,5,7
/proc/23979/stat : 23979 (pb_cplex) R 23978 23978 22465 0 -1 4202496 138100 0 0 0 25571 42 0 0 20 0 1 0 391004758 197160960 28108 33554432000 134512640 146736320 4293772768 4293769560 144757825 0 0 4096 16387 0 0 0 17 3 0 0 0 0 0
/proc/23979/statm: 48135 28108 901 2985 0 45069 0
Current children cumulated CPU time (s) 256.13
Current children cumulated vsize (KiB) 201688
#
############


[startup+102.301 s]
/proc/loadavg: 6.08 6.63 6.95 4/186 23987

################
# More data... #
################

[pid=23979/tid=24018] ppid=23978 vsize=289904 CPUtime=0 cores=1,3,5,7
/proc/23979/task/24018/stat : 24018 (pb_cplex) S 23978 23978 22465 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 8 0 391078061 296861696 46680 33554432000 134512640 146736320 4293772768 4002410128 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 1 0 0 0 0 0
[pid=23979/tid=24019] ppid=23978 vsize=289904 CPUtime=0 cores=1,3,5,7
/proc/23979/task/24019/stat : 24019 (pb_cplex) S 23978 23978 22465 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 8 0 391078061 296861696 46680 33554432000 134512640 146736320 4293772768 3991924368 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 3 0 0 0 0 0
[pid=23979/tid=24020] ppid=23978 vsize=289904 CPUtime=0 cores=1,3,5,7
/proc/23979/task/24020/stat : 24020 (pb_cplex) S 23978 23978 22465 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 8 0 391078061 296861696 46680 33554432000 134512640 146736320 4293772768 3981438608 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1038.78
Current children cumulated vsize (KiB) 299052

[startup+942.301 s]
/proc/loadavg: 3.20 5.21 5.71 2/187 24072
/proc/meminfo: memFree=22654168/32873648 swapFree=7372/7372
[pid=23978] ppid=23976 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/23978/stat : 23978 (run) S 23976 23978 22465 0 -1 4202496 356 0 0 0 0 0 0 0 20 0 1 0 391004758 9367552 270 33554432000 4194304 5064252 140737312408160 140737312407072 259112199758 0 65536 4100 65538 18446744071579302229 0 0 17 5 0 0 0 0 0
/proc/23978/statm: 2287 270 229 213 0 72 0
[pid=23979] ppid=23978 vsize=290928 CPUtime=1098.77 cores=1,3,5,7
/proc/23979/stat : 23979 (pb_cplex) R 23978 23978 22465 0 -1 4202496 316011 0 0 0 109787 90 0 0 20 0 8 0 391004758 297910272 46934 33554432000 134512640 146736320 4293772768 4293764992 139046505 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/23979/statm: 72732 46934 913 2985 0 69666 0
[pid=23979/tid=24014] ppid=23978 vsize=290928 CPUtime=0 cores=1,3,5,7
/proc/23979/task/24014/stat : 24014 (pb_cplex) S 23978 23978 22465 0 -1 4202560 0 0 0 0 0 0 0 0 20 0 8 0 391078061 297910272 46934 33554432000 134512640 146736320 4293772768 4127919760 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 5 0 0 0 0 0
[pid=23979/tid=24015] ppid=23978 vsize=290928 CPUtime=0 cores=1,3,5,7
/proc/23979/task/24015/stat : 24015 (pb_cplex) S 23978 23978 22465 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 8 0 391078061 297910272 46934 33554432000 134512640 146736320 4293772768 4138405520 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 7 0 0 0 0 0
[pid=23979/tid=24016] ppid=23978 vsize=290928 CPUtime=0 cores=1,3,5,7
/proc/23979/task/24016/stat : 24016 (pb_cplex) S 23978 23978 22465 0 -1 4202560 0 0 0 0 0 0 0 0 20 0 8 0 391078061 297910272 46934 33554432000 134512640 146736320 4293772768 4148891280 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 1 0 0 0 0 0
[pid=23979/tid=24017] ppid=23978 vsize=290928 CPUtime=0 cores=1,3,5,7
/proc/23979/task/24017/stat : 24017 (pb_cplex) S 23978 23978 22465 0 -1 4202560 0 0 0 0 0 0 0 0 20 0 8 0 391078061 297910272 46934 33554432000 134512640 146736320 4293772768 4096577168 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 5 0 0 0 0 0
[pid=23979/tid=24018] ppid=23978 vsize=290928 CPUtime=0 cores=1,3,5,7
/proc/23979/task/24018/stat : 24018 (pb_cplex) S 23978 23978 22465 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 8 0 391078061 297910272 46934 33554432000 134512640 146736320 4293772768 4002410128 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 1 0 0 0 0 0
[pid=23979/tid=24019] ppid=23978 vsize=290928 CPUtime=0 cores=1,3,5,7
/proc/23979/task/24019/stat : 24019 (pb_cplex) S 23978 23978 22465 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 8 0 391078061 297910272 46934 33554432000 134512640 146736320 4293772768 3991924368 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 3 0 0 0 0 0
[pid=23979/tid=24020] ppid=23978 vsize=290928 CPUtime=0 cores=1,3,5,7
/proc/23979/task/24020/stat : 24020 (pb_cplex) S 23978 23978 22465 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 8 0 391078061 297910272 46934 33554432000 134512640 146736320 4293772768 3981438608 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1098.77
Current children cumulated vsize (KiB) 300076

[startup+1002.31 s]
/proc/loadavg: 7.95 6.18 6.00 8/187 24072
/proc/meminfo: memFree=22645036/32873648 swapFree=7372/7372
[pid=23978] ppid=23976 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/23978/stat : 23978 (run) S 23976 23978 22465 0 -1 4202496 356 0 0 0 0 0 0 0 20 0 1 0 391004758 9367552 270 33554432000 4194304 5064252 140737312408160 140737312407072 259112199758 0 65536 4100 65538 18446744071579302229 0 0 17 5 0 0 0 0 0
/proc/23978/statm: 2287 270 229 213 0 72 0
[pid=23979] ppid=23978 vsize=389720 CPUtime=1312.77 cores=1,3,5,7
/proc/23979/stat : 23979 (pb_cplex) R 23978 23978 22465 0 -1 4202496 388351 0 0 0 131150 127 0 0 20 0 8 0 391004758 399073280 70453 33554432000 134512640 146736320 4293772768 4293765388 139028318 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/23979/statm: 97430 70453 913 2985 0 94364 0
[pid=23979/tid=24014] ppid=23978 vsize=389720 CPUtime=28.02 cores=1,3,5,7
/proc/23979/task/24014/stat : 24014 (pb_cplex) R 23978 23978 22465 0 -1 4202560 4628 0 0 0 2797 5 0 0 20 0 8 0 391078061 399073280 70453 33554432000 134512640 146736320 4293772768 4127916240 136008172 0 2 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=23979/tid=24015] ppid=23978 vsize=389720 CPUtime=7.36 cores=1,3,5,7
/proc/23979/task/24015/stat : 24015 (pb_cplex) S 23978 23978 22465 0 -1 4202560 18151 0 0 0 732 4 0 0 20 0 8 0 391078061 399073280 70453 33554432000 134512640 146736320 4293772768 4138405520 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 1 0 0 0 0 0
[pid=23979/tid=24016] ppid=23978 vsize=389720 CPUtime=28.09 cores=1,3,5,7
/proc/23979/task/24016/stat : 24016 (pb_cplex) R 23978 23978 22465 0 -1 4202560 6794 0 0 0 2806 3 0 0 20 0 8 0 391078061 399073280 70453 33554432000 134512640 146736320 4293772768 4148887552 136018936 0 2 4096 16387 0 0 0 -1 5 0 0 0 0 0
[pid=23979/tid=24017] ppid=23978 vsize=389720 CPUtime=27.58 cores=1,3,5,7
/proc/23979/task/24017/stat : 24017 (pb_cplex) R 23978 23978 22465 0 -1 4202560 3844 0 0 0 2754 4 0 0 20 0 8 0 391078061 399073280 70453 33554432000 134512640 146736320 4293772768 4096573896 136000758 0 2 4096 16387 0 0 0 -1 1 0 0 0 0 0
[pid=23979/tid=24018] ppid=23978 vsize=389720 CPUtime=28.75 cores=1,3,5,7
/proc/23979/task/24018/stat : 24018 (pb_cplex) R 23978 23978 22465 0 -1 4202560 10878 0 0 0 2870 5 0 0 20 0 8 0 391078061 399073280 70453 33554432000 134512640 146736320 4293772768 4002406856 136001712 0 2 4096 16387 0 0 0 -1 1 0 0 0 0 0
[pid=23979/tid=24019] ppid=23978 vsize=389720 CPUtime=27.87 cores=1,3,5,7
/proc/23979/task/24019/stat : 24019 (pb_cplex) R 23978 23978 22465 0 -1 4202560 3522 0 0 0 2783 4 0 0 20 0 8 0 391078061 399073280 70453 33554432000 134512640 146736320 4293772768 3991920848 136008047 0 2 4096 16387 0 0 0 -1 7 0 0 0 0 0
[pid=23979/tid=24020] ppid=23978 vsize=389720 CPUtime=28.11 cores=1,3,5,7
/proc/23979/task/24020/stat : 24020 (pb_cplex) R 23978 23978 22465 0 -1 4202560 7984 0 0 0 2807 4 0 0 20 0 8 0 391078061 399073280 70453 33554432000 134512640 146736320 4293772768 3981435336 136001705 0 2 4096 16387 0 0 0 -1 7 0 0 0 0 0
Current children cumulated CPU time (s) 1312.77
Current children cumulated vsize (KiB) 398868

[startup+1062.3 s]
/proc/loadavg: 8.25 6.63 6.17 9/187 24125
/proc/meminfo: memFree=29726416/32873648 swapFree=7372/7372
[pid=23978] ppid=23976 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/23978/stat : 23978 (run) S 23976 23978 22465 0 -1 4202496 356 0 0 0 0 0 0 0 20 0 1 0 391004758 9367552 270 33554432000 4194304 5064252 140737312408160 140737312407072 259112199758 0 65536 4100 65538 18446744071579302229 0 0 17 5 0 0 0 0 0
/proc/23978/statm: 2287 270 229 213 0 72 0
[pid=23979] ppid=23978 vsize=398500 CPUtime=1552.33 cores=1,3,5,7
/proc/23979/stat : 23979 (pb_cplex) R 23978 23978 22465 0 -1 4202496 423304 0 0 0 155089 144 0 0 20 0 8 0 391004758 408064000 72751 33554432000 134512640 146736320 4293772768 4293765348 136016728 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0 0 0
/proc/23979/statm: 99625 72751 913 2985 0 96559 0
[pid=23979/tid=24014] ppid=23978 vsize=398500 CPUtime=61.95 cores=1,3,5,7
/proc/23979/task/24014/stat : 24014 (pb_cplex) R 23978 23978 22465 0 -1 4202560 5463 0 0 0 6188 7 0 0 20 0 8 0 391078061 408064000 72751 33554432000 134512640 146736320 4293772768 4127916240 136008065 0 2 4096 16387 0 0 0 -1 1 0 0 0 0 0
[pid=23979/tid=24015] ppid=23978 vsize=398500 CPUtime=7.36 cores=1,3,5,7
/proc/23979/task/24015/stat : 24015 (pb_cplex) S 23978 23978 22465 0 -1 4202560 18151 0 0 0 732 4 0 0 20 0 8 0 391078061 408064000 72751 33554432000 134512640 146736320 4293772768 4138405520 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 1 0 0 0 0 0
[pid=23979/tid=24016] ppid=23978 vsize=398500 CPUtime=62.14 cores=1,3,5,7
/proc/23979/task/24016/stat : 24016 (pb_cplex) R 23978 23978 22465 0 -1 4202560 8443 0 0 0 6210 4 0 0 20 0 8 0 391078061 408064000 72751 33554432000 134512640 146736320 4293772768 4148887600 136384852 0 2 4096 16387 0 0 0 -1 7 0 0 0 0 0
[pid=23979/tid=24017] ppid=23978 vsize=398500 CPUtime=61.36 cores=1,3,5,7
/proc/23979/task/24017/stat : 24017 (pb_cplex) R 23978 23978 22465 0 -1 4202560 5885 0 0 0 6131 5 0 0 20 0 8 0 391078061 408064000 72751 33554432000 134512640 146736320 4293772768 4096573648 136008047 0 2 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=23979/tid=24018] ppid=23978 vsize=398500 CPUtime=62.68 cores=1,3,5,7
/proc/23979/task/24018/stat : 24018 (pb_cplex) R 23978 23978 22465 0 -1 4202560 20503 0 0 0 6259 9 0 0 20 0 8 0 391078061 408064000 72751 33554432000 134512640 146736320 4293772768 4002406816 136388292 0 2 4096 16387 0 0 0 -1 5 0 0 0 0 0
[pid=23979/tid=24019] ppid=23978 vsize=398500 CPUtime=62.13 cores=1,3,5,7
/proc/23979/task/24019/stat : 24019 (pb_cplex) R 23978 23978 22465 0 -1 4202560 4461 0 0 0 6208 5 0 0 20 0 8 0 391078061 408064000 72751 33554432000 134512640 146736320 4293772768 3991920848 136008042 0 2 4096 16387 0 0 0 -1 5 0 0 0 0 0
[pid=23979/tid=24020] ppid=23978 vsize=398500 CPUtime=61.94 cores=1,3,5,7
/proc/23979/task/24020/stat : 24020 (pb_cplex) R 23978 23978 22465 0 -1 4202560 17233 0 0 0 6186 8 0 0 20 0 8 0 391078061 408064000 72751 33554432000 134512640 146736320 4293772768 3981435088 136008050 0 2 4096 16387 0 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 1552.33
Current children cumulated vsize (KiB) 407648

[startup+1122.3 s]
/proc/loadavg: 8.09 6.88 6.28 9/186 24125
/proc/meminfo: memFree=29720116/32873648 swapFree=7372/7372
[pid=23978] ppid=23976 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/23978/stat : 23978 (run) S 23976 23978 22465 0 -1 4202496 356 0 0 0 0 0 0 0 20 0 1 0 391004758 9367552 270 33554432000 4194304 5064252 140737312408160 140737312407072 259112199758 0 65536 4100 65538 18446744071579302229 0 0 17 5 0 0 0 0 0
/proc/23978/statm: 2287 270 229 213 0 72 0
[pid=23979] ppid=23978 vsize=398276 CPUtime=1791.9 cores=1,3,5,7
/proc/23979/stat : 23979 (pb_cplex) R 23978 23978 22465 0 -1 4202496 461009 0 0 0 179032 158 0 0 20 0 8 0 391004758 407834624 72730 33554432000 134512640 146736320 4293772768 4293765896 136000967 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0 0 0
/proc/23979/statm: 99569 72730 913 2985 0 96503 0
[pid=23979/tid=24014] ppid=23978 vsize=398276 CPUtime=96.01 cores=1,3,5,7
/proc/23979/task/24014/stat : 24014 (pb_cplex) R 23978 23978 22465 0 -1 4202560 7679 0 0 0 9593 8 0 0 20 0 8 0 391078061 407834624 72730 33554432000 134512640 146736320 4293772768 4127916624 136403117 0 2 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=23979/tid=24015] ppid=23978 vsize=398276 CPUtime=7.36 cores=1,3,5,7
/proc/23979/task/24015/stat : 24015 (pb_cplex) S 23978 23978 22465 0 -1 4202560 18151 0 0 0 732 4 0 0 20 0 8 0 391078061 407834624 72730 33554432000 134512640 146736320 4293772768 4138405520 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 1 0 0 0 0 0
[pid=23979/tid=24016] ppid=23978 vsize=398276 CPUtime=96.61 cores=1,3,5,7
/proc/23979/task/24016/stat : 24016 (pb_cplex) R 23978 23978 22465 0 -1 4202560 9111 0 0 0 9655 6 0 0 20 0 8 0 391078061 407834624 72730 33554432000 134512640 146736320 4293772768 4148887552 136018931 0 2 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=23979/tid=24017] ppid=23978 vsize=398276 CPUtime=94.86 cores=1,3,5,7
/proc/23979/task/24017/stat : 24017 (pb_cplex) R 23978 23978 22465 0 -1 4202560 7197 0 0 0 9480 6 0 0 20 0 8 0 391078061 407834624 72730 33554432000 134512640 146736320 4293772768 4096574080 139046485 0 2 4096 16387 0 0 0 -1 7 0 0 0 0 0
[pid=23979/tid=24018] ppid=23978 vsize=398276 CPUtime=96.13 cores=1,3,5,7
/proc/23979/task/24018/stat : 24018 (pb_cplex) R 23978 23978 22465 0 -1 4202560 31861 0 0 0 9600 13 0 0 20 0 8 0 391078061 407834624 72730 33554432000 134512640 146736320 4293772768 4002405568 135468704 0 2 4096 16387 0 0 0 -1 5 0 0 0 0 0
[pid=23979/tid=24019] ppid=23978 vsize=398276 CPUtime=96.49 cores=1,3,5,7
/proc/23979/task/24019/stat : 24019 (pb_cplex) R 23978 23978 22465 0 -1 4202560 6651 0 0 0 9642 7 0 0 20 0 8 0 391078061 407834624 72730 33554432000 134512640 146736320 4293772768 3991919808 135468700 0 2 4096 16387 0 0 0 -1 7 0 0 0 0 0
[pid=23979/tid=24020] ppid=23978 vsize=398276 CPUtime=96.77 cores=1,3,5,7
/proc/23979/task/24020/stat : 24020 (pb_cplex) R 23978 23978 22465 0 -1 4202560 26170 0 0 0 9664 13 0 0 20 0 8 0 391078061 407834624 72730 33554432000 134512640 146736320 4293772768 3981434972 135855179 0 2 4096 16387 0 0 0 -1 1 0 0 0 0 0
Current children cumulated CPU time (s) 1791.9
Current children cumulated vsize (KiB) 407424



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1124.2 s]
/proc/loadavg: 8.09 6.88 6.28 9/186 24125
/proc/meminfo: memFree=29720116/32873648 swapFree=7372/7372
[pid=23978] ppid=23976 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/23978/stat : 23978 (run) S 23976 23978 22465 0 -1 4202496 356 0 0 0 0 0 0 0 20 0 1 0 391004758 9367552 270 33554432000 4194304 5064252 140737312408160 140737312407072 259112199758 0 65536 4100 65538 18446744071579302229 0 0 17 5 0 0 0 0 0
/proc/23978/statm: 2287 270 229 213 0 72 0
[pid=23979] ppid=23978 vsize=398276 CPUtime=1799.56 cores=1,3,5,7
/proc/23979/stat : 23979 (pb_cplex) R 23978 23978 22465 0 -1 4202496 462087 0 0 0 179797 159 0 0 20 0 8 0 391004758 407834624 72730 33554432000 134512640 146736320 4293772768 4293764604 135453295 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0 0 0
/proc/23979/statm: 99569 72730 913 2985 0 96503 0
[pid=23979/tid=24014] ppid=23978 vsize=398276 CPUtime=97.1 cores=1,3,5,7
/proc/23979/task/24014/stat : 24014 (pb_cplex) R 23978 23978 22465 0 -1 4202560 7679 0 0 0 9702 8 0 0 20 0 8 0 391078061 407834624 72730 33554432000 134512640 146736320 4293772768 4127915848 135525292 0 2 4096 16387 0 0 0 -1 1 0 0 0 0 0
[pid=23979/tid=24015] ppid=23978 vsize=398276 CPUtime=7.36 cores=1,3,5,7
/proc/23979/task/24015/stat : 24015 (pb_cplex) S 23978 23978 22465 0 -1 4202560 18151 0 0 0 732 4 0 0 20 0 8 0 391078061 407834624 72730 33554432000 134512640 146736320 4293772768 4138405520 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 1 0 0 0 0 0
[pid=23979/tid=24016] ppid=23978 vsize=398276 CPUtime=97.69 cores=1,3,5,7
/proc/23979/task/24016/stat : 24016 (pb_cplex) R 23978 23978 22465 0 -1 4202560 9228 0 0 0 9763 6 0 0 20 0 8 0 391078061 407834624 72730 33554432000 134512640 146736320 4293772768 4148887368 135525963 0 2 4096 16387 0 0 0 -1 5 0 0 0 0 0
[pid=23979/tid=24017] ppid=23978 vsize=398276 CPUtime=95.81 cores=1,3,5,7
/proc/23979/task/24017/stat : 24017 (pb_cplex) R 23978 23978 22465 0 -1 4202560 7456 0 0 0 9575 6 0 0 20 0 8 0 391078061 407834624 72730 33554432000 134512640 146736320 4293772768 4096573896 136000738 0 2 4096 16387 0 0 0 -1 5 0 0 0 0 0
[pid=23979/tid=24018] ppid=23978 vsize=398276 CPUtime=97.21 cores=1,3,5,7
/proc/23979/task/24018/stat : 24018 (pb_cplex) R 23978 23978 22465 0 -1 4202560 32100 0 0 0 9708 13 0 0 20 0 8 0 391078061 407834624 72730 33554432000 134512640 146736320 4293772768 4002406216 135525920 0 2 4096 16387 0 0 0 -1 7 0 0 0 0 0
[pid=23979/tid=24019] ppid=23978 vsize=398276 CPUtime=97.63 cores=1,3,5,7
/proc/23979/task/24019/stat : 24019 (pb_cplex) R 23978 23978 22465 0 -1 4202560 6651 0 0 0 9756 7 0 0 20 0 8 0 391078061 407834624 72730 33554432000 134512640 146736320 4293772768 3991921264 136385265 0 2 4096 16387 0 0 0 -1 5 0 0 0 0 0
[pid=23979/tid=24020] ppid=23978 vsize=398276 CPUtime=98.11 cores=1,3,5,7
/proc/23979/task/24020/stat : 24020 (pb_cplex) R 23978 23978 22465 0 -1 4202560 26383 0 0 0 9798 13 0 0 20 0 8 0 391078061 407834624 72730 33554432000 134512640 146736320 4293772768 3981435088 136008050 0 2 4096 16387 0 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 1799.56
Current children cumulated vsize (KiB) 407424

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 23978 and gives
#  childrusage.ru_utime.tv_sec=0
#  childrusage.ru_utime.tv_usec=0
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=0
# CPU time returned by wait4() is 0
# while last known CPU time is 1799.56
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...


# WARNING:
# The CPU time of some children was not reported to their father
# (probably because of a missing or aborted wait()).
# This 'lost CPU time' is added to the watched process CPU time.
#  lost CPU time (s): 0.47998
#  lost CPU user time (s): 0.499985
#  lost CPU system time (s): -0.02

Real time (s): 1124.23
CPU time (s): 1800.04
CPU user time (s): 1798.47
CPU system time (s): 1.57
CPU usage (%): 160.113
Max. virtual memory (cumulated for all children) (KiB): 411844

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 0
system time used= 0
maximum resident set size= 1080
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 356
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 2
involuntary context switches= 2

runsolver used 2.52062 second user time and 7.02593 second system time

The end

Launcher Data 

Begin job on node124 at 2012-06-09 15:33:09
IDJOB=3737768
IDBENCH=48313
IDSOLVER=2325
FILE ID=node124/3737768-1339248789
RUNJOBID= node124-1339246831-22482
PBS_JOBID= 14644357
Free space on /tmp= 70584 MiB

SOLVER NAME= PB10: pb_cplex 2010-06-29
BENCH NAME= PB07/normalized-PB07/SATUNSAT-SMALLINT-NLC/submittedPB07/manquinho/dbsg/normalized-dbsg_200_25_5_40.opb
COMMAND LINE= run BENCHNAME
CONVERSION SCRIPT= PBconversionToLinear BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3737768-1339248789/watcher-3737768-1339248789 -o /tmp/evaluation-result-3737768-1339248789/solver-3737768-1339248789 -C 1800 -W 1900 -M 15500  run HOME/instance-3737768-1339248789.opb

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= c1794605d16cd8196553c490f5507fd9
RANDOM SEED=524331035

node124.alineos.net Linux 2.6.32-71.29.1.el6.x86_64 #1 SMP Mon Jun 27 19:49:27 BST 2011

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.325
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5334.65
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.325
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5385.03
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.325
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5385.04
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.325
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5357.53
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.325
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5385.03
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.325
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5385.04
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.325
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5385.03
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.325
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5385.03
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32873648 kB
MemFree:        30226136 kB
Buffers:          453404 kB
Cached:          1260216 kB
SwapCached:         8612 kB
Active:          1690132 kB
Inactive:          83716 kB
Active(anon):      44744 kB
Inactive(anon):    11320 kB
Active(file):    1645388 kB
Inactive(file):    72396 kB
Unevictable:        7372 kB
Mlocked:            7372 kB
SwapTotal:      67108856 kB
SwapFree:       67092344 kB
Dirty:             16464 kB
Writeback:             0 kB
AnonPages:         52468 kB
Mapped:            12460 kB
Shmem:                 0 kB
Slab:             733632 kB
SReclaimable:     177272 kB
SUnreclaim:       556360 kB
KernelStack:        1488 kB
PageTables:         4244 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83545680 kB
Committed_AS:     174692 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      346400 kB
VmallocChunk:   34341988052 kB
HardwareCorrupted:     0 kB
AnonHugePages:     24576 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:        7680 kB
DirectMap2M:    33538048 kB

CONVERSION COMMAND LINE= PBconversionToLinear HOME/instance-3737768-1339248789.opb

Free space on /tmp at the end= 70560 MiB
End job on node124 at 2012-06-09 15:51:53