Trace number 3731719

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
PB10: pb_cplex 2010-06-29? (TO) 1800.29 515.416

General information on the benchmark

Namenormalized-PB06/OPT-SMALLINT/submitted-PB06/liu/
vtxcov/normalized-vtxcov_v2000_e4000_34.opb.PB06.opb
MD5SUMe19b588c94d7a5fd177e87fa7a6307a3
Bench CategoryOPT-SMALLINT (optimisation, small integers)
Best result obtained on this benchmarkSAT
Best value of the objective obtained on this benchmark1039
Best CPU time to get the best result obtained on this benchmark1796.74
Has Objective FunctionYES
SatisfiableYES
(Un)Satisfiability was provedYES
Best value of the objective function 1033
Optimality of the best value was proved NO
Number of variables1960
Total number of constraints4000
Number of constraints which are clauses4000
Number of constraints which are cardinality constraints (but not clauses)0
Number of constraints which are nor clauses,nor cardinality constraints0
Minimum length of a constraint2
Maximum length of a constraint2
Number of terms in the objective function 1960
Biggest coefficient in the objective function 1
Number of bits for the biggest coefficient in the objective function 1
Sum of the numbers in the objective function 1960
Number of bits of the sum of numbers in the objective function 11
Biggest number in a constraint 1
Number of bits of the biggest number in a constraint 1
Biggest sum of numbers in a constraint 1960
Number of bits of the biggest sum of numbers11
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Solver Data 

0.00/0.00	c pb_cplex 1.0 - 20100701
0.00/0.00	c Parsing opb file format. File HOME/instance-3731719-1339246970.opb.
0.00/0.00	c Instance file HOME/instance-3731719-1339246970.opb
0.00/0.00	c File size is 112132 bytes.
0.00/0.37	c Highest Coefficient sum: 3
0.00/0.37	c  IBM ILOG License Manager: "IBM ILOG Optimization Suite for Academic Initiative" is accessing CPLEX 12 with option(s): "e m b q ".
0.00/0.38	c ============================[ Problem Statistics ]=============================
0.00/0.38	c |                                                                             |
0.00/0.38	c |  Parsing time:          0.38         s                                      |
0.00/0.38	c |  Number Variables:      1960                                                |
0.00/0.38	c |  Number Constraints:    4000                                                |
0.00/0.38	c ===============================================================================
1800.29/515.41	c Remaining time 1799.62 sec.
1800.29/515.41	c 
1800.29/515.41	c *** INTERRUPTED ***
1800.29/515.41	s UNKNOWN
1800.29/515.41	c Total CPU time              : 1798.02 s
1800.29/515.41	c Memory used           : 200.69 MB
1800.29/515.41	c CPU time              : 1798.02 s
1800.29/515.41	c 
1800.29/515.41	c *** INTERRUPTED ***

Verifier Data 

ERROR: no interpretation found !

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.1 (svn: 989)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3731719-1339246970/watcher-3731719-1339246970 -o /tmp/evaluation-result-3731719-1339246970/solver-3731719-1339246970 -C 1800 -W 1900 -M 15500 run HOME/instance-3731719-1339246970.opb 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1900 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 7.55 2.78 1.01 10/185 20179
/proc/meminfo: memFree=31200704/32873648 swapFree=7376/7376
[pid=20179] ppid=20177 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/20179/stat : 20179 (run) S 20177 20179 20024 0 -1 4202496 355 0 0 0 0 0 0 0 20 0 1 0 390822969 9367552 270 33554432000 4194304 5064252 140736245658800 140736245657712 226084152910 0 65536 4100 65538 18446744071579302229 0 0 17 5 0 0 0 0 0
/proc/20179/statm: 2287 270 229 213 0 72 0

[startup+0.0091179 s]
/proc/loadavg: 7.55 2.78 1.01 10/185 20179
/proc/meminfo: memFree=31200704/32873648 swapFree=7376/7376
[pid=20179] ppid=20177 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/20179/stat : 20179 (run) S 20177 20179 20024 0 -1 4202496 355 0 0 0 0 0 0 0 20 0 1 0 390822969 9367552 270 33554432000 4194304 5064252 140736245658800 140736245657712 226084152910 0 65536 4100 65538 18446744071579302229 0 0 17 5 0 0 0 0 0
/proc/20179/statm: 2287 270 229 213 0 72 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 9148

[startup+0.100197 s]
/proc/loadavg: 7.55 2.78 1.01 10/185 20179
/proc/meminfo: memFree=31200704/32873648 swapFree=7376/7376
[pid=20179] ppid=20177 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/20179/stat : 20179 (run) S 20177 20179 20024 0 -1 4202496 355 0 0 0 0 0 0 0 20 0 1 0 390822969 9367552 270 33554432000 4194304 5064252 140736245658800 140736245657712 226084152910 0 65536 4100 65538 18446744071579302229 0 0 17 5 0 0 0 0 0
/proc/20179/statm: 2287 270 229 213 0 72 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 9148

[startup+0.300181 s]
/proc/loadavg: 7.55 2.78 1.01 10/185 20179
/proc/meminfo: memFree=31200704/32873648 swapFree=7376/7376
[pid=20179] ppid=20177 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/20179/stat : 20179 (run) S 20177 20179 20024 0 -1 4202496 355 0 0 0 0 0 0 0 20 0 1 0 390822969 9367552 270 33554432000 4194304 5064252 140736245658800 140736245657712 226084152910 0 65536 4100 65538 18446744071579302229 0 0 17 5 0 0 0 0 0
/proc/20179/statm: 2287 270 229 213 0 72 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 9148

[startup+0.700129 s]
/proc/loadavg: 7.55 2.78 1.01 10/185 20179
/proc/meminfo: memFree=31200704/32873648 swapFree=7376/7376
[pid=20179] ppid=20177 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/20179/stat : 20179 (run) S 20177 20179 20024 0 -1 4202496 355 0 0 0 0 0 0 0 20 0 1 0 390822969 9367552 270 33554432000 4194304 5064252 140736245658800 140736245657712 226084152910 0 65536 4100 65538 18446744071579302229 0 0 17 5 0 0 0 0 0
/proc/20179/statm: 2287 270 229 213 0 72 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 9148

[startup+1.50021 s]
/proc/loadavg: 7.55 2.78 1.01 9/187 20181
/proc/meminfo: memFree=31192380/32873648 swapFree=7376/7376
[pid=20179] ppid=20177 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/20179/stat : 20179 (run) S 20177 20179 20024 0 -1 4202496 355 0 0 0 0 0 0 0 20 0 1 0 390822969 9367552 270 33554432000 4194304 5064252 140736245658800 140736245657712 226084152910 0 65536 4100 65538 18446744071579302229 0 0 17 5 0 0 0 0 0
/proc/20179/statm: 2287 270 229 213 0 72 0
[pid=20180] ppid=20179 vsize=22776 CPUtime=1.49 cores=1,3,5,7
/proc/20180/stat : 20180 (pb_cplex) R 20179 20179 20024 0 -1 4202496 5432 0 0 0 148 1 0 0 20 0 1 0 390822969 23322624 2940 33554432000 134512640 146736320 4294450000 4294444060 135855174 0 0 4096 16387 0 0 0 17 3 0 0 0 0 0
/proc/20180/statm: 5694 2940 913 2985 0 2628 0
Current children cumulated CPU time (s) 1.49
Current children cumulated vsize (KiB) 31924

[startup+3.10015 s]
/proc/loadavg: 7.58 2.87 1.05 10/187 20181
/proc/meminfo: memFree=31191496/32873648 swapFree=7376/7376
[pid=20179] ppid=20177 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/20179/stat : 20179 (run) S 20177 20179 20024 0 -1 4202496 355 0 0 0 0 0 0 0 20 0 1 0 390822969 9367552 270 33554432000 4194304 5064252 140736245658800 140736245657712 226084152910 0 65536 4100 65538 18446744071579302229 0 0 17 5 0 0 0 0 0
/proc/20179/statm: 2287 270 229 213 0 72 0
[pid=20180] ppid=20179 vsize=22716 CPUtime=3.09 cores=1,3,5,7
/proc/20180/stat : 20180 (pb_cplex) R 20179 20179 20024 0 -1 4202496 6298 0 0 0 308 1 0 0 20 0 1 0 390822969 23261184 3004 33554432000 134512640 146736320 4294450000 4294444560 136403109 0 0 4096 16387 0 0 0 17 3 0 0 0 0 0
/proc/20180/statm: 5679 3004 913 2985 0 2613 0
Current children cumulated CPU time (s) 3.09
Current children cumulated vsize (KiB) 31864

[startup+6.30014 s]
/proc/loadavg: 7.58 2.87 1.05 10/187 20181
/proc/meminfo: memFree=31189936/32873648 swapFree=7376/7376
[pid=20179] ppid=20177 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/20179/stat : 20179 (run) S 20177 20179 20024 0 -1 4202496 355 0 0 0 0 0 0 0 20 0 1 0 390822969 9367552 270 33554432000 4194304 5064252 140736245658800 140736245657712 226084152910 0 65536 4100 65538 18446744071579302229 0 0 17 5 0 0 0 0 0
/proc/20179/statm: 2287 270 229 213 0 72 0
[pid=20180] ppid=20179 vsize=23168 CPUtime=6.29 cores=1,3,5,7
/proc/20180/stat : 20180 (pb_cplex) R 20179 20179 20024 0 -1 4202496 8170 0 0 0 628 1 0 0 20 0 1 0 390822969 23724032 3093 33554432000 134512640 146736320 4294450000 4294444036 136385174 0 0 4096 16387 0 0 0 17 3 0 0 0 0 0
/proc/20180/statm: 5792 3093 914 2985 0 2726 0
Current children cumulated CPU time (s) 6.29
Current children cumulated vsize (KiB) 32316

[startup+12.7002 s]
/proc/loadavg: 7.56 3.02 1.12 10/187 20181
/proc/meminfo: memFree=31191100/32873648 swapFree=7376/7376
[pid=20179] ppid=20177 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/20179/stat : 20179 (run) S 20177 20179 20024 0 -1 4202496 355 0 0 0 0 0 0 0 20 0 1 0 390822969 9367552 270 33554432000 4194304 5064252 140736245658800 140736245657712 226084152910 0 65536 4100 65538 18446744071579302229 0 0 17 5 0 0 0 0 0
/proc/20179/statm: 2287 270 229 213 0 72 0
[pid=20180] ppid=20179 vsize=23180 CPUtime=12.69 cores=1,3,5,7
/proc/20180/stat : 20180 (pb_cplex) R 20179 20179 20024 0 -1 4202496 12831 0 0 0 1267 2 0 0 20 0 1 0 390822969 23736320 3115 33554432000 134512640 146736320 4294450000 4294444176 136403112 0 0 4096 16387 0 0 0 17 3 0 0 0 0 0
/proc/20180/statm: 5795 3115 914 2985 0 2729 0
Current children cumulated CPU time (s) 12.69
Current children cumulated vsize (KiB) 32328

[startup+25.5004 s]
/proc/loadavg: 7.50 3.15 1.18 16/194 20188
/proc/meminfo: memFree=31164664/32873648 swapFree=7376/7376
[pid=20179] ppid=20177 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/20179/stat : 20179 (run) S 20177 20179 20024 0 -1 4202496 355 0 0 0 0 0 0 0 20 0 1 0 390822969 9367552 270 33554432000 4194304 5064252 140736245658800 140736245657712 226084152910 0 65536 4100 65538 18446744071579302229 0 0 17 5 0 0 0 0 0
/proc/20179/statm: 2287 270 229 213 0 72 0
[pid=20180] ppid=20179 vsize=133720 CPUtime=49.46 cores=1,3,5,7
/proc/20180/stat : 20180 (pb_cplex) R 20179 20179 20024 0 -1 4202496 21087 0 0 0 4940 6 0 0 20 0 8 0 390822969 136929280 10069 33554432000 134512640 146736320 4294450000 4294441608 139042902 0 0 4096 16387 18446744073709551615 0 0 17 7 0 0 0 0 0
/proc/20180/statm: 33430 10069 945 2985 0 30364 0
[pid=20180/tid=20182] ppid=20179 vsize=133720 CPUtime=4.24 cores=1,3,5,7
/proc/20180/task/20182/stat : 20182 (pb_cplex) R 20179 20179 20024 0 -1 4202560 708 0 0 0 424 0 0 0 20 0 8 0 390824472 136929280 10069 33554432000 134512640 146736320 4294450000 4149538320 136403109 0 2 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=20180/tid=20183] ppid=20179 vsize=133720 CPUtime=4.23 cores=1,3,5,7
/proc/20180/task/20183/stat : 20183 (pb_cplex) R 20179 20179 20024 0 -1 4202560 676 0 0 0 423 0 0 0 20 0 8 0 390824472 136929280 10069 33554432000 134512640 146736320 4294450000 4139052176 136008454 0 2 4096 16387 0 0 0 -1 1 0 0 0 0 0
[pid=20180/tid=20184] ppid=20179 vsize=133720 CPUtime=4.08 cores=1,3,5,7
/proc/20180/task/20184/stat : 20184 (pb_cplex) R 20179 20179 20024 0 -1 4202560 573 0 0 0 408 0 0 0 20 0 8 0 390824472 136929280 10069 33554432000 134512640 146736320 4294450000 4128567888 136403109 0 2 4096 16387 0 0 0 -1 5 0 0 0 0 0
[pid=20180/tid=20185] ppid=20179 vsize=133720 CPUtime=4.36 cores=1,3,5,7
/proc/20180/task/20185/stat : 20185 (pb_cplex) R 20179 20179 20024 0 -1 4202560 767 0 0 0 436 0 0 0 20 0 8 0 390824472 136929280 10069 33554432000 134512640 146736320 4294450000 4118081744 136008167 0 2 4096 16387 0 0 0 -1 5 0 0 0 0 0
[pid=20180/tid=20186] ppid=20179 vsize=133720 CPUtime=4.04 cores=1,3,5,7
/proc/20180/task/20186/stat : 20186 (pb_cplex) R 20179 20179 20024 0 -1 4202560 804 0 0 0 404 0 0 0 20 0 8 0 390824472 136929280 10069 33554432000 134512640 146736320 4294450000 4107595984 136007975 0 2 4096 16387 0 0 0 -1 7 0 0 0 0 0
[pid=20180/tid=20187] ppid=20179 vsize=133720 CPUtime=4.04 cores=1,3,5,7
/proc/20180/task/20187/stat : 20187 (pb_cplex) R 20179 20179 20024 0 -1 4202560 787 0 0 0 404 0 0 0 20 0 8 0 390824472 136929280 10069 33554432000 134512640 146736320 4294450000 4097112128 136687441 0 2 4096 16387 0 0 0 -1 1 0 0 0 0 0
[pid=20180/tid=20188] ppid=20179 vsize=133720 CPUtime=3.82 cores=1,3,5,7
/proc/20180/task/20188/stat : 20188 (pb_cplex) R 20179 20179 20024 0 -1 4202560 721 0 0 0 382 0 0 0 20 0 8 0 390824472 136929280 10069 33554432000 134512640 146736320 4294450000 4086624464 136008450 0 2 4096 16387 0 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 49.46
Current children cumulated vsize (KiB) 142868

[startup+51.1004 s]
/proc/loadavg: 8.15 3.68 1.41 15/194 20195
/proc/meminfo: memFree=31124672/32873648 swapFree=7376/7376
[pid=20179] ppid=20177 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/20179/stat : 20179 (run) S 20177 20179 20024 0 -1 4202496 355 0 0 0 0 0 0 0 20 0 1 0 390822969 9367552 270 33554432000 4194304 5064252 140736245658800 140736245657712 226084152910 0 65536 4100 65538 18446744071579302229 0 0 17 5 0 0 0 0 0
/proc/20179/statm: 2287 270 229 213 0 72 0
[pid=20180] ppid=20179 vsize=169900 CPUtime=103.28 cores=1,3,5,7
/proc/20180/stat : 20180 (pb_cplex) R 20179 20179 20024 0 -1 4202496 33724 0 0 0 10308 20 0 0 20 0 8 0 390822969 173977600 20401 33554432000 134512640 146736320 4294450000 4294442692 136385179 0 0 4096 16387 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/20180/statm: 42475 20401 962 2985 0 39409 0
[pid=20180/tid=20189] ppid=20179 vsize=169900 CPUtime=0.71 cores=1,3,5,7
/proc/20180/task/20189/stat : 20189 (pb_cplex) R 20179 20179 20024 0 -1 4202560 796 0 0 0 71 0 0 0 20 0 8 0 390827667 173977600 20401 33554432000 134512640 146736320 4294450000 4086623376 136008234 0 2 4096 16387 0 0 0 -1 7 0 0 0 0 0
[pid=20180/tid=20190] ppid=20179 vsize=169900 CPUtime=0.77 cores=1,3,5,7
/proc/20180/task/20190/stat : 20190 (pb_cplex) R 20179 20179 20024 0 -1 4202560 731 0 0 0 77 0 0 0 20 0 8 0 390827667 173977600 20401 33554432000 134512640 146736320 4294450000 4097110072 136475859 0 2 4096 16387 0 0 0 -1 1 0 0 0 0 0
[pid=20180/tid=20191] ppid=20179 vsize=169900 CPUtime=0.7 cores=1,3,5,7
/proc/20180/task/20191/stat : 20191 (pb_cplex) R 20179 20179 20024 0 -1 4202560 754 0 0 0 70 0 0 0 20 0 8 0 390827667 173977600 20401 33554432000 134512640 146736320 4294450000 4107596232 136000415 0 2 4096 16387 0 0 0 -1 7 0 0 0 0 0
[pid=20180/tid=20192] ppid=20179 vsize=169900 CPUtime=0.77 cores=1,3,5,7
/proc/20180/task/20192/stat : 20192 (pb_cplex) R 20179 20179 20024 0 -1 4202560 678 0 0 0 77 0 0 0 20 0 8 0 390827667 173977600 20401 33554432000 134512640 146736320 4294450000 4118081576 139044499 0 2 4096 16387 0 0 0 -1 5 0 0 0 0 0
[pid=20180/tid=20193] ppid=20179 vsize=169900 CPUtime=0.75 cores=1,3,5,7
/proc/20180/task/20193/stat : 20193 (pb_cplex) R 20179 20179 20024 0 -1 4202560 707 0 0 0 75 0 0 0 20 0 8 0 390827667 173977600 20401 33554432000 134512640 146736320 4294450000 4070563208 136000311 0 2 4096 16387 0 0 0 -1 1 0 0 0 0 0
[pid=20180/tid=20194] ppid=20179 vsize=169900 CPUtime=0.74 cores=1,3,5,7
/proc/20180/task/20194/stat : 20194 (pb_cplex) R 20179 20179 20024 0 -1 4202560 700 0 0 0 74 0 0 0 20 0 8 0 390827667 173977600 20401 33554432000 134512640 146736320 4294450000 4060077048 136475800 0 2 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=20180/tid=20195] ppid=20179 vsize=169900 CPUtime=0.77 cores=1,3,5,7
/proc/20180/task/20195/stat : 20195 (pb_cplex) R 20179 20179 20024 0 -1 4202560 511 0 0 0 77 0 0 0 20 0 8 0 390827667 173977600 20401 33554432000 134512640 146736320 4294450000 4049592528 136008248 0 2 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 103.28
Current children cumulated vsize (KiB) 179048

[startup+102.307 s]
/proc/loadavg: 10.56 5.15 2.04 16/193 20195
/proc/meminfo: memFree=31120036/32873648 swapFree=7376/7376
[pid=20179] ppid=20177 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/20179/stat : 20179 (run) S 20177 20179 20024 0 -1 4202496 355 0 0 0 0 0 0 0 20 0 1 0 390822969 9367552 270 33554432000 4194304 5064252 140736245658800 140736245657712 226084152910 0 65536 4100 65538 18446744071579302229 0 0 17 5 0 0 0 0 0
/proc/20179/statm: 2287 270 229 213 0 72 0
[pid=20180] ppid=20179 vsize=171492 CPUtime=287.31 cores=1,3,5,7
/proc/20180/stat : 20180 (pb_cplex) R 20179 20179 20024 0 -1 4202496 41561 0 0 0 28696 35 0 0 20 0 8 0 390822969 175607808 20965 33554432000 134512640 146736320 4294450000 4294442696 139042981 0 0 4096 16387 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/20180/statm: 42873 20965 966 2985 0 39807 0
[pid=20180/tid=20189] ppid=20179 vsize=171492 CPUtime=25.78 cores=1,3,5,7
/proc/20180/task/20189/stat : 20189 (pb_cplex) R 20179 20179 20024 0 -1 4202560 3080 0 0 0 2576 2 0 0 20 0 8 0 390827667 175607808 20965 33554432000 134512640 146736320 4294450000 4086625256 144757825 0 2 4096 16387 0 0 0 -1 5 0 0 0 0 0
[pid=20180/tid=20190] ppid=20179 vsize=171492 CPUtime=23.43 cores=1,3,5,7
/proc/20180/task/20190/stat : 20190 (pb_cplex) R 20179 20179 20024 0 -1 4202560 1174 0 0 0 2341 2 0 0 20 0 8 0 390827667 175607808 20965 33554432000 134512640 146736320 4294450000 4097110084 136385167 0 2 4096 16387 0 0 0 -1 7 0 0 0 0 0
[pid=20180/tid=20191] ppid=20179 vsize=171492 CPUtime=24.17 cores=1,3,5,7
/proc/20180/task/20191/stat : 20191 (pb_cplex) R 20179 20179 20024 0 -1 4202560 1618 0 0 0 2415 2 0 0 20 0 8 0 390827667 175607808 20965 33554432000 134512640 146736320 4294450000 4107596368 136403112 0 2 4096 16387 0 0 0 -1 7 0 0 0 0 0
[pid=20180/tid=20192] ppid=20179 vsize=171492 CPUtime=23.01 cores=1,3,5,7
/proc/20180/task/20192/stat : 20192 (pb_cplex) R 20179 20179 20024 0 -1 4202560 1797 0 0 0 2299 2 0 0 20 0 8 0 390827667 175607808 20965 33554432000 134512640 146736320 4294450000 4118081576 139044555 0 2 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=20180/tid=20193] ppid=20179 vsize=171492 CPUtime=23.66 cores=1,3,5,7
/proc/20180/task/20193/stat : 20193 (pb_cplex) R 20179 20179 20024 0 -1 4202560 1912 0 0 0 2364 2 0 0 20 0 8 0 390827667 175607808 20965 33554432000 134512640 146736320 4294450000 4070563208 136000494 0 2 4096 16387 0 0 0 -1 7 0 0 0 0 0
[pid=20180/tid=20194] ppid=20179 vsize=171492 CPUtime=24.15 cores=1,3,5,7
/proc/20180/task/20194/stat : 20194 (pb_cplex) R 20179 20179 20024 0 -1 4202560 1169 0 0 0 2414 1 0 0 20 0 8 0 390827667 175607808 20965 33554432000 134512640 146736320 4294450000 4060077200 136008248 0 2 4096 16387 0 0 0 -1 1 0 0 0 0 0
[pid=20180/tid=20195] ppid=20179 vsize=171492 CPUtime=23.25 cores=1,3,5,7
/proc/20180/task/20195/stat : 20195 (pb_cplex) R 20179 20179 20024 0 -1 4202560 623 0 0 0 2323 2 0 0 20 0 8 0 390827667 175607808 20965 33554432000 134512640 146736320 4294450000 4049592912 136403109 0 2 4096 16387 0 0 0 -1 1 0 0 0 0 0
Current children cumulated CPU time (s) 287.31
Current children cumulated vsize (KiB) 180640

[startup+162.3 s]
/proc/loadavg: 13.08 6.75 2.77 16/193 20196
/proc/meminfo: memFree=31114012/32873648 swapFree=7376/7376
[pid=20179] ppid=20177 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/20179/stat : 20179 (run) S 20177 20179 20024 0 -1 4202496 355 0 0 0 0 0 0 0 20 0 1 0 390822969 9367552 270 33554432000 4194304 5064252 140736245658800 140736245657712 226084152910 0 65536 4100 65538 18446744071579302229 0 0 17 5 0 0 0 0 0
/proc/20179/statm: 2287 270 229 213 0 72 0
[pid=20180] ppid=20179 vsize=174092 CPUtime=499.54 cores=1,3,5,7
/proc/20180/stat : 20180 (pb_cplex) R 20179 20179 20024 0 -1 4202496 57741 0 0 0 49894 60 0 0 20 0 8 0 390822969 178270208 22266 33554432000 134512640 146736320 4294450000 4294442840 136008615 0 0 4096 16387 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/20180/statm: 43523 22266 966 2985 0 40457 0
[pid=20180/tid=20189] ppid=20179 vsize=174092 CPUtime=54.01 cores=1,3,5,7

################
# More data... #
################

/proc/20180/statm: 43930 23365 966 2985 0 40864 0
[pid=20180/tid=20189] ppid=20179 vsize=175720 CPUtime=81.39 cores=1,3,5,7
/proc/20180/task/20189/stat : 20189 (pb_cplex) R 20179 20179 20024 0 -1 4202560 13977 0 0 0 8128 11 0 0 20 0 8 0 390827667 179937280 23365 33554432000 134512640 146736320 4294450000 4086624304 136384857 0 2 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=20180/tid=20190] ppid=20179 vsize=175720 CPUtime=78.3 cores=1,3,5,7
/proc/20180/task/20190/stat : 20190 (pb_cplex) R 20179 20179 20024 0 -1 4202560 3589 0 0 0 7821 9 0 0 20 0 8 0 390827667 179937280 23365 33554432000 134512640 146736320 4294450000 4097110608 136403109 0 2 4096 16387 0 0 0 -1 7 0 0 0 0 0
[pid=20180/tid=20191] ppid=20179 vsize=175720 CPUtime=75.93 cores=1,3,5,7
/proc/20180/task/20191/stat : 20191 (pb_cplex) R 20179 20179 20024 0 -1 4202560 7588 0 0 0 7582 11 0 0 20 0 8 0 390827667 179937280 23365 33554432000 134512640 146736320 4294450000 4107595984 136008438 0 2 4096 16387 0 0 0 -1 7 0 0 0 0 0
[pid=20180/tid=20192] ppid=20179 vsize=175720 CPUtime=74.9 cores=1,3,5,7
/proc/20180/task/20192/stat : 20192 (pb_cplex) R 20179 20179 20024 0 -1 4202560 5307 0 0 0 7482 8 0 0 20 0 8 0 390827667 179937280 23365 33554432000 134512640 146736320 4294450000 4118082128 136403103 0 2 4096 16387 0 0 0 -1 1 0 0 0 0 0
[pid=20180/tid=20193] ppid=20179 vsize=175720 CPUtime=76.92 cores=1,3,5,7
/proc/20180/task/20193/stat : 20193 (pb_cplex) R 20179 20179 20024 0 -1 4202560 8291 0 0 0 7682 10 0 0 20 0 8 0 390827667 179937280 23365 33554432000 134512640 146736320 4294450000 4070563656 135525911 0 2 4096 16387 0 0 0 -1 5 0 0 0 0 0
[pid=20180/tid=20194] ppid=20179 vsize=175720 CPUtime=78.21 cores=1,3,5,7
/proc/20180/task/20194/stat : 20194 (pb_cplex) R 20179 20179 20024 0 -1 4202560 14279 0 0 0 7808 13 0 0 20 0 8 0 390827667 179937280 23365 33554432000 134512640 146736320 4294450000 4060078272 135468690 0 2 4096 16387 0 0 0 -1 5 0 0 0 0 0
[pid=20180/tid=20195] ppid=20179 vsize=175720 CPUtime=77.45 cores=1,3,5,7
/proc/20180/task/20195/stat : 20195 (pb_cplex) R 20179 20179 20024 0 -1 4202560 835 0 0 0 7736 9 0 0 20 0 8 0 390827667 179937280 23365 33554432000 134512640 146736320 4294450000 4049592528 136008299 0 2 4096 16387 0 0 0 -1 7 0 0 0 0 0
Current children cumulated CPU time (s) 716.05
Current children cumulated vsize (KiB) 184868

[startup+282.3 s]
/proc/loadavg: 11.81 8.31 3.81 17/193 20280
/proc/meminfo: memFree=30952416/32873648 swapFree=7376/7376
[pid=20179] ppid=20177 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/20179/stat : 20179 (run) S 20177 20179 20024 0 -1 4202496 355 0 0 0 0 0 0 0 20 0 1 0 390822969 9367552 270 33554432000 4194304 5064252 140736245658800 140736245657712 226084152910 0 65536 4100 65538 18446744071579302229 0 0 17 5 0 0 0 0 0
/proc/20179/statm: 2287 270 229 213 0 72 0
[pid=20180] ppid=20179 vsize=242928 CPUtime=930.75 cores=1,3,5,7
/proc/20180/stat : 20180 (pb_cplex) R 20179 20179 20024 0 -1 4202496 132271 0 0 0 92941 134 0 0 20 0 8 0 390822969 248758272 35721 33554432000 134512640 146736320 4294450000 4294438608 136008082 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0 0 0
/proc/20180/statm: 60732 35721 969 2985 0 57666 0
[pid=20180/tid=20189] ppid=20179 vsize=242928 CPUtime=109.13 cores=1,3,5,7
/proc/20180/task/20189/stat : 20189 (pb_cplex) R 20179 20179 20024 0 -1 4202560 22860 0 0 0 10894 19 0 0 20 0 8 0 390827667 248758272 35721 33554432000 134512640 146736320 4294450000 4086620124 135855165 0 2 4096 16387 0 0 0 -1 7 0 0 0 0 0
[pid=20180/tid=20190] ppid=20179 vsize=242928 CPUtime=105.06 cores=1,3,5,7
/proc/20180/task/20190/stat : 20190 (pb_cplex) R 20179 20179 20024 0 -1 4202560 9800 0 0 0 10492 14 0 0 20 0 8 0 390827667 248758272 35721 33554432000 134512640 146736320 4294450000 4097107016 136000316 0 2 4096 16387 0 0 0 -1 7 0 0 0 0 0
[pid=20180/tid=20191] ppid=20179 vsize=242928 CPUtime=103.17 cores=1,3,5,7
/proc/20180/task/20191/stat : 20191 (pb_cplex) R 20179 20179 20024 0 -1 4202560 10691 0 0 0 10302 15 0 0 20 0 8 0 390827667 248758272 35721 33554432000 134512640 146736320 4294450000 4107592388 136385177 0 2 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=20180/tid=20192] ppid=20179 vsize=242928 CPUtime=101.85 cores=1,3,5,7
/proc/20180/task/20192/stat : 20192 (pb_cplex) R 20179 20179 20024 0 -1 4202560 14979 0 0 0 10170 15 0 0 20 0 8 0 390827667 248758272 35721 33554432000 134512640 146736320 4294450000 4118076296 139042902 0 2 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=20180/tid=20193] ppid=20179 vsize=242928 CPUtime=103.73 cores=1,3,5,7
/proc/20180/task/20193/stat : 20193 (pb_cplex) R 20179 20179 20024 0 -1 4202560 13940 0 0 0 10358 15 0 0 20 0 8 0 390827667 248758272 35721 33554432000 134512640 146736320 4294450000 4070559824 136008416 0 2 4096 16387 0 0 0 -1 5 0 0 0 0 0
[pid=20180/tid=20194] ppid=20179 vsize=242928 CPUtime=104.36 cores=1,3,5,7
/proc/20180/task/20194/stat : 20194 (pb_cplex) R 20179 20179 20024 0 -1 4202560 20825 0 0 0 10418 18 0 0 20 0 8 0 390827667 248758272 35721 33554432000 134512640 146736320 4294450000 4060074312 136000412 0 2 4096 16387 0 0 0 -1 5 0 0 0 0 0
[pid=20180/tid=20195] ppid=20179 vsize=242928 CPUtime=103.73 cores=1,3,5,7
/proc/20180/task/20195/stat : 20195 (pb_cplex) R 20179 20179 20024 0 -1 4202560 3107 0 0 0 10361 12 0 0 20 0 8 0 390827667 248758272 35721 33554432000 134512640 146736320 4294450000 4049592064 136622793 0 2 4096 16387 0 0 0 -1 1 0 0 0 0 0
Current children cumulated CPU time (s) 930.75
Current children cumulated vsize (KiB) 252076

[startup+342.3 s]
/proc/loadavg: 12.82 9.33 4.47 14/193 20280
/proc/meminfo: memFree=30928512/32873648 swapFree=7376/7376
[pid=20179] ppid=20177 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/20179/stat : 20179 (run) S 20177 20179 20024 0 -1 4202496 355 0 0 0 0 0 0 0 20 0 1 0 390822969 9367552 270 33554432000 4194304 5064252 140736245658800 140736245657712 226084152910 0 65536 4100 65538 18446744071579302229 0 0 17 5 0 0 0 0 0
/proc/20179/statm: 2287 270 229 213 0 72 0
[pid=20180] ppid=20179 vsize=238184 CPUtime=1170.24 cores=1,3,5,7
/proc/20180/stat : 20180 (pb_cplex) R 20179 20179 20024 0 -1 4202496 153773 0 0 0 116865 159 0 0 20 0 8 0 390822969 243900416 36329 33554432000 134512640 146736320 4294450000 4294438608 136008230 0 0 4096 16387 18446744073709551615 0 0 17 7 0 0 0 0 0
/proc/20180/statm: 59546 36329 980 2985 0 56480 0
[pid=20180/tid=20189] ppid=20179 vsize=238184 CPUtime=138.86 cores=1,3,5,7
/proc/20180/task/20189/stat : 20189 (pb_cplex) R 20179 20179 20024 0 -1 4202560 25453 0 0 0 13864 22 0 0 20 0 8 0 390827667 243900416 36329 33554432000 134512640 146736320 4294450000 4086620240 136008042 0 2 4096 16387 0 0 0 -1 5 0 0 0 0 0
[pid=20180/tid=20190] ppid=20179 vsize=238184 CPUtime=135.06 cores=1,3,5,7
/proc/20180/task/20190/stat : 20190 (pb_cplex) R 20179 20179 20024 0 -1 4202560 10082 0 0 0 13488 18 0 0 20 0 8 0 390827667 243900416 36329 33554432000 134512640 146736320 4294450000 4097111016 144757825 0 2 4096 16387 0 0 0 -1 5 0 0 0 0 0
[pid=20180/tid=20191] ppid=20179 vsize=238184 CPUtime=133.48 cores=1,3,5,7
/proc/20180/task/20191/stat : 20191 (pb_cplex) R 20179 20179 20024 0 -1 4202560 12255 0 0 0 13330 18 0 0 20 0 8 0 390827667 243900416 36329 33554432000 134512640 146736320 4294450000 4107594140 144785853 0 2 4096 16387 0 0 0 -1 1 0 0 0 0 0
[pid=20180/tid=20192] ppid=20179 vsize=238184 CPUtime=132.34 cores=1,3,5,7
/proc/20180/task/20192/stat : 20192 (pb_cplex) R 20179 20179 20024 0 -1 4202560 22886 0 0 0 13214 20 0 0 20 0 8 0 390827667 243900416 36329 33554432000 134512640 146736320 4294450000 4118077704 136388095 0 2 4096 16387 0 0 0 -1 7 0 0 0 0 0
[pid=20180/tid=20193] ppid=20179 vsize=238184 CPUtime=132.81 cores=1,3,5,7
/proc/20180/task/20193/stat : 20193 (pb_cplex) S 20179 20179 20024 0 -1 4202560 14112 0 0 0 13260 21 0 0 20 0 8 0 390827667 243900416 36329 33554432000 134512640 146736320 4294450000 4070567568 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 1 0 0 0 0 0
[pid=20180/tid=20194] ppid=20179 vsize=238184 CPUtime=134.38 cores=1,3,5,7
/proc/20180/task/20194/stat : 20194 (pb_cplex) R 20179 20179 20024 0 -1 4202560 23882 0 0 0 13416 22 0 0 20 0 8 0 390827667 243900416 36329 33554432000 134512640 146736320 4294450000 4060075080 136000179 0 2 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=20180/tid=20195] ppid=20179 vsize=238184 CPUtime=133.72 cores=1,3,5,7
/proc/20180/task/20195/stat : 20195 (pb_cplex) R 20179 20179 20024 0 -1 4202560 7860 0 0 0 13356 16 0 0 20 0 8 0 390827667 243900416 36329 33554432000 134512640 146736320 4294450000 4049588304 136008042 0 2 4096 16387 0 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 1170.24
Current children cumulated vsize (KiB) 247332

[startup+402.3 s]
/proc/loadavg: 11.82 9.76 4.91 17/193 20280
/proc/meminfo: memFree=30943696/32873648 swapFree=7376/7376
[pid=20179] ppid=20177 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/20179/stat : 20179 (run) S 20177 20179 20024 0 -1 4202496 355 0 0 0 0 0 0 0 20 0 1 0 390822969 9367552 270 33554432000 4194304 5064252 140736245658800 140736245657712 226084152910 0 65536 4100 65538 18446744071579302229 0 0 17 5 0 0 0 0 0
/proc/20179/statm: 2287 270 229 213 0 72 0
[pid=20180] ppid=20179 vsize=205388 CPUtime=1392.53 cores=1,3,5,7
/proc/20180/stat : 20180 (pb_cplex) S 20179 20179 20024 0 -1 4202496 165160 0 0 0 139067 186 0 0 20 0 8 0 390822969 210317312 30109 33554432000 134512640 146736320 4294450000 4294446352 144580073 0 0 4096 16387 18446744073709551615 0 0 17 7 0 0 0 0 0
/proc/20180/statm: 51347 30109 981 2985 0 48281 0
[pid=20180/tid=20189] ppid=20179 vsize=205388 CPUtime=160.12 cores=1,3,5,7
/proc/20180/task/20189/stat : 20189 (pb_cplex) S 20179 20179 20024 0 -1 4202560 25657 0 0 0 15986 26 0 0 20 0 8 0 390827667 210317312 30109 33554432000 134512640 146736320 4294450000 4086627984 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 1 0 0 0 0 0
[pid=20180/tid=20190] ppid=20179 vsize=205388 CPUtime=170.43 cores=1,3,5,7
/proc/20180/task/20190/stat : 20190 (pb_cplex) S 20179 20179 20024 0 -1 4202560 13408 0 0 0 17021 22 0 0 20 0 8 0 390827667 210317312 30109 33554432000 134512640 146736320 4294450000 4097113744 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 3 0 0 0 0 0
[pid=20180/tid=20191] ppid=20179 vsize=205388 CPUtime=168.06 cores=1,3,5,7
/proc/20180/task/20191/stat : 20191 (pb_cplex) S 20179 20179 20024 0 -1 4202560 16086 0 0 0 16783 23 0 0 20 0 8 0 390827667 210317312 30109 33554432000 134512640 146736320 4294450000 4107599504 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 5 0 0 0 0 0
[pid=20180/tid=20192] ppid=20179 vsize=205388 CPUtime=172.46 cores=1,3,5,7
/proc/20180/task/20192/stat : 20192 (pb_cplex) S 20179 20179 20024 0 -1 4202560 22937 0 0 0 17223 23 0 0 20 0 8 0 390827667 210317312 30109 33554432000 134512640 146736320 4294450000 4118085264 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 3 0 0 0 0 0
[pid=20180/tid=20193] ppid=20179 vsize=205388 CPUtime=137.72 cores=1,3,5,7
/proc/20180/task/20193/stat : 20193 (pb_cplex) S 20179 20179 20024 0 -1 4202560 14112 0 0 0 13751 21 0 0 20 0 8 0 390827667 210317312 30109 33554432000 134512640 146736320 4294450000 4070567568 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 1 0 0 0 0 0
[pid=20180/tid=20194] ppid=20179 vsize=205388 CPUtime=175.69 cores=1,3,5,7
/proc/20180/task/20194/stat : 20194 (pb_cplex) R 20179 20179 20024 0 -1 4202560 24000 0 0 0 17544 25 0 0 20 0 8 0 390827667 210317312 30109 33554432000 134512640 146736320 4294450000 4060078672 136403129 0 2 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=20180/tid=20195] ppid=20179 vsize=205388 CPUtime=155.51 cores=1,3,5,7
/proc/20180/task/20195/stat : 20195 (pb_cplex) R 20179 20179 20024 0 -1 4202560 9566 0 0 0 15532 19 0 0 20 0 8 0 390827667 210317312 30109 33554432000 134512640 146736320 4294450000 4049591300 136385179 0 2 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1392.53
Current children cumulated vsize (KiB) 214536

[startup+462.3 s]
/proc/loadavg: 13.43 10.62 5.53 17/193 20283
/proc/meminfo: memFree=30941100/32873648 swapFree=7376/7376
[pid=20179] ppid=20177 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/20179/stat : 20179 (run) S 20177 20179 20024 0 -1 4202496 355 0 0 0 0 0 0 0 20 0 1 0 390822969 9367552 270 33554432000 4194304 5064252 140736245658800 140736245657712 226084152910 0 65536 4100 65538 18446744071579302229 0 0 17 5 0 0 0 0 0
/proc/20179/statm: 2287 270 229 213 0 72 0
[pid=20180] ppid=20179 vsize=204516 CPUtime=1605.91 cores=1,3,5,7
/proc/20180/stat : 20180 (pb_cplex) R 20179 20179 20024 0 -1 4202496 165189 0 0 0 160384 207 0 0 20 0 8 0 390822969 209424384 29906 33554432000 134512640 146736320 4294450000 4294441812 136003486 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0 0 0
/proc/20180/statm: 51129 29906 981 2985 0 48063 0
[pid=20180/tid=20189] ppid=20179 vsize=204516 CPUtime=185.94 cores=1,3,5,7
/proc/20180/task/20189/stat : 20189 (pb_cplex) R 20179 20179 20024 0 -1 4202560 25658 0 0 0 18565 29 0 0 20 0 8 0 390827667 209424384 29906 33554432000 134512640 146736320 4294450000 4086624848 136403117 0 2 4096 16387 0 0 0 -1 1 0 0 0 0 0
[pid=20180/tid=20190] ppid=20179 vsize=204516 CPUtime=196.6 cores=1,3,5,7
/proc/20180/task/20190/stat : 20190 (pb_cplex) R 20179 20179 20024 0 -1 4202560 13410 0 0 0 19636 24 0 0 20 0 8 0 390827667 209424384 29906 33554432000 134512640 146736320 4294450000 4097110608 136403117 0 2 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=20180/tid=20191] ppid=20179 vsize=204516 CPUtime=194.15 cores=1,3,5,7
/proc/20180/task/20191/stat : 20191 (pb_cplex) R 20179 20179 20024 0 -1 4202560 16087 0 0 0 19389 26 0 0 20 0 8 0 390827667 209424384 29906 33554432000 134512640 146736320 4294450000 4107595592 135525911 0 2 4096 16387 0 0 0 -1 7 0 0 0 0 0
[pid=20180/tid=20192] ppid=20179 vsize=204516 CPUtime=198.9 cores=1,3,5,7
/proc/20180/task/20192/stat : 20192 (pb_cplex) R 20179 20179 20024 0 -1 4202560 22939 0 0 0 19863 27 0 0 20 0 8 0 390827667 209424384 29906 33554432000 134512640 146736320 4294450000 4118081608 139042974 0 2 4096 16387 0 0 0 -1 7 0 0 0 0 0
[pid=20180/tid=20193] ppid=20179 vsize=204516 CPUtime=165.28 cores=1,3,5,7
/proc/20180/task/20193/stat : 20193 (pb_cplex) R 20179 20179 20024 0 -1 4202560 14113 0 0 0 16504 24 0 0 20 0 8 0 390827667 209424384 29906 33554432000 134512640 146736320 4294450000 4070564232 136388075 0 2 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=20180/tid=20194] ppid=20179 vsize=204516 CPUtime=201.73 cores=1,3,5,7
/proc/20180/task/20194/stat : 20194 (pb_cplex) R 20179 20179 20024 0 -1 4202560 24001 0 0 0 20144 29 0 0 20 0 8 0 390827667 209424384 29906 33554432000 134512640 146736320 4294450000 4060078288 136008065 0 2 4096 16387 0 0 0 -1 5 0 0 0 0 0
[pid=20180/tid=20195] ppid=20179 vsize=204516 CPUtime=183.17 cores=1,3,5,7
/proc/20180/task/20195/stat : 20195 (pb_cplex) R 20179 20179 20024 0 -1 4202560 9567 0 0 0 18296 21 0 0 20 0 8 0 390827667 209424384 29906 33554432000 134512640 146736320 4294450000 4049593368 144757825 0 2 4096 16387 0 0 0 -1 1 0 0 0 0 0
Current children cumulated CPU time (s) 1605.91
Current children cumulated vsize (KiB) 213664



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+515.4 s]
/proc/loadavg: 13.32 11.01 5.92 17/193 20284
/proc/meminfo: memFree=30938624/32873648 swapFree=7376/7376
[pid=20179] ppid=20177 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/20179/stat : 20179 (run) S 20177 20179 20024 0 -1 4202496 355 0 0 0 0 0 0 0 20 0 1 0 390822969 9367552 270 33554432000 4194304 5064252 140736245658800 140736245657712 226084152910 0 65536 4100 65538 18446744071579302229 0 0 17 5 0 0 0 0 0
/proc/20179/statm: 2287 270 229 213 0 72 0
[pid=20180] ppid=20179 vsize=205500 CPUtime=1800.29 cores=1,3,5,7
/proc/20180/stat : 20180 (pb_cplex) R 20179 20179 20024 0 -1 4202496 165450 0 0 0 179799 230 0 0 20 0 8 0 390822969 210432000 30167 33554432000 134512640 146736320 4294450000 4294443060 136400577 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/20180/statm: 51375 30167 981 2985 0 48309 0
[pid=20180/tid=20189] ppid=20179 vsize=205500 CPUtime=210.35 cores=1,3,5,7
/proc/20180/task/20189/stat : 20189 (pb_cplex) R 20179 20179 20024 0 -1 4202560 25772 0 0 0 21004 31 0 0 20 0 8 0 390827667 210432000 30167 33554432000 134512640 146736320 4294450000 4086624464 136008172 0 2 4096 16387 0 0 0 -1 7 0 0 0 0 0
[pid=20180/tid=20190] ppid=20179 vsize=205500 CPUtime=220.8 cores=1,3,5,7
/proc/20180/task/20190/stat : 20190 (pb_cplex) R 20179 20179 20024 0 -1 4202560 13410 0 0 0 22052 28 0 0 20 0 8 0 390827667 210432000 30167 33554432000 134512640 146736320 4294450000 4097110292 136003526 0 2 4096 16387 0 0 0 -1 1 0 0 0 0 0
[pid=20180/tid=20191] ppid=20179 vsize=205500 CPUtime=218.68 cores=1,3,5,7
/proc/20180/task/20191/stat : 20191 (pb_cplex) R 20179 20179 20024 0 -1 4202560 16087 0 0 0 21838 30 0 0 20 0 8 0 390827667 210432000 30167 33554432000 134512640 146736320 4294450000 4107595992 136008602 0 2 4096 16387 0 0 0 -1 7 0 0 0 0 0
[pid=20180/tid=20192] ppid=20179 vsize=205500 CPUtime=223.67 cores=1,3,5,7
/proc/20180/task/20192/stat : 20192 (pb_cplex) R 20179 20179 20024 0 -1 4202560 22939 0 0 0 22336 31 0 0 20 0 8 0 390827667 210432000 30167 33554432000 134512640 146736320 4294450000 4118082536 144757825 0 2 4096 16387 0 0 0 -1 5 0 0 0 0 0
[pid=20180/tid=20193] ppid=20179 vsize=205500 CPUtime=189 cores=1,3,5,7
/proc/20180/task/20193/stat : 20193 (pb_cplex) R 20179 20179 20024 0 -1 4202560 14114 0 0 0 18873 27 0 0 20 0 8 0 390827667 210432000 30167 33554432000 134512640 146736320 4294450000 4070564232 136388081 0 2 4096 16387 0 0 0 -1 5 0 0 0 0 0
[pid=20180/tid=20194] ppid=20179 vsize=205500 CPUtime=225.53 cores=1,3,5,7
/proc/20180/task/20194/stat : 20194 (pb_cplex) R 20179 20179 20024 0 -1 4202560 24015 0 0 0 22521 32 0 0 20 0 8 0 390827667 210432000 30167 33554432000 134512640 146736320 4294450000 4060078536 136000404 0 2 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=20180/tid=20195] ppid=20179 vsize=205500 CPUtime=207.47 cores=1,3,5,7
/proc/20180/task/20195/stat : 20195 (pb_cplex) R 20179 20179 20024 0 -1 4202560 9638 0 0 0 20722 25 0 0 20 0 8 0 390827667 210432000 30167 33554432000 134512640 146736320 4294450000 4049592912 136403103 0 2 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1800.29
Current children cumulated vsize (KiB) 214648

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 20179 and gives
#  childrusage.ru_utime.tv_sec=0
#  childrusage.ru_utime.tv_usec=999
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=0
# CPU time returned by wait4() is 0.000999
# while last known CPU time is 1800.29
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 515.416
CPU time (s): 1800.29
CPU user time (s): 1797.99
CPU system time (s): 2.3
CPU usage (%): 349.288
Max. virtual memory (cumulated for all children) (KiB): 267756

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 0.000999
system time used= 0
maximum resident set size= 1080
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 355
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 2
involuntary context switches= 1

runsolver used 1.35379 second user time and 3.44248 second system time

The end

Launcher Data 

Begin job on node120 at 2012-06-09 15:02:50
IDJOB=3731719
IDBENCH=1979
IDSOLVER=2325
FILE ID=node120/3731719-1339246970
RUNJOBID= node120-1339246833-20042
PBS_JOBID= 14644361
Free space on /tmp= 70828 MiB

SOLVER NAME= PB10: pb_cplex 2010-06-29
BENCH NAME= PB06//final/normalized-PB06/OPT-SMALLINT/submitted-PB06/liu/vtxcov/normalized-vtxcov_v2000_e4000_34.opb.PB06.opb
COMMAND LINE= run BENCHNAME
CONVERSION SCRIPT= PBconversionToLinear BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3731719-1339246970/watcher-3731719-1339246970 -o /tmp/evaluation-result-3731719-1339246970/solver-3731719-1339246970 -C 1800 -W 1900 -M 15500  run HOME/instance-3731719-1339246970.opb

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= e19b588c94d7a5fd177e87fa7a6307a3
RANDOM SEED=575900162

node120.alineos.net Linux 2.6.32-71.29.1.el6.x86_64 #1 SMP Mon Jun 27 19:49:27 BST 2011

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.456
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.456
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.456
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.92
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.456
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.88
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.456
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.456
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.456
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.456
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32873648 kB
MemFree:        31201192 kB
Buffers:          438920 kB
Cached:           342768 kB
SwapCached:         5856 kB
Active:           519380 kB
Inactive:         331016 kB
Active(anon):      52316 kB
Inactive(anon):    10444 kB
Active(file):     467064 kB
Inactive(file):   320572 kB
Unevictable:        7376 kB
Mlocked:            7376 kB
SwapTotal:      67108856 kB
SwapFree:       67096152 kB
Dirty:             19264 kB
Writeback:             0 kB
AnonPages:         47516 kB
Mapped:            12396 kB
Shmem:                 0 kB
Slab:             685528 kB
SReclaimable:     129352 kB
SUnreclaim:       556176 kB
KernelStack:        1560 kB
PageTables:         4536 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83545680 kB
Committed_AS:     219000 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      346400 kB
VmallocChunk:   34341988052 kB
HardwareCorrupted:     0 kB
AnonHugePages:     12288 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:        7680 kB
DirectMap2M:    33538048 kB

CONVERSION COMMAND LINE= PBconversionToLinear HOME/instance-3731719-1339246970.opb

Free space on /tmp at the end= 70812 MiB
End job on node120 at 2012-06-09 15:11:27