Trace number 3712727

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
pwbo 2.01MSAT (TO) 1800.06 900.434

General information on the benchmark

Name/SOFT-SMALLINT-LIN/PB06/submitted-PB06/namasivayam/
tsp/normalized-t3002.11tsp11.1900545610--soft-0-100-0.wbo
MD5SUMaacdee42f12f02195344334122667810
Bench CategorySOFT-SMALLINT-LIN (only soft constraints, small integers, linear constraints)
Best result obtained on this benchmarkMOPT
Best cost obtained on this benchmark1
Best CPU time to get the best result obtained on this benchmark56.5064
Max-Satisfiable
Max-(Un)Satisfiability was proved
Best value of the cost
Optimality of the best cost was proved
Number of variables231
Total number of constraints2707
Number of soft constraints2707
Number of constraints which are clauses2684
Number of constraints which are cardinality constraints (but not clauses)22
Number of constraints which are nor clauses,nor cardinality constraints1
Minimum length of a constraint2
Maximum length of a constraint110
Top cost 135641
Min constraint cost 1
Max constraint cost 100
Sum of constraints costs 135640
Biggest number in a constraint 25
Number of bits of the biggest number in a constraint 5
Biggest sum of numbers in a constraint 671
Number of bits of the biggest sum of numbers10
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Quality of the solution as a function of time


Download the above graph as a PDF file / as an EPS file

Solver Data

0.00/0.00	c ==============================[ Solver Version ]===============================
0.00/0.00	c |                                                                             |
0.00/0.00	c |  pwbo:                    2.01 beta - May, 2012                            |
0.00/0.00	c |                                                                             |
0.00/0.00	c Parsing wbo file format. File HOME/instance-3712727-1338205040.wbo.
0.00/0.00	c Instance file HOME/instance-3712727-1338205040.wbo
0.00/0.00	c File size is 96768 bytes.
0.00/0.01	c Highest Coefficient sum: 671
0.00/0.01	c ============================[ Problem Statistics ]=============================
0.00/0.01	c |                                                                             |
0.00/0.01	c |  Parsing time:          0.01         s                                      |
0.00/0.01	c |  Number Variables:      2938                                                |
0.00/0.01	c |  Number Clauses:        2684                                                |
0.00/0.01	c |  Number Cardinality:    0                                                   |
0.00/0.01	c |  Number PB Constraints: 23                                                  |
0.00/0.01	c |                                                                             |
0.00/0.01	c |  Problem Type:          Optimization                                        |
0.00/0.01	c |  Objective Function:    PB Constraint                                       |
0.00/0.01	c |                                                                             |
0.00/0.01	c ===============================================================================
1800.06/900.31	o 783
1800.06/900.31	o 764
1800.06/900.31	o 755
1800.06/900.31	o 731
1800.06/900.31	o 725
1800.06/900.31	o 636
1800.06/900.31	o 579
1800.06/900.31	o 573
1800.06/900.31	o 536
1800.06/900.31	o 486
1800.06/900.31	o 437
1800.06/900.31	o 432
1800.06/900.31	o 427
1800.06/900.31	o 409
1800.06/900.31	o 408
1800.06/900.31	o 403
1800.06/900.31	o 398
1800.06/900.31	o 363
1800.06/900.31	o 354
1800.06/900.31	o 319
1800.06/900.31	o 306
1800.06/900.31	o 297
1800.06/900.31	o 262
1800.06/900.31	o 249
1800.06/900.31	o 248
1800.06/900.31	o 244
1800.06/900.31	o 238
1800.06/900.31	o 236
1800.06/900.31	o 228
1800.06/900.31	o 225
1800.06/900.31	o 214
1800.06/900.31	o 207
1800.06/900.31	o 200
1800.06/900.31	o 190
1800.06/900.31	o 176
1800.06/900.31	o 161
1800.06/900.31	o 159
1800.06/900.31	o 155
1800.06/900.31	o 152
1800.06/900.31	o 148
1800.06/900.31	o 147
1800.06/900.31	o 142
1800.06/900.31	o 137
1800.06/900.31	o 135
1800.06/900.31	o 111
1800.06/900.31	o 110
1800.06/900.31	o 109
1800.06/900.31	o 107
1800.06/900.31	o 106
1800.06/900.31	o 102
1800.06/900.31	o 85
1800.06/900.31	o 79
1800.06/900.31	o 72
1800.06/900.31	o 71
1800.06/900.31	o 69
1800.06/900.31	o 54
1800.06/900.31	o 52
1800.06/900.31	o 40
1800.06/900.31	o 36
1800.06/900.31	o 33
1800.06/900.31	o 32
1800.06/900.31	o 31
1800.06/900.31	o 30
1800.06/900.31	o 27
1800.06/900.31	o 26
1800.06/900.31	o 19
1800.06/900.31	o 17
1800.06/900.31	o 7
1800.06/900.31	o 6
1800.06/900.31	o 5
1800.06/900.31	o 2
1800.06/900.31	o 1
1800.06/900.31	c ===============================================================================
1800.06/900.31	c Wall Clock Time: 900.31 s
1800.06/900.31	c Best Solution: 1
1800.06/900.31	s SATISFIABLE
1800.06/900.31	v -x1 -x2 -x3 x4 x5 -x6 -x7 -x8 -x9 -x10 -x11 -x12 -x13 -x14 -x15 -x16 -x17 -x18 -x19 -x20 -x21 -x22 -x23 -x24 -x25 -x26 -x27 -x28 -x29 -x30 -x31 -x32 x33 -x34 -x35 -x36 -x37 -x38 -x39 -x40 -x41 x42 -x43 -x44 -x45 -x46 -x47 -x48 x49 -x50 -x51 -x52 -x53 -x54 -x55 -x56 -x57 -x58 -x59 -x60 -x61 -x62 x63 -x64 -x65 -x66 x67 -x68 -x69 -x70 -x71 -x72 -x73 -x74 -x75 -x76 -x77 -x78 -x79 -x80 -x81 -x82 x83 -x84 -x85 -x86 -x87 -x88 -x89 -x90 -x91 -x92 -x93 -x94 x95 -x96 -x97 -x98 -x99 -x100 -x101 -x102 x103 -x104 -x105 -x106 -x107 -x108 -x109 -x110 -x111 -x112 -x113 -x114 -x115 -x116 -x117 -x118 -x119 x120 -x121 -x122 -x123 -x124 -x125 -x126 -x127 x128 -x129 -x130 -x131 -x132 x133 -x134 -x135 -x136 -x137 -x138 -x139 -x140 -x141 -x142 -x143 -x144 -x145 -x146 -x147 -x148 -x149 x150 -x151 -x152 -x153 -x154 -x155 -x156 x157 -x158 -x159 -x160 -x161 -x162 -x163 -x164 -x165 -x166 -x167 -x168 x169 -x170 -x171 x172 -x173 -x174 -x175 -x176 -x177 -x178 -x179 -x180 -x181 -x182 -x183 -x184 -x185 -x186 x187 -x188 -x189 -x190 -x191 -x192 -x193 -x194 -x195 x196 -x197 -x198 -x199 -x200 -x201 -x202 -x203 -x204 -x205 -x206 -x207 -x208 -x209 -x210 -x211 -x212 -x213 -x214 x215 -x216 -x217 -x218 -x219 -x220 -x221 -x222 x223 -x224 -x225 -x226 -x227 -x228 -x229 -x230 -x231

Verifier Data

OK	1

Watcher Data

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.1 (svn: 989)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3712727-1338205040/watcher-3712727-1338205040 -o /tmp/evaluation-result-3712727-1338205040/solver-3712727-1338205040 -C 1800 -W 1900 -M 15500 pwbo2.01 -file-format=wbo -verbosity=0 HOME/instance-3712727-1338205040.wbo 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1900 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 4.00 4.00 4.00 4/180 24823
/proc/meminfo: memFree=29879112/32873844 swapFree=7112/7112
[pid=24823] ppid=24821 vsize=4740 CPUtime=0 cores=1,3,5,7
/proc/24823/stat : 24823 (pwbo2.01) R 24821 24823 22874 0 -1 4202496 459 0 0 0 0 0 0 0 20 0 1 0 286629301 4853760 411 33554432000 4194304 5964478 140737292666016 140737292665432 5179584 0 0 4096 16387 0 0 0 17 5 0 0 0 0 0
/proc/24823/statm: 1185 419 169 433 0 725 0

[startup+0.065528 s]
/proc/loadavg: 4.00 4.00 4.00 4/180 24823
/proc/meminfo: memFree=29879112/32873844 swapFree=7112/7112
[pid=24823] ppid=24821 vsize=164272 CPUtime=0.1 cores=1,3,5,7
/proc/24823/stat : 24823 (pwbo2.01) S 24821 24823 22874 0 -1 4202496 2769 0 0 0 10 0 0 0 20 0 3 0 286629301 168214528 2263 33554432000 4194304 5964478 140737292666016 140737292665536 4546669 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/24823/statm: 41068 2263 198 433 0 40632 0
Current children cumulated CPU time (s) 0.1
Current children cumulated vsize (KiB) 164272

[startup+0.100237 s]
/proc/loadavg: 4.00 4.00 4.00 4/180 24823
/proc/meminfo: memFree=29879112/32873844 swapFree=7112/7112
[pid=24823] ppid=24821 vsize=164272 CPUtime=0.17 cores=1,3,5,7
/proc/24823/stat : 24823 (pwbo2.01) S 24821 24823 22874 0 -1 4202496 3179 0 0 0 17 0 0 0 20 0 3 0 286629301 168214528 2473 33554432000 4194304 5964478 140737292666016 140737292665536 4546669 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/24823/statm: 41068 2473 198 433 0 40632 0
Current children cumulated CPU time (s) 0.17
Current children cumulated vsize (KiB) 164272

[startup+0.300137 s]
/proc/loadavg: 4.00 4.00 4.00 4/180 24823
/proc/meminfo: memFree=29879112/32873844 swapFree=7112/7112
[pid=24823] ppid=24821 vsize=164272 CPUtime=0.57 cores=1,3,5,7
/proc/24823/stat : 24823 (pwbo2.01) S 24821 24823 22874 0 -1 4202496 6294 0 0 0 56 1 0 0 20 0 3 0 286629301 168214528 3709 33554432000 4194304 5964478 140737292666016 140737292665536 4546669 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/24823/statm: 41068 3709 198 433 0 40632 0
Current children cumulated CPU time (s) 0.57
Current children cumulated vsize (KiB) 164272

[startup+0.700132 s]
/proc/loadavg: 4.00 4.00 4.00 4/180 24823
/proc/meminfo: memFree=29879112/32873844 swapFree=7112/7112
[pid=24823] ppid=24821 vsize=164272 CPUtime=1.37 cores=1,3,5,7
/proc/24823/stat : 24823 (pwbo2.01) S 24821 24823 22874 0 -1 4202496 7708 0 0 0 136 1 0 0 20 0 3 0 286629301 168214528 4621 33554432000 4194304 5964478 140737292666016 140737292665536 4546669 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/24823/statm: 41068 4621 198 433 0 40632 0
Current children cumulated CPU time (s) 1.37
Current children cumulated vsize (KiB) 164272

[startup+1.50037 s]
/proc/loadavg: 4.00 4.00 4.00 5/183 24826
/proc/meminfo: memFree=29857892/32873844 swapFree=7112/7112
[pid=24823] ppid=24821 vsize=164272 CPUtime=2.96 cores=1,3,5,7
/proc/24823/stat : 24823 (pwbo2.01) S 24821 24823 22874 0 -1 4202496 10482 0 0 0 294 2 0 0 20 0 3 0 286629301 168214528 6294 33554432000 4194304 5964478 140737292666016 140737292665536 4546669 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/24823/statm: 41068 6294 198 433 0 40632 0
[pid=24823/tid=24825] ppid=24821 vsize=164272 CPUtime=1.47 cores=1,3,5,7
/proc/24823/task/24825/stat : 24825 (pwbo2.01) R 24821 24823 22874 0 -1 4202560 3047 0 0 0 145 2 0 0 20 0 3 0 286629302 168214528 6294 33554432000 4194304 5964478 140737292666016 139816985937984 4400071 0 0 4096 16387 0 0 0 -1 1 0 0 0 0 0
[pid=24823/tid=24826] ppid=24821 vsize=164272 CPUtime=1.46 cores=1,3,5,7
/proc/24823/task/24826/stat : 24826 (pwbo2.01) R 24821 24823 22874 0 -1 4202560 6344 0 0 0 145 1 0 0 20 0 3 0 286629302 168214528 6294 33554432000 4194304 5964478 140737292666016 139816975448520 4403705 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 2.96
Current children cumulated vsize (KiB) 164272

[startup+3.10035 s]
/proc/loadavg: 4.00 4.00 4.00 5/183 24826
/proc/meminfo: memFree=29851056/32873844 swapFree=7112/7112
[pid=24823] ppid=24821 vsize=164272 CPUtime=6.17 cores=1,3,5,7
/proc/24823/stat : 24823 (pwbo2.01) S 24821 24823 22874 0 -1 4202496 13561 0 0 0 611 6 0 0 20 0 3 0 286629301 168214528 8840 33554432000 4194304 5964478 140737292666016 140737292665536 4546669 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/24823/statm: 41068 8840 198 433 0 40632 0
[pid=24823/tid=24825] ppid=24821 vsize=164272 CPUtime=3.06 cores=1,3,5,7
/proc/24823/task/24825/stat : 24825 (pwbo2.01) R 24821 24823 22874 0 -1 4202560 5228 0 0 0 301 5 0 0 20 0 3 0 286629302 168214528 8840 33554432000 4194304 5964478 140737292666016 139816985937912 4373504 0 0 4096 16387 0 0 0 -1 1 0 0 0 0 0
[pid=24823/tid=24826] ppid=24821 vsize=164272 CPUtime=3.06 cores=1,3,5,7
/proc/24823/task/24826/stat : 24826 (pwbo2.01) R 24821 24823 22874 0 -1 4202560 7242 0 0 0 305 1 0 0 20 0 3 0 286629302 168214528 8840 33554432000 4194304 5964478 140737292666016 139816975448728 4403648 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 6.17
Current children cumulated vsize (KiB) 164272

[startup+6.30033 s]
/proc/loadavg: 4.00 4.00 4.00 5/183 24826
/proc/meminfo: memFree=29830472/32873844 swapFree=7112/7112
[pid=24823] ppid=24821 vsize=164272 CPUtime=12.57 cores=1,3,5,7
/proc/24823/stat : 24823 (pwbo2.01) S 24821 24823 22874 0 -1 4202496 20233 0 0 0 1248 9 0 0 20 0 3 0 286629301 168214528 14590 33554432000 4194304 5964478 140737292666016 140737292665536 4546669 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/24823/statm: 41068 14590 198 433 0 40632 0
[pid=24823/tid=24825] ppid=24821 vsize=164272 CPUtime=6.25 cores=1,3,5,7
/proc/24823/task/24825/stat : 24825 (pwbo2.01) R 24821 24823 22874 0 -1 4202560 10119 0 0 0 618 7 0 0 20 0 3 0 286629302 168214528 14590 33554432000 4194304 5964478 140737292666016 139816985937912 4399994 0 0 4096 16387 0 0 0 -1 1 0 0 0 0 0
[pid=24823/tid=24826] ppid=24821 vsize=164272 CPUtime=6.25 cores=1,3,5,7
/proc/24823/task/24826/stat : 24826 (pwbo2.01) R 24821 24823 22874 0 -1 4202560 9023 0 0 0 624 1 0 0 20 0 3 0 286629302 168214528 14590 33554432000 4194304 5964478 140737292666016 139816975448376 4221984 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 12.57
Current children cumulated vsize (KiB) 164272

[startup+12.7003 s]
/proc/loadavg: 4.00 4.00 4.00 5/183 24826
/proc/meminfo: memFree=29792972/32873844 swapFree=7112/7112
[pid=24823] ppid=24821 vsize=230336 CPUtime=25.36 cores=1,3,5,7
/proc/24823/stat : 24823 (pwbo2.01) S 24821 24823 22874 0 -1 4202496 29007 0 0 0 2524 12 0 0 20 0 3 0 286629301 235864064 23261 33554432000 4194304 5964478 140737292666016 140737292665536 4546669 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/24823/statm: 57584 23261 198 433 0 57148 0
[pid=24823/tid=24825] ppid=24821 vsize=230336 CPUtime=12.64 cores=1,3,5,7
/proc/24823/task/24825/stat : 24825 (pwbo2.01) R 24821 24823 22874 0 -1 4202560 17465 0 0 0 1255 9 0 0 20 0 3 0 286629302 235864064 23261 33554432000 4194304 5964478 140737292666016 139816985937912 4400075 0 0 4096 16387 0 0 0 -1 1 0 0 0 0 0
[pid=24823/tid=24826] ppid=24821 vsize=230336 CPUtime=12.63 cores=1,3,5,7
/proc/24823/task/24826/stat : 24826 (pwbo2.01) R 24821 24823 22874 0 -1 4202560 10451 0 0 0 1261 2 0 0 20 0 3 0 286629302 235864064 23261 33554432000 4194304 5964478 140737292666016 139816975448136 4221120 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 25.36
Current children cumulated vsize (KiB) 230336

[startup+25.5004 s]
/proc/loadavg: 4.00 4.00 4.00 5/183 24826
/proc/meminfo: memFree=29679000/32873844 swapFree=7112/7112
[pid=24823] ppid=24821 vsize=296988 CPUtime=50.96 cores=1,3,5,7
/proc/24823/stat : 24823 (pwbo2.01) S 24821 24823 22874 0 -1 4202496 56600 0 0 0 5074 22 0 0 20 0 3 0 286629301 304115712 50740 33554432000 4194304 5964478 140737292666016 140737292665536 4546669 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/24823/statm: 74247 50740 198 433 0 73811 0
[pid=24823/tid=24825] ppid=24821 vsize=296988 CPUtime=25.4 cores=1,3,5,7
/proc/24823/task/24825/stat : 24825 (pwbo2.01) R 24821 24823 22874 0 -1 4202560 25691 0 0 0 2528 12 0 0 20 0 3 0 286629302 304115712 50740 33554432000 4194304 5964478 140737292666016 139816985937824 4400093 0 0 4096 16387 0 0 0 -1 1 0 0 0 0 0
[pid=24823/tid=24826] ppid=24821 vsize=296988 CPUtime=25.4 cores=1,3,5,7
/proc/24823/task/24826/stat : 24826 (pwbo2.01) R 24821 24823 22874 0 -1 4202560 29818 0 0 0 2531 9 0 0 20 0 3 0 286629302 304115712 50740 33554432000 4194304 5964478 140737292666016 139816975448376 4399904 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 50.96
Current children cumulated vsize (KiB) 296988

[startup+51.1004 s]
/proc/loadavg: 4.00 4.00 4.00 5/183 24826
/proc/meminfo: memFree=29520048/32873844 swapFree=7112/7112
[pid=24823] ppid=24821 vsize=431072 CPUtime=102.15 cores=1,3,5,7
/proc/24823/stat : 24823 (pwbo2.01) S 24821 24823 22874 0 -1 4202496 96445 0 0 0 10170 45 0 0 20 0 3 0 286629301 441417728 90585 33554432000 4194304 5964478 140737292666016 140737292665536 4546669 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/24823/statm: 107768 90585 198 433 0 107332 0
[pid=24823/tid=24825] ppid=24821 vsize=431072 CPUtime=50.93 cores=1,3,5,7
/proc/24823/task/24825/stat : 24825 (pwbo2.01) R 24821 24823 22874 0 -1 4202560 44340 0 0 0 5068 25 0 0 20 0 3 0 286629302 441417728 90585 33554432000 4194304 5964478 140737292666016 139816985937912 4399904 0 0 4096 16387 0 0 0 -1 1 0 0 0 0 0
[pid=24823/tid=24826] ppid=24821 vsize=431072 CPUtime=50.93 cores=1,3,5,7
/proc/24823/task/24826/stat : 24826 (pwbo2.01) R 24821 24823 22874 0 -1 4202560 51014 0 0 0 5075 18 0 0 20 0 3 0 286629302 441417728 90585 33554432000 4194304 5964478 140737292666016 139816975448312 4399904 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 102.15
Current children cumulated vsize (KiB) 431072

[startup+102.307 s]
/proc/loadavg: 4.00 4.00 4.00 5/183 24827
/proc/meminfo: memFree=29169296/32873844 swapFree=7112/7112
[pid=24823] ppid=24821 vsize=694080 CPUtime=204.53 cores=1,3,5,7
/proc/24823/stat : 24823 (pwbo2.01) S 24821 24823 22874 0 -1 4202496 155773 0 0 0 20362 91 0 0 20 0 3 0 286629301 710737920 149913 33554432000 4194304 5964478 140737292666016 140737292665536 4546669 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/24823/statm: 173520 149913 198 433 0 173084 0
[pid=24823/tid=24825] ppid=24821 vsize=694080 CPUtime=102 cores=1,3,5,7
/proc/24823/task/24825/stat : 24825 (pwbo2.01) R 24821 24823 22874 0 -1 4202560 85525 0 0 0 10135 65 0 0 20 0 3 0 286629302 710737920 149913 33554432000 4194304 5964478 140737292666016 139816985937912 4379280 0 0 4096 16387 0 0 0 -1 1 0 0 0 0 0
[pid=24823/tid=24826] ppid=24821 vsize=694080 CPUtime=102 cores=1,3,5,7
/proc/24823/task/24826/stat : 24826 (pwbo2.01) R 24821 24823 22874 0 -1 4202560 69160 0 0 0 10173 27 0 0 20 0 3 0 286629302 710737920 149916 33554432000 4194304 5964478 140737292666016 139816975448376 5136404 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 204.53
Current children cumulated vsize (KiB) 694080

[startup+162.3 s]
/proc/loadavg: 4.00 4.00 4.00 5/184 24830
/proc/meminfo: memFree=29058692/32873844 swapFree=7112/7112
[pid=24823] ppid=24821 vsize=826616 CPUtime=324.5 cores=1,3,5,7
/proc/24823/stat : 24823 (pwbo2.01) S 24821 24823 22874 0 -1 4202496 182826 0 0 0 32348 102 0 0 20 0 3 0 286629301 846454784 176966 33554432000 4194304 5964478 140737292666016 140737292665536 4546669 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/24823/statm: 206654 176966 198 433 0 206218 0
[pid=24823/tid=24825] ppid=24821 vsize=826616 CPUtime=161.83 cores=1,3,5,7
/proc/24823/task/24825/stat : 24825 (pwbo2.01) R 24821 24823 22874 0 -1 4202560 88155 0 0 0 16116 67 0 0 20 0 3 0 286629302 846454784 176966 33554432000 4194304 5964478 140737292666016 139816985937912 4400053 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
[pid=24823/tid=24826] ppid=24821 vsize=826616 CPUtime=161.84 cores=1,3,5,7
/proc/24823/task/24826/stat : 24826 (pwbo2.01) R 24821 24823 22874 0 -1 4202560 93580 0 0 0 16146 38 0 0 20 0 3 0 286629302 846454784 176966 33554432000 4194304 5964478 140737292666016 139816975448136 4388212 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 324.5
Current children cumulated vsize (KiB) 826616

[startup+222.3 s]
/proc/loadavg: 4.00 4.00 4.00 5/183 24830
/proc/meminfo: memFree=28708072/32873844 swapFree=7112/7112
[pid=24823] ppid=24821 vsize=1024572 CPUtime=444.48 cores=1,3,5,7
/proc/24823/stat : 24823 (pwbo2.01) S 24821 24823 22874 0 -1 4202496 239926 0 0 0 44321 127 0 0 20 0 3 0 286629301 1049161728 234066 33554432000 4194304 5964478 140737292666016 140737292665536 4546669 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/24823/statm: 256143 234066 198 433 0 255707 0
[pid=24823/tid=24825] ppid=24821 vsize=1024572 CPUtime=221.68 cores=1,3,5,7
/proc/24823/task/24825/stat : 24825 (pwbo2.01) R 24821 24823 22874 0 -1 4202560 125807 0 0 0 22082 86 0 0 20 0 3 0 286629302 1049161728 234066 33554432000 4194304 5964478 140737292666016 139816985937912 4388753 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
[pid=24823/tid=24826] ppid=24821 vsize=1024572 CPUtime=221.68 cores=1,3,5,7
/proc/24823/task/24826/stat : 24826 (pwbo2.01) R 24821 24823 22874 0 -1 4202560 113028 0 0 0 22122 46 0 0 20 0 3 0 286629302 1049161728 234066 33554432000 4194304 5964478 140737292666016 139816975448136 4399904 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 444.48
Current children cumulated vsize (KiB) 1024572

[startup+282.3 s]
/proc/loadavg: 4.00 4.00 4.00 5/183 24830
/proc/meminfo: memFree=28216936/32873844 swapFree=7112/7112
[pid=24823] ppid=24821 vsize=1419660 CPUtime=564.46 cores=1,3,5,7
/proc/24823/stat : 24823 (pwbo2.01) S 24821 24823 22874 0 -1 4202496 327722 0 0 0 56279 167 0 0 20 0 3 0 286629301 1453731840 321862 33554432000 4194304 5964478 140737292666016 140737292665536 4546669 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/24823/statm: 354915 321862 198 433 0 354479 0
[pid=24823/tid=24825] ppid=24821 vsize=1419660 CPUtime=281.52 cores=1,3,5,7
/proc/24823/task/24825/stat : 24825 (pwbo2.01) R 24821 24823 22874 0 -1 4202560 168233 0 0 0 28048 104 0 0 20 0 3 0 286629302 1453731840 321862 33554432000 4194304 5964478 140737292666016 139816985937912 4403323 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
[pid=24823/tid=24826] ppid=24821 vsize=1419660 CPUtime=281.52 cores=1,3,5,7
/proc/24823/task/24826/stat : 24826 (pwbo2.01) R 24821 24823 22874 0 -1 4202560 158398 0 0 0 28082 70 0 0 20 0 3 0 286629302 1453731840 321862 33554432000 4194304 5964478 140737292666016 139816975448480 4220672 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 564.46
Current children cumulated vsize (KiB) 1419660

[startup+342.3 s]
/proc/loadavg: 4.00 4.00 4.00 5/183 24830
/proc/meminfo: memFree=28020176/32873844 swapFree=7112/7112
[pid=24823] ppid=24821 vsize=1485780 CPUtime=684.45 cores=1,3,5,7
/proc/24823/stat : 24823 (pwbo2.01) S 24821 24823 22874 0 -1 4202496 346959 0 0 0 68266 179 0 0 20 0 3 0 286629301 1521438720 340280 33554432000 4194304 5964478 140737292666016 140737292665536 4546669 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/24823/statm: 371445 340280 198 433 0 371009 0

################
# More data... #
################

Current children cumulated CPU time (s) 1044.37
Current children cumulated vsize (KiB) 1487632

[startup+582.3 s]
/proc/loadavg: 3.96 3.97 3.99 5/184 24873
/proc/meminfo: memFree=29297956/32873844 swapFree=7112/7112
[pid=24823] ppid=24821 vsize=1553592 CPUtime=1164.32 cores=1,3,5,7
/proc/24823/stat : 24823 (pwbo2.01) S 24821 24823 22874 0 -1 4202496 365797 0 0 0 116241 191 0 0 20 0 3 0 286629301 1590878208 359894 33554432000 4194304 5964478 140737292666016 140737292665536 4546669 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/24823/statm: 388398 359894 198 433 0 387962 0
[pid=24823/tid=24825] ppid=24821 vsize=1553592 CPUtime=580.69 cores=1,3,5,7
/proc/24823/task/24825/stat : 24825 (pwbo2.01) R 24821 24823 22874 0 -1 4202560 205053 0 0 0 57937 132 0 0 20 0 3 0 286629302 1590878208 359894 33554432000 4194304 5964478 140737292666016 139816985937912 4399904 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
[pid=24823/tid=24826] ppid=24821 vsize=1553592 CPUtime=580.73 cores=1,3,5,7
/proc/24823/task/24826/stat : 24826 (pwbo2.01) R 24821 24823 22874 0 -1 4202560 159653 0 0 0 57999 74 0 0 20 0 3 0 286629302 1590878208 359894 33554432000 4194304 5964478 140737292666016 139816975448480 4400062 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 1164.32
Current children cumulated vsize (KiB) 1553592

[startup+642.3 s]
/proc/loadavg: 4.02 3.99 3.99 5/183 24873
/proc/meminfo: memFree=29074916/32873844 swapFree=7112/7112
[pid=24823] ppid=24821 vsize=1685328 CPUtime=1284.28 cores=1,3,5,7
/proc/24823/stat : 24823 (pwbo2.01) S 24821 24823 22874 0 -1 4202496 394628 0 0 0 128220 208 0 0 20 0 3 0 286629301 1725775872 388691 33554432000 4194304 5964478 140737292666016 140737292665536 4546669 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/24823/statm: 421332 388691 198 433 0 420896 0
[pid=24823/tid=24825] ppid=24821 vsize=1685328 CPUtime=640.53 cores=1,3,5,7
/proc/24823/task/24825/stat : 24825 (pwbo2.01) R 24821 24823 22874 0 -1 4202560 233735 0 0 0 63903 150 0 0 20 0 3 0 286629302 1725775872 388691 33554432000 4194304 5964478 140737292666016 139816985937912 4221120 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
[pid=24823/tid=24826] ppid=24821 vsize=1685328 CPUtime=640.55 cores=1,3,5,7
/proc/24823/task/24826/stat : 24826 (pwbo2.01) R 24821 24823 22874 0 -1 4202560 159802 0 0 0 63979 76 0 0 20 0 3 0 286629302 1725775872 388691 33554432000 4194304 5964478 140737292666016 139816975448136 4400090 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 1284.28
Current children cumulated vsize (KiB) 1685328

[startup+702.3 s]
/proc/loadavg: 4.00 3.99 3.99 5/183 24874
/proc/meminfo: memFree=28691536/32873844 swapFree=7112/7112
[pid=24823] ppid=24821 vsize=1883084 CPUtime=1404.2 cores=1,3,5,7
/proc/24823/stat : 24823 (pwbo2.01) S 24821 24823 22874 0 -1 4202496 458505 0 0 0 140171 249 0 0 20 0 3 0 286629301 1928278016 452543 33554432000 4194304 5964478 140737292666016 140737292665536 4546669 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/24823/statm: 470771 452543 198 433 0 470335 0
[pid=24823/tid=24825] ppid=24821 vsize=1883084 CPUtime=700.35 cores=1,3,5,7
/proc/24823/task/24825/stat : 24825 (pwbo2.01) R 24821 24823 22874 0 -1 4202560 261323 0 0 0 69871 164 0 0 20 0 3 0 286629302 1928278016 452543 33554432000 4194304 5964478 140737292666016 139816985937912 4400053 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
[pid=24823/tid=24826] ppid=24821 vsize=1883084 CPUtime=700.37 cores=1,3,5,7
/proc/24823/task/24826/stat : 24826 (pwbo2.01) R 24821 24823 22874 0 -1 4202560 196091 0 0 0 69933 104 0 0 20 0 3 0 286629302 1928278016 452543 33554432000 4194304 5964478 140737292666016 139816975448288 4399936 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 1404.2
Current children cumulated vsize (KiB) 1883084

[startup+762.307 s]
/proc/loadavg: 4.00 3.99 3.99 5/184 24877
/proc/meminfo: memFree=28545104/32873844 swapFree=7112/7112
[pid=24823] ppid=24821 vsize=2015224 CPUtime=1524.16 cores=1,3,5,7
/proc/24823/stat : 24823 (pwbo2.01) S 24821 24823 22874 0 -1 4202496 485026 0 0 0 152150 266 0 0 20 0 3 0 286629301 2063589376 479039 33554432000 4194304 5964478 140737292666016 140737292665536 4546669 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/24823/statm: 503806 479039 198 433 0 503370 0
[pid=24823/tid=24825] ppid=24821 vsize=2015224 CPUtime=760.17 cores=1,3,5,7
/proc/24823/task/24825/stat : 24825 (pwbo2.01) R 24821 24823 22874 0 -1 4202560 287807 0 0 0 75835 182 0 0 20 0 3 0 286629302 2063589376 479039 33554432000 4194304 5964478 140737292666016 139816985937912 4400099 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
[pid=24823/tid=24826] ppid=24821 vsize=2015224 CPUtime=760.21 cores=1,3,5,7
/proc/24823/task/24826/stat : 24826 (pwbo2.01) R 24821 24823 22874 0 -1 4202560 196128 0 0 0 75916 105 0 0 20 0 3 0 286629302 2063589376 479039 33554432000 4194304 5964478 140737292666016 139816975448136 4399904 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 1524.16
Current children cumulated vsize (KiB) 2015224

[startup+822.3 s]
/proc/loadavg: 4.00 3.99 3.99 5/183 24877
/proc/meminfo: memFree=28269488/32873844 swapFree=7112/7112
[pid=24823] ppid=24821 vsize=2146864 CPUtime=1644.1 cores=1,3,5,7
/proc/24823/stat : 24823 (pwbo2.01) S 24821 24823 22874 0 -1 4202496 523872 0 0 0 164122 288 0 0 20 0 3 0 286629301 2198388736 517855 33554432000 4194304 5964478 140737292666016 140737292665536 4546669 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/24823/statm: 536716 517855 198 433 0 536280 0
[pid=24823/tid=24825] ppid=24821 vsize=2146864 CPUtime=820 cores=1,3,5,7
/proc/24823/task/24825/stat : 24825 (pwbo2.01) R 24821 24823 22874 0 -1 4202560 310991 0 0 0 81802 198 0 0 20 0 3 0 286629302 2198388736 517855 33554432000 4194304 5964478 140737292666016 139816985937912 4399904 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
[pid=24823/tid=24826] ppid=24821 vsize=2146864 CPUtime=820.03 cores=1,3,5,7
/proc/24823/task/24826/stat : 24826 (pwbo2.01) R 24821 24823 22874 0 -1 4202560 211790 0 0 0 81889 114 0 0 20 0 3 0 286629302 2198388736 517855 33554432000 4194304 5964478 140737292666016 139816975448376 4400081 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 1644.1
Current children cumulated vsize (KiB) 2146864

[startup+882.3 s]
/proc/loadavg: 4.04 4.00 4.00 5/183 24877
/proc/meminfo: memFree=28014704/32873844 swapFree=7112/7112
[pid=24823] ppid=24821 vsize=2279252 CPUtime=1764.06 cores=1,3,5,7
/proc/24823/stat : 24823 (pwbo2.01) S 24821 24823 22874 0 -1 4202496 550311 0 0 0 176102 304 0 0 20 0 3 0 286629301 2333954048 544185 33554432000 4194304 5964478 140737292666016 140737292665536 4546669 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/24823/statm: 569813 544185 198 433 0 569377 0
[pid=24823/tid=24825] ppid=24821 vsize=2279252 CPUtime=879.84 cores=1,3,5,7
/proc/24823/task/24825/stat : 24825 (pwbo2.01) R 24821 24823 22874 0 -1 4202560 331389 0 0 0 87772 212 0 0 20 0 3 0 286629302 2333954048 544185 33554432000 4194304 5964478 140737292666016 139816985937912 4399904 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
[pid=24823/tid=24826] ppid=24821 vsize=2279252 CPUtime=879.85 cores=1,3,5,7
/proc/24823/task/24826/stat : 24826 (pwbo2.01) R 24821 24823 22874 0 -1 4202560 217831 0 0 0 87868 117 0 0 20 0 3 0 286629302 2333954048 544185 33554432000 4194304 5964478 140737292666016 139816975448408 4391496 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 1764.06
Current children cumulated vsize (KiB) 2279252



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+900.3 s]
/proc/loadavg: 4.03 4.00 4.00 5/183 24877
/proc/meminfo: memFree=27916960/32873844 swapFree=7112/7112
[pid=24823] ppid=24821 vsize=2279252 CPUtime=1800.06 cores=1,3,5,7
/proc/24823/stat : 24823 (pwbo2.01) S 24821 24823 22874 0 -1 4202496 557177 0 0 0 179699 307 0 0 20 0 3 0 286629301 2333954048 551041 33554432000 4194304 5964478 140737292666016 140737292665536 4546669 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/24823/statm: 569813 551041 198 433 0 569377 0
[pid=24823/tid=24825] ppid=24821 vsize=2279252 CPUtime=897.79 cores=1,3,5,7
/proc/24823/task/24825/stat : 24825 (pwbo2.01) R 24821 24823 22874 0 -1 4202560 338255 0 0 0 89564 215 0 0 20 0 3 0 286629302 2333954048 551041 33554432000 4194304 5964478 140737292666016 139816985937912 4399904 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
[pid=24823/tid=24826] ppid=24821 vsize=2279252 CPUtime=897.81 cores=1,3,5,7
/proc/24823/task/24826/stat : 24826 (pwbo2.01) R 24821 24823 22874 0 -1 4202560 217831 0 0 0 89664 117 0 0 20 0 3 0 286629302 2333954048 551041 33554432000 4194304 5964478 140737292666016 139816975448408 4399904 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 1800.06
Current children cumulated vsize (KiB) 2279252

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

############
# WARNING:
# current cumulated CPU time (1797.93 s) is less than in the last sample (1800.06 s)
# The time of a child was probably not reported to its father.
# (see the two samples below)
# Adding the difference (2.12988 s) to the 'lost time'.

[startup+900.3 s]
/proc/loadavg: 4.03 4.00 4.00 5/183 24877
/proc/meminfo: memFree=27916960/32873844 swapFree=7112/7112
[pid=24823] ppid=24821 vsize=2279252 CPUtime=1800.06 cores=1,3,5,7
/proc/24823/stat : 24823 (pwbo2.01) S 24821 24823 22874 0 -1 4202496 557177 0 0 0 179699 307 0 0 20 0 3 0 286629301 2333954048 551041 33554432000 4194304 5964478 140737292666016 140737292665536 4546669 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/24823/statm: 569813 551041 198 433 0 569377 0
[pid=24823/tid=24825] ppid=24821 vsize=2279252 CPUtime=897.79 cores=1,3,5,7
/proc/24823/task/24825/stat : 24825 (pwbo2.01) R 24821 24823 22874 0 -1 4202560 338255 0 0 0 89564 215 0 0 20 0 3 0 286629302 2333954048 551041 33554432000 4194304 5964478 140737292666016 139816985937912 4399904 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
[pid=24823/tid=24826] ppid=24821 vsize=2279252 CPUtime=897.81 cores=1,3,5,7
/proc/24823/task/24826/stat : 24826 (pwbo2.01) R 24821 24823 22874 0 -1 4202560 217831 0 0 0 89664 117 0 0 20 0 3 0 286629302 2333954048 551041 33554432000 4194304 5964478 140737292666016 139816975448408 4399904 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 1800.06
Current children cumulated vsize (KiB) 2279252

[startup+900.412 s]
/proc/loadavg: 4.03 4.00 4.00 5/183 24877
/proc/meminfo: memFree=27916960/32873844 swapFree=7112/7112
[pid=24823] ppid=24821 vsize=0 CPUtime=1797.93 cores=1,3,5,7
/proc/24823/stat : 24823 (pwbo2.01) Z 24821 24823 22874 0 -1 4202508 557179 0 0 0 179463 330 0 0 20 0 2 0 286629301 0 0 33554432000 0 0 0 0 0 0 16384 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/24823/statm: 0 0 0 0 0 0 0
[pid=24823/tid=24825] ppid=24821 vsize=0 CPUtime=897.89 cores=1,3,5,7
/proc/24823/task/24825/stat : 24825 (pwbo2.01) R 24821 24823 22874 0 -1 4203588 338255 0 0 0 89564 225 0 0 20 0 2 0 286629302 0 0 33554432000 0 0 0 0 0 0 0 4096 16387 18446744073709551615 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1797.93
Current children cumulated vsize (KiB) 0
#
############


Solver just ended. Dumping a history of the last processes samples

[startup+900.412 s]
/proc/loadavg: 4.03 4.00 4.00 5/183 24877
/proc/meminfo: memFree=27916960/32873844 swapFree=7112/7112
[pid=24823] ppid=24821 vsize=0 CPUtime=1797.93 cores=1,3,5,7
/proc/24823/stat : 24823 (pwbo2.01) Z 24821 24823 22874 0 -1 4202508 557179 0 0 0 179463 330 0 0 20 0 2 0 286629301 0 0 33554432000 0 0 0 0 0 0 16384 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/24823/statm: 0 0 0 0 0 0 0
[pid=24823/tid=24825] ppid=24821 vsize=0 CPUtime=897.89 cores=1,3,5,7
/proc/24823/task/24825/stat : 24825 (pwbo2.01) R 24821 24823 22874 0 -1 4203588 338255 0 0 0 89564 225 0 0 20 0 2 0 286629302 0 0 33554432000 0 0 0 0 0 0 0 4096 16387 18446744073709551615 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1797.93
Current children cumulated vsize (KiB) 0

Child status: 0

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 24823 and gives
#  childrusage.ru_utime.tv_sec=1792
#  childrusage.ru_utime.tv_usec=295529
#  childrusage.ru_stime.tv_sec=3
#  childrusage.ru_stime.tv_usec=462473
# CPU time returned by wait4() is 1795.76
# while last known CPU time is 1797.93
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...


# WARNING:
# The CPU time of some children was not reported to their father
# (probably because of a missing or aborted wait()).
# This 'lost CPU time' is added to the watched process CPU time.
#  lost CPU time (s): 2.12988
#  lost CPU user time (s): 2.35999
#  lost CPU system time (s): -0.23

Real time (s): 900.434
CPU time (s): 1800.06
CPU user time (s): 1796.99
CPU system time (s): 3.07
CPU usage (%): 199.91
Max. virtual memory (cumulated for all children) (KiB): 2279252

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1792.3
system time used= 3.46247
maximum resident set size= 2204172
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 557179
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 1110
involuntary context switches= 2960

runsolver used 2.24166 second user time and 5.16322 second system time

The end

Launcher Data

Begin job on node132 at 2012-05-28 13:37:20
IDJOB=3712727
IDBENCH=79303
IDSOLVER=2292
FILE ID=node132/3712727-1338205040
RUNJOBID= node132-1338194011-22891
PBS_JOBID= 14624592
Free space on /tmp= 71632 MiB

SOLVER NAME= pwbo 2.01
BENCH NAME= PB10/normalized-PB10/SOFT-SMALLINT-LIN/PB06/submitted-PB06/namasivayam/tsp/normalized-t3002.11tsp11.1900545610--soft-0-100-0.wbo
COMMAND LINE= pwbo2.01 -file-format=wbo -verbosity=0 BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3712727-1338205040/watcher-3712727-1338205040 -o /tmp/evaluation-result-3712727-1338205040/solver-3712727-1338205040 -C 1800 -W 1900 -M 15500  pwbo2.01 -file-format=wbo -verbosity=0 HOME/instance-3712727-1338205040.wbo

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= aacdee42f12f02195344334122667810
RANDOM SEED=1409733242

node132.alineos.net Linux 2.6.32-71.29.1.el6.x86_64 #1 SMP Mon Jun 27 19:49:27 BST 2011

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.832
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.66
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.832
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.832
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.56
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.832
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.56
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.832
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.832
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.56
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.832
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.832
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32873844 kB
MemFree:        29879756 kB
Buffers:          464476 kB
Cached:           204840 kB
SwapCached:         2284 kB
Active:          1932520 kB
Inactive:         169004 kB
Active(anon):    1424252 kB
Inactive(anon):     8148 kB
Active(file):     508268 kB
Inactive(file):   160856 kB
Unevictable:        7112 kB
Mlocked:            7112 kB
SwapTotal:      67108856 kB
SwapFree:       67103740 kB
Dirty:              5464 kB
Writeback:             0 kB
AnonPages:       1435228 kB
Mapped:            11784 kB
Shmem:                 8 kB
Slab:             750516 kB
SReclaimable:     192216 kB
SUnreclaim:       558300 kB
KernelStack:        1488 kB
PageTables:         6792 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83545776 kB
Committed_AS:     167636 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      346376 kB
VmallocChunk:   34341987860 kB
HardwareCorrupted:     0 kB
AnonHugePages:     16384 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:        7872 kB
DirectMap2M:    33538048 kB

Free space on /tmp at the end= 71628 MiB
End job on node132 at 2012-05-28 13:52:22