Trace number 3371004

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
Plingeling 587f (fixed)? (TO) 4800.47 1203.96

General information on the benchmark

NameSAT05/crafted/lynce05/social-golfer-problem/
sgp_5-6-8.shuffled-as.sat05-2669.cnf
MD5SUM4229175ff4382a4625ce92a19d20dde4
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark135.322
Satisfiable
(Un)Satisfiability was proved
Number of variables58560
Number of clauses778800
Sum of the clauses size1766280
Maximum clause length48
Minimum clause length1
Number of clauses of size 196
Number of clauses of size 2599208
Number of clauses of size 3177096
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 52400

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3371004-1305431774/watcher-3371004-1305431774 -o /tmp/evaluation-result-3371004-1305431774/solver-3371004-1305431774 -C 4800 -W 1300 -M 15500 plingeling -t 4 HOME/instance-3371004-1305431774.cnf 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 4.45 6.81 7.22 5/288 12473
/proc/meminfo: memFree=21455012/32951124 swapFree=66457188/67111528
[pid=12473] ppid=12471 vsize=14028 CPUtime=0 cores=1,3,5,7
/proc/12473/stat : 12473 (plingeling) R 12471 12473 4856 0 -1 4202496 1601 1251 0 0 0 0 0 0 24 0 1 0 654775599 14364672 1531 33554432000 4194304 4417452 140733942156064 18446744073709551615 232335892224 0 0 4096 17442 0 0 0 17 5 0 0 0
/proc/12473/statm: 3507 1531 149 55 0 1393 0

[startup+0.107125 s]
/proc/loadavg: 4.45 6.81 7.22 5/288 12473
/proc/meminfo: memFree=21455012/32951124 swapFree=66457188/67111528
[pid=12473] ppid=12471 vsize=32524 CPUtime=0.09 cores=1,3,5,7
/proc/12473/stat : 12473 (plingeling) R 12471 12473 4856 0 -1 4202496 6243 1251 0 0 9 0 0 0 24 0 1 0 654775599 33304576 6155 33554432000 4194304 4417452 140733942156064 18446744073709551615 4231321 0 0 4096 17442 0 0 0 17 5 0 0 0
/proc/12473/statm: 8131 6155 149 55 0 6017 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 32524

[startup+0.201108 s]
/proc/loadavg: 4.45 6.81 7.22 5/288 12473
/proc/meminfo: memFree=21455012/32951124 swapFree=66457188/67111528
[pid=12473] ppid=12471 vsize=36620 CPUtime=0.19 cores=1,3,5,7
/proc/12473/stat : 12473 (plingeling) R 12471 12473 4856 0 -1 4202496 7267 1251 0 0 18 1 0 0 24 0 1 0 654775599 37498880 7179 33554432000 4194304 4417452 140733942156064 18446744073709551615 232335892224 0 0 4096 17442 0 0 0 17 5 0 0 0
/proc/12473/statm: 9155 7179 149 55 0 7041 0
Current children cumulated CPU time (s) 0.19
Current children cumulated vsize (KiB) 36620

[startup+0.301089 s]
/proc/loadavg: 4.45 6.81 7.22 5/288 12473
/proc/meminfo: memFree=21455012/32951124 swapFree=66457188/67111528
[pid=12473] ppid=12471 vsize=44812 CPUtime=0.28 cores=1,3,5,7
/proc/12473/stat : 12473 (plingeling) R 12471 12473 4856 0 -1 4202496 9315 1251 0 0 27 1 0 0 25 0 1 0 654775599 45887488 9227 33554432000 4194304 4417452 140733942156064 18446744073709551615 4231468 0 0 4096 17442 0 0 0 17 5 0 0 0
/proc/12473/statm: 11203 9227 149 55 0 9089 0
Current children cumulated CPU time (s) 0.28
Current children cumulated vsize (KiB) 44812

[startup+0.701018 s]
/proc/loadavg: 4.45 6.81 7.22 5/288 12473
/proc/meminfo: memFree=21455012/32951124 swapFree=66457188/67111528
[pid=12473] ppid=12471 vsize=61784 CPUtime=0.69 cores=1,3,5,7
/proc/12473/stat : 12473 (plingeling) R 12471 12473 4856 0 -1 4202496 13558 1251 0 0 67 2 0 0 25 0 1 0 654775599 63266816 13470 33554432000 4194304 4417452 140733942156064 18446744073709551615 4231321 0 0 4096 17442 0 0 0 17 5 0 0 0
/proc/12473/statm: 15446 13470 149 55 0 13332 0
Current children cumulated CPU time (s) 0.69
Current children cumulated vsize (KiB) 61784

[startup+1.50083 s]
/proc/loadavg: 4.45 6.81 7.22 6/289 12479
/proc/meminfo: memFree=21369700/32951124 swapFree=66457188/67111528
[pid=12473] ppid=12471 vsize=136456 CPUtime=1.61 cores=1,3,5,7
/proc/12473/stat : 12473 (plingeling) S 12471 12473 4856 0 -1 4202496 22400 1251 0 0 158 3 0 0 25 0 5 0 654775599 139730944 21911 33554432000 4194304 4417452 140733942156064 18446744073709551615 232347695077 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/12473/statm: 34114 21911 158 55 0 32000 0
Current children cumulated CPU time (s) 1.61
Current children cumulated vsize (KiB) 136456

[startup+3.10055 s]
/proc/loadavg: 4.45 6.81 7.22 9/293 12483
/proc/meminfo: memFree=21362476/32951124 swapFree=66457188/67111528
[pid=12473] ppid=12471 vsize=209600 CPUtime=8.01 cores=1,3,5,7
/proc/12473/stat : 12473 (plingeling) S 12471 12473 4856 0 -1 4202496 33731 1251 0 0 796 5 0 0 25 0 5 0 654775599 214630400 24289 33554432000 4194304 4417452 140733942156064 18446744073709551615 232347695077 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/12473/statm: 52400 24289 174 55 0 50286 0
[pid=12473/tid=12480] ppid=12471 vsize=209600 CPUtime=1.64 cores=1,3,5,7
/proc/12473/task/12480/stat : 12480 (plingeling) R 12471 12473 4856 0 -1 4202560 1378 1251 0 0 164 0 0 0 20 0 5 0 654775744 214630400 24289 33554432000 4194304 4417452 140733942156064 18446744073709551615 4282405 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=12473/tid=12481] ppid=12471 vsize=209600 CPUtime=1.62 cores=1,3,5,7
/proc/12473/task/12481/stat : 12481 (plingeling) R 12471 12473 4856 0 -1 4202560 2367 1251 0 0 162 0 0 0 25 0 5 0 654775744 214630400 24289 33554432000 4194304 4417452 140733942156064 18446744073709551615 4290650 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=12473/tid=12482] ppid=12471 vsize=209600 CPUtime=1.63 cores=1,3,5,7
/proc/12473/task/12482/stat : 12482 (plingeling) R 12471 12473 4856 0 -1 4202560 3901 1251 0 0 163 0 0 0 25 0 5 0 654775744 214630400 24289 33554432000 4194304 4417452 140733942156064 18446744073709551615 4290744 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=12473/tid=12483] ppid=12471 vsize=209600 CPUtime=1.63 cores=1,3,5,7
/proc/12473/task/12483/stat : 12483 (plingeling) R 12471 12473 4856 0 -1 4202560 4291 1251 0 0 163 0 0 0 25 0 5 0 654775744 214630400 24289 33554432000 4194304 4417452 140733942156064 18446744073709551615 4353632 0 0 4096 17442 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 8.01
Current children cumulated vsize (KiB) 209600

[startup+6.30098 s]
/proc/loadavg: 4.73 6.83 7.23 9/293 12483
/proc/meminfo: memFree=21331012/32951124 swapFree=66457188/67111528
[pid=12473] ppid=12471 vsize=219020 CPUtime=20.77 cores=1,3,5,7
/proc/12473/stat : 12473 (plingeling) S 12471 12473 4856 0 -1 4202496 52616 1251 0 0 2070 7 0 0 25 0 5 0 654775599 224276480 26431 33554432000 4194304 4417452 140733942156064 18446744073709551615 232347695077 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/12473/statm: 54755 26431 180 55 0 52641 0
[pid=12473/tid=12480] ppid=12471 vsize=219020 CPUtime=4.83 cores=1,3,5,7
/proc/12473/task/12480/stat : 12480 (plingeling) R 12471 12473 4856 0 -1 4202560 6155 1251 0 0 483 0 0 0 25 0 5 0 654775744 224276480 26431 33554432000 4194304 4417452 140733942156064 18446744073709551615 4249991 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=12473/tid=12481] ppid=12471 vsize=219020 CPUtime=4.79 cores=1,3,5,7
/proc/12473/task/12481/stat : 12481 (plingeling) R 12471 12473 4856 0 -1 4202560 10443 1251 0 0 478 1 0 0 25 0 5 0 654775744 224276480 26431 33554432000 4194304 4417452 140733942156064 18446744073709551615 4248897 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=12473/tid=12482] ppid=12471 vsize=219020 CPUtime=4.83 cores=1,3,5,7
/proc/12473/task/12482/stat : 12482 (plingeling) R 12471 12473 4856 0 -1 4202560 8445 1251 0 0 482 1 0 0 25 0 5 0 654775744 224276480 26431 33554432000 4194304 4417452 140733942156064 18446744073709551615 4232787 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=12473/tid=12483] ppid=12471 vsize=219020 CPUtime=4.83 cores=1,3,5,7
/proc/12473/task/12483/stat : 12483 (plingeling) R 12471 12473 4856 0 -1 4202560 5779 1251 0 0 483 0 0 0 25 0 5 0 654775744 224276480 26431 33554432000 4194304 4417452 140733942156064 18446744073709551615 4364533 0 0 4096 17442 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 20.77
Current children cumulated vsize (KiB) 219020

[startup+12.7008 s]
/proc/loadavg: 4.99 6.85 7.23 9/293 12483
/proc/meminfo: memFree=21282556/32951124 swapFree=66457188/67111528
[pid=12473] ppid=12471 vsize=261216 CPUtime=46.31 cores=1,3,5,7
/proc/12473/stat : 12473 (plingeling) S 12471 12473 4856 0 -1 4202496 63731 1251 0 0 4622 9 0 0 25 0 5 0 654775599 267485184 36980 33554432000 4194304 4417452 140733942156064 18446744073709551615 232347695077 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/12473/statm: 65304 36980 180 55 0 63190 0
[pid=12473/tid=12480] ppid=12471 vsize=261216 CPUtime=11.24 cores=1,3,5,7
/proc/12473/task/12480/stat : 12480 (plingeling) R 12471 12473 4856 0 -1 4202560 7957 1251 0 0 1123 1 0 0 25 0 5 0 654775744 267485184 36980 33554432000 4194304 4417452 140733942156064 18446744073709551615 4251950 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=12473/tid=12481] ppid=12471 vsize=261216 CPUtime=11.13 cores=1,3,5,7
/proc/12473/task/12481/stat : 12481 (plingeling) R 12471 12473 4856 0 -1 4202560 11426 1251 0 0 1112 1 0 0 25 0 5 0 654775744 267485184 36980 33554432000 4194304 4417452 140733942156064 18446744073709551615 4310641 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=12473/tid=12482] ppid=12471 vsize=261216 CPUtime=11.23 cores=1,3,5,7
/proc/12473/task/12482/stat : 12482 (plingeling) R 12471 12473 4856 0 -1 4202560 12697 1251 0 0 1122 1 0 0 25 0 5 0 654775744 267485184 36980 33554432000 4194304 4417452 140733942156064 18446744073709551615 4232651 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=12473/tid=12483] ppid=12471 vsize=261216 CPUtime=11.24 cores=1,3,5,7
/proc/12473/task/12483/stat : 12483 (plingeling) R 12471 12473 4856 0 -1 4202560 9857 1251 0 0 1123 1 0 0 25 0 5 0 654775744 267485184 36980 33554432000 4194304 4417452 140733942156064 18446744073709551615 4236649 0 0 4096 17442 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 46.31
Current children cumulated vsize (KiB) 261216

[startup+25.5006 s]
/proc/loadavg: 5.72 6.92 7.25 10/293 12484
/proc/meminfo: memFree=21201092/32951124 swapFree=66457188/67111528
[pid=12473] ppid=12471 vsize=294244 CPUtime=97.39 cores=1,3,5,7
/proc/12473/stat : 12473 (plingeling) S 12471 12473 4856 0 -1 4202496 72496 1251 0 0 9729 10 0 0 25 0 5 0 654775599 301305856 45242 33554432000 4194304 4417452 140733942156064 18446744073709551615 232347695077 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/12473/statm: 73561 45242 180 55 0 71447 0
[pid=12473/tid=12480] ppid=12471 vsize=294244 CPUtime=24.04 cores=1,3,5,7
/proc/12473/task/12480/stat : 12480 (plingeling) R 12471 12473 4856 0 -1 4202560 9931 1251 0 0 2403 1 0 0 25 0 5 0 654775744 301305856 45242 33554432000 4194304 4417452 140733942156064 18446744073709551615 4331751 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=12473/tid=12481] ppid=12471 vsize=294244 CPUtime=23.81 cores=1,3,5,7
/proc/12473/task/12481/stat : 12481 (plingeling) R 12471 12473 4856 0 -1 4202560 13610 1251 0 0 2380 1 0 0 25 0 5 0 654775744 301305856 45242 33554432000 4194304 4417452 140733942156064 18446744073709551615 4264940 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=12473/tid=12482] ppid=12471 vsize=294244 CPUtime=24.03 cores=1,3,5,7
/proc/12473/task/12482/stat : 12482 (plingeling) R 12471 12473 4856 0 -1 4202560 12808 1251 0 0 2402 1 0 0 25 0 5 0 654775744 301305856 45242 33554432000 4194304 4417452 140733942156064 18446744073709551615 4232680 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=12473/tid=12483] ppid=12471 vsize=294244 CPUtime=24.03 cores=1,3,5,7
/proc/12473/task/12483/stat : 12483 (plingeling) R 12471 12473 4856 0 -1 4202560 14353 1251 0 0 2402 1 0 0 25 0 5 0 654775744 301305856 45242 33554432000 4194304 4417452 140733942156064 18446744073709551615 4236961 0 0 4096 17442 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 97.39
Current children cumulated vsize (KiB) 294244

[startup+51.101 s]
/proc/loadavg: 6.50 7.01 7.27 9/293 12484
/proc/meminfo: memFree=21146240/32951124 swapFree=66457188/67111528
[pid=12473] ppid=12471 vsize=337644 CPUtime=199.56 cores=1,3,5,7
/proc/12473/stat : 12473 (plingeling) S 12471 12473 4856 0 -1 4202496 86498 1251 0 0 19945 11 0 0 25 0 5 0 654775599 345747456 56092 33554432000 4194304 4417452 140733942156064 18446744073709551615 232347695077 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/12473/statm: 84411 56092 180 55 0 82297 0
[pid=12473/tid=12480] ppid=12471 vsize=337644 CPUtime=49.64 cores=1,3,5,7
/proc/12473/task/12480/stat : 12480 (plingeling) R 12471 12473 4856 0 -1 4202560 11836 1251 0 0 4963 1 0 0 25 0 5 0 654775744 345747456 56092 33554432000 4194304 4417452 140733942156064 18446744073709551615 4365973 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=12473/tid=12481] ppid=12471 vsize=337644 CPUtime=49.18 cores=1,3,5,7
/proc/12473/task/12481/stat : 12481 (plingeling) R 12471 12473 4856 0 -1 4202560 15129 1251 0 0 4917 1 0 0 25 0 5 0 654775744 345747456 56092 33554432000 4194304 4417452 140733942156064 18446744073709551615 4366079 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=12473/tid=12482] ppid=12471 vsize=337644 CPUtime=49.63 cores=1,3,5,7
/proc/12473/task/12482/stat : 12482 (plingeling) R 12471 12473 4856 0 -1 4202560 13079 1251 0 0 4962 1 0 0 25 0 5 0 654775744 345747456 56092 33554432000 4194304 4417452 140733942156064 18446744073709551615 4364641 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=12473/tid=12483] ppid=12471 vsize=337644 CPUtime=49.63 cores=1,3,5,7
/proc/12473/task/12483/stat : 12483 (plingeling) R 12471 12473 4856 0 -1 4202560 24660 1251 0 0 4961 2 0 0 25 0 5 0 654775744 345747456 56092 33554432000 4194304 4417452 140733942156064 18446744073709551615 4357410 0 0 4096 17442 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 199.56
Current children cumulated vsize (KiB) 337644

[startup+102.301 s]
/proc/loadavg: 7.53 7.22 7.32 9/293 12486
/proc/meminfo: memFree=21022588/32951124 swapFree=66457188/67111528
[pid=12473] ppid=12471 vsize=368156 CPUtime=403.93 cores=1,3,5,7
/proc/12473/stat : 12473 (plingeling) S 12471 12473 4856 0 -1 4202496 150015 1251 0 0 40373 20 0 0 25 0 5 0 654775599 376991744 64712 33554432000 4194304 4417452 140733942156064 18446744073709551615 232347695077 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/12473/statm: 92039 64712 180 55 0 89925 0
[pid=12473/tid=12480] ppid=12471 vsize=368156 CPUtime=100.85 cores=1,3,5,7
/proc/12473/task/12480/stat : 12480 (plingeling) R 12471 12473 4856 0 -1 4202560 23839 1251 0 0 10082 3 0 0 25 0 5 0 654775744 376991744 64712 33554432000 4194304 4417452 140733942156064 18446744073709551615 4275932 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=12473/tid=12481] ppid=12471 vsize=368156 CPUtime=99.92 cores=1,3,5,7
/proc/12473/task/12481/stat : 12481 (plingeling) R 12471 12473 4856 0 -1 4202560 26119 1251 0 0 9989 3 0 0 25 0 5 0 654775744 376991744 64712 33554432000 4194304 4417452 140733942156064 18446744073709551615 4232651 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=12473/tid=12482] ppid=12471 vsize=368156 CPUtime=100.84 cores=1,3,5,7
/proc/12473/task/12482/stat : 12482 (plingeling) R 12471 12473 4856 0 -1 4202560 22583 1251 0 0 10081 3 0 0 25 0 5 0 654775744 376991744 64712 33554432000 4194304 4417452 140733942156064 18446744073709551615 4364817 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=12473/tid=12483] ppid=12471 vsize=368156 CPUtime=100.85 cores=1,3,5,7
/proc/12473/task/12483/stat : 12483 (plingeling) R 12471 12473 4856 0 -1 4202560 55680 1251 0 0 10079 6 0 0 25 0 5 0 654775744 376991744 64712 33554432000 4194304 4417452 140733942156064 18446744073709551615 4250476 0 0 4096 17442 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 403.93
Current children cumulated vsize (KiB) 368156

[startup+162.3 s]
/proc/loadavg: 7.92 7.39 7.37 9/293 12487
/proc/meminfo: memFree=20938616/32951124 swapFree=66457188/67111528
[pid=12473] ppid=12471 vsize=483620 CPUtime=643.36 cores=1,3,5,7
/proc/12473/stat : 12473 (plingeling) S 12471 12473 4856 0 -1 4202496 250083 1251 0 0 64305 31 0 0 25 0 5 0 654775599 495226880 92586 33554432000 4194304 4417452 140733942156064 18446744073709551615 232347695077 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/12473/statm: 120905 92586 180 55 0 118791 0
[pid=12473/tid=12480] ppid=12471 vsize=483620 CPUtime=160.84 cores=1,3,5,7
/proc/12473/task/12480/stat : 12480 (plingeling) R 12471 12473 4856 0 -1 4202560 43241 1251 0 0 16079 5 0 0 25 0 5 0 654775744 495226880 92586 33554432000 4194304 4417452 140733942156064 18446744073709551615 4366048 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=12473/tid=12481] ppid=12471 vsize=483620 CPUtime=159.37 cores=1,3,5,7
/proc/12473/task/12481/stat : 12481 (plingeling) R 12471 12473 4856 0 -1 4202560 42008 1251 0 0 15932 5 0 0 25 0 5 0 654775744 495226880 92586 33554432000 4194304 4417452 140733942156064 18446744073709551615 4259600 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=12473/tid=12482] ppid=12471 vsize=483620 CPUtime=160.83 cores=1,3,5,7
/proc/12473/task/12482/stat : 12482 (plingeling) R 12471 12473 4856 0 -1 4202560 41625 1251 0 0 16078 5 0 0 25 0 5 0 654775744 495226880 92586 33554432000 4194304 4417452 140733942156064 18446744073709551615 4232804 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=12473/tid=12483] ppid=12471 vsize=483620 CPUtime=160.84 cores=1,3,5,7
/proc/12473/task/12483/stat : 12483 (plingeling) R 12471 12473 4856 0 -1 4202560 101415 1251 0 0 16073 11 0 0 25 0 5 0 654775744 495226880 92586 33554432000 4194304 4417452 140733942156064 18446744073709551615 4364453 0 0 4096 17442 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 643.36
Current children cumulated vsize (KiB) 483620

[startup+222.311 s]
/proc/loadavg: 8.05 7.52 7.42 9/293 12489
/proc/meminfo: memFree=20826244/32951124 swapFree=66457188/67111528
[pid=12473] ppid=12471 vsize=487108 CPUtime=882.84 cores=1,3,5,7
/proc/12473/stat : 12473 (plingeling) S 12471 12473 4856 0 -1 4202496 330752 1251 0 0 88244 40 0 0 25 0 5 0 654775599 498798592 93458 33554432000 4194304 4417452 140733942156064 18446744073709551615 232347695077 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/12473/statm: 121777 93458 180 55 0 119663 0
[pid=12473/tid=12480] ppid=12471 vsize=487108 CPUtime=220.84 cores=1,3,5,7
/proc/12473/task/12480/stat : 12480 (plingeling) R 12471 12473 4856 0 -1 4202560 55973 1251 0 0 22078 6 0 0 25 0 5 0 654775744 498798592 93458 33554432000 4194304 4417452 140733942156064 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 5 0 0 0

################
# More data... #
################

[pid=12473/tid=12481] ppid=12471 vsize=841148 CPUtime=694.47 cores=1,3,5,7
/proc/12473/task/12481/stat : 12481 (plingeling) R 12471 12473 4856 0 -1 4202560 260667 1251 0 0 69412 35 0 0 25 0 5 0 654775744 861335552 181968 33554432000 4194304 4417452 140733942156064 18446744073709551615 4305888 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=12473/tid=12482] ppid=12471 vsize=841148 CPUtime=700.83 cores=1,3,5,7
/proc/12473/task/12482/stat : 12482 (plingeling) R 12471 12473 4856 0 -1 4202560 395721 1251 0 0 70030 53 0 0 25 0 5 0 654775744 861335552 181968 33554432000 4194304 4417452 140733942156064 18446744073709551615 4232609 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=12473/tid=12483] ppid=12471 vsize=841148 CPUtime=700.84 cores=1,3,5,7
/proc/12473/task/12483/stat : 12483 (plingeling) R 12471 12473 4856 0 -1 4202560 248066 1251 0 0 70055 29 0 0 25 0 5 0 654775744 861335552 181968 33554432000 4194304 4417452 140733942156064 18446744073709551615 4364550 0 0 4096 17442 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 2798.47
Current children cumulated vsize (KiB) 841148

[startup+762.301 s]
/proc/loadavg: 8.29 8.13 7.77 9/293 12515
/proc/meminfo: memFree=20133288/32951124 swapFree=66457188/67111528
[pid=12473] ppid=12471 vsize=837096 CPUtime=3037.96 cores=1,3,5,7
/proc/12473/stat : 12473 (plingeling) S 12471 12473 4856 0 -1 4202496 1385474 1251 0 0 303609 187 0 0 25 0 5 0 654775599 857186304 180955 33554432000 4194304 4417452 140733942156064 18446744073709551615 232347695077 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/12473/statm: 209274 180955 180 55 0 207160 0
[pid=12473/tid=12480] ppid=12471 vsize=837096 CPUtime=760.85 cores=1,3,5,7
/proc/12473/task/12480/stat : 12480 (plingeling) R 12471 12473 4856 0 -1 4202560 382034 1251 0 0 76031 54 0 0 25 0 5 0 654775744 857186304 180955 33554432000 4194304 4417452 140733942156064 18446744073709551615 4364741 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=12473/tid=12481] ppid=12471 vsize=837096 CPUtime=753.93 cores=1,3,5,7
/proc/12473/task/12481/stat : 12481 (plingeling) R 12471 12473 4856 0 -1 4202560 283427 1251 0 0 75355 38 0 0 25 0 5 0 654775744 857186304 180955 33554432000 4194304 4417452 140733942156064 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=12473/tid=12482] ppid=12471 vsize=837096 CPUtime=760.85 cores=1,3,5,7
/proc/12473/task/12482/stat : 12482 (plingeling) R 12471 12473 4856 0 -1 4202560 427554 1251 0 0 76028 57 0 0 25 0 5 0 654775744 857186304 180955 33554432000 4194304 4417452 140733942156064 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=12473/tid=12483] ppid=12471 vsize=837096 CPUtime=760.86 cores=1,3,5,7
/proc/12473/task/12483/stat : 12483 (plingeling) R 12471 12473 4856 0 -1 4202560 270665 1251 0 0 76053 33 0 0 25 0 5 0 654775744 857186304 180955 33554432000 4194304 4417452 140733942156064 18446744073709551615 4236906 0 0 4096 17442 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 3037.96
Current children cumulated vsize (KiB) 837096

[startup+822.301 s]
/proc/loadavg: 8.22 8.14 7.79 9/293 12517
/proc/meminfo: memFree=19954196/32951124 swapFree=66457188/67111528
[pid=12473] ppid=12471 vsize=842292 CPUtime=3277.4 cores=1,3,5,7
/proc/12473/stat : 12473 (plingeling) S 12471 12473 4856 0 -1 4202496 1481545 1251 0 0 327538 202 0 0 25 0 5 0 654775599 862507008 182254 33554432000 4194304 4417452 140733942156064 18446744073709551615 232347695077 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/12473/statm: 210573 182254 180 55 0 208459 0
[pid=12473/tid=12480] ppid=12471 vsize=842292 CPUtime=820.85 cores=1,3,5,7
/proc/12473/task/12480/stat : 12480 (plingeling) R 12471 12473 4856 0 -1 4202560 418026 1251 0 0 82026 59 0 0 25 0 5 0 654775744 862507008 182254 33554432000 4194304 4417452 140733942156064 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=12473/tid=12481] ppid=12471 vsize=842292 CPUtime=813.39 cores=1,3,5,7
/proc/12473/task/12481/stat : 12481 (plingeling) R 12471 12473 4856 0 -1 4202560 302416 1251 0 0 81298 41 0 0 25 0 5 0 654775744 862507008 182254 33554432000 4194304 4417452 140733942156064 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=12473/tid=12482] ppid=12471 vsize=842292 CPUtime=820.84 cores=1,3,5,7
/proc/12473/task/12482/stat : 12482 (plingeling) R 12471 12473 4856 0 -1 4202560 455080 1251 0 0 82022 62 0 0 25 0 5 0 654775744 862507008 182254 33554432000 4194304 4417452 140733942156064 18446744073709551615 4366391 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=12473/tid=12483] ppid=12471 vsize=842292 CPUtime=820.85 cores=1,3,5,7
/proc/12473/task/12483/stat : 12483 (plingeling) R 12471 12473 4856 0 -1 4202560 284229 1251 0 0 82050 35 0 0 25 0 5 0 654775744 862507008 182254 33554432000 4194304 4417452 140733942156064 18446744073709551615 4364604 0 0 4096 17442 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 3277.4
Current children cumulated vsize (KiB) 842292

[startup+882.311 s]
/proc/loadavg: 8.23 8.16 7.82 9/293 12519
/proc/meminfo: memFree=19829044/32951124 swapFree=66457188/67111528
[pid=12473] ppid=12471 vsize=984548 CPUtime=3516.9 cores=1,3,5,7
/proc/12473/stat : 12473 (plingeling) S 12471 12473 4856 0 -1 4202496 1588060 1251 0 0 351473 217 0 0 25 0 5 0 654775599 1008177152 217818 33554432000 4194304 4417452 140733942156064 18446744073709551615 232347695077 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/12473/statm: 246137 217818 180 55 0 244023 0
[pid=12473/tid=12480] ppid=12471 vsize=984548 CPUtime=880.86 cores=1,3,5,7
/proc/12473/task/12480/stat : 12480 (plingeling) R 12471 12473 4856 0 -1 4202560 447065 1251 0 0 88023 63 0 0 25 0 5 0 654775744 1008177152 217818 33554432000 4194304 4417452 140733942156064 18446744073709551615 4356992 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=12473/tid=12481] ppid=12471 vsize=984548 CPUtime=872.85 cores=1,3,5,7
/proc/12473/task/12481/stat : 12481 (plingeling) R 12471 12473 4856 0 -1 4202560 339313 1251 0 0 87238 47 0 0 25 0 5 0 654775744 1008177152 217818 33554432000 4194304 4417452 140733942156064 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=12473/tid=12482] ppid=12471 vsize=984548 CPUtime=880.85 cores=1,3,5,7
/proc/12473/task/12482/stat : 12482 (plingeling) R 12471 12473 4856 0 -1 4202560 464650 1251 0 0 88022 63 0 0 25 0 5 0 654775744 1008177152 217818 33554432000 4194304 4417452 140733942156064 18446744073709551615 4364835 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=12473/tid=12483] ppid=12471 vsize=984548 CPUtime=880.86 cores=1,3,5,7
/proc/12473/task/12483/stat : 12483 (plingeling) R 12471 12473 4856 0 -1 4202560 315238 1251 0 0 88047 39 0 0 25 0 5 0 654775744 1008177152 217818 33554432000 4194304 4417452 140733942156064 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 3516.9
Current children cumulated vsize (KiB) 984548

[startup+942.301 s]
/proc/loadavg: 8.18 8.16 7.84 9/293 12520
/proc/meminfo: memFree=19639412/32951124 swapFree=66457188/67111528
[pid=12473] ppid=12471 vsize=1144740 CPUtime=3756.32 cores=1,3,5,7
/proc/12473/stat : 12473 (plingeling) S 12471 12473 4856 0 -1 4202496 1707294 1251 0 0 375398 234 0 0 25 0 5 0 654775599 1172213760 257866 33554432000 4194304 4417452 140733942156064 18446744073709551615 232347695077 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/12473/statm: 286185 257866 180 55 0 284071 0
[pid=12473/tid=12480] ppid=12471 vsize=1144740 CPUtime=940.85 cores=1,3,5,7
/proc/12473/task/12480/stat : 12480 (plingeling) R 12471 12473 4856 0 -1 4202560 463845 1251 0 0 94020 65 0 0 25 0 5 0 654775744 1172213760 257866 33554432000 4194304 4417452 140733942156064 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=12473/tid=12481] ppid=12471 vsize=1144740 CPUtime=932.29 cores=1,3,5,7
/proc/12473/task/12481/stat : 12481 (plingeling) R 12471 12473 4856 0 -1 4202560 413319 1251 0 0 93172 57 0 0 25 0 5 0 654775744 1172213760 257866 33554432000 4194304 4417452 140733942156064 18446744073709551615 4364587 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=12473/tid=12482] ppid=12471 vsize=1144740 CPUtime=940.84 cores=1,3,5,7
/proc/12473/task/12482/stat : 12482 (plingeling) R 12471 12473 4856 0 -1 4202560 481685 1251 0 0 94019 65 0 0 25 0 5 0 654775744 1172213760 257866 33554432000 4194304 4417452 140733942156064 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=12473/tid=12483] ppid=12471 vsize=1144740 CPUtime=940.85 cores=1,3,5,7
/proc/12473/task/12483/stat : 12483 (plingeling) R 12471 12473 4856 0 -1 4202560 326651 1251 0 0 94045 40 0 0 25 0 5 0 654775744 1172213760 257866 33554432000 4194304 4417452 140733942156064 18446744073709551615 4237290 0 0 4096 17442 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 3756.32
Current children cumulated vsize (KiB) 1144740

[startup+1002.3 s]
/proc/loadavg: 8.25 8.18 7.86 9/293 12522
/proc/meminfo: memFree=19399440/32951124 swapFree=66457188/67111528
[pid=12473] ppid=12471 vsize=1272088 CPUtime=3995.78 cores=1,3,5,7
/proc/12473/stat : 12473 (plingeling) S 12471 12473 4856 0 -1 4202496 1852058 1251 0 0 399324 254 0 0 25 0 5 0 654775599 1302618112 289703 33554432000 4194304 4417452 140733942156064 18446744073709551615 232347695077 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/12473/statm: 318022 289703 180 55 0 315908 0
[pid=12473/tid=12480] ppid=12471 vsize=1272088 CPUtime=1000.85 cores=1,3,5,7
/proc/12473/task/12480/stat : 12480 (plingeling) R 12471 12473 4856 0 -1 4202560 479718 1251 0 0 100018 67 0 0 25 0 5 0 654775744 1302618112 289703 33554432000 4194304 4417452 140733942156064 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=12473/tid=12481] ppid=12471 vsize=1272088 CPUtime=991.74 cores=1,3,5,7
/proc/12473/task/12481/stat : 12481 (plingeling) R 12471 12473 4856 0 -1 4202560 453639 1251 0 0 99112 62 0 0 25 0 5 0 654775744 1302618112 289703 33554432000 4194304 4417452 140733942156064 18446744073709551615 4232595 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=12473/tid=12482] ppid=12471 vsize=1272088 CPUtime=1000.84 cores=1,3,5,7
/proc/12473/task/12482/stat : 12482 (plingeling) R 12471 12473 4856 0 -1 4202560 558468 1251 0 0 100007 77 0 0 25 0 5 0 654775744 1302618112 289703 33554432000 4194304 4417452 140733942156064 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=12473/tid=12483] ppid=12471 vsize=1272088 CPUtime=1000.85 cores=1,3,5,7
/proc/12473/task/12483/stat : 12483 (plingeling) R 12471 12473 4856 0 -1 4202560 338439 1251 0 0 100043 42 0 0 25 0 5 0 654775744 1302618112 289703 33554432000 4194304 4417452 140733942156064 18446744073709551615 4366141 0 0 4096 17442 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 3995.78
Current children cumulated vsize (KiB) 1272088

[startup+1062.3 s]
/proc/loadavg: 8.13 8.16 7.87 9/293 12523
/proc/meminfo: memFree=19639224/32951124 swapFree=66457188/67111528
[pid=12473] ppid=12471 vsize=1193612 CPUtime=4235.24 cores=1,3,5,7
/proc/12473/stat : 12473 (plingeling) S 12471 12473 4856 0 -1 4202496 2031259 1251 0 0 423242 282 0 0 25 0 5 0 654775599 1222258688 270084 33554432000 4194304 4417452 140733942156064 18446744073709551615 232347695077 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/12473/statm: 298403 270084 180 55 0 296289 0
[pid=12473/tid=12480] ppid=12471 vsize=1193612 CPUtime=1060.85 cores=1,3,5,7
/proc/12473/task/12480/stat : 12480 (plingeling) R 12471 12473 4856 0 -1 4202560 543160 1251 0 0 106007 78 0 0 25 0 5 0 654775744 1222258688 270084 33554432000 4194304 4417452 140733942156064 18446744073709551615 4364798 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=12473/tid=12481] ppid=12471 vsize=1193612 CPUtime=1051.21 cores=1,3,5,7
/proc/12473/task/12481/stat : 12481 (plingeling) R 12471 12473 4856 0 -1 4202560 487001 1251 0 0 105054 67 0 0 25 0 5 0 654775744 1222258688 270084 33554432000 4194304 4417452 140733942156064 18446744073709551615 4366472 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=12473/tid=12482] ppid=12471 vsize=1193612 CPUtime=1060.85 cores=1,3,5,7
/proc/12473/task/12482/stat : 12482 (plingeling) R 12471 12473 4856 0 -1 4202560 628576 1251 0 0 105997 88 0 0 25 0 5 0 654775744 1222258688 270084 33554432000 4194304 4417452 140733942156064 18446744073709551615 4356934 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=12473/tid=12483] ppid=12471 vsize=1193612 CPUtime=1060.85 cores=1,3,5,7
/proc/12473/task/12483/stat : 12483 (plingeling) R 12471 12473 4856 0 -1 4202560 350728 1251 0 0 106041 44 0 0 25 0 5 0 654775744 1222258688 270084 33554432000 4194304 4417452 140733942156064 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 4235.24
Current children cumulated vsize (KiB) 1193612

[startup+1122.3 s]
/proc/loadavg: 8.09 8.14 7.89 9/293 12525
/proc/meminfo: memFree=19436452/32951124 swapFree=66457188/67111528
[pid=12473] ppid=12471 vsize=1180452 CPUtime=4474.7 cores=1,3,5,7
/proc/12473/stat : 12473 (plingeling) S 12471 12473 4856 0 -1 4202496 2176134 1251 0 0 447169 301 0 0 25 0 5 0 654775599 1208782848 266794 33554432000 4194304 4417452 140733942156064 18446744073709551615 232347695077 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/12473/statm: 295113 266794 180 55 0 292999 0
[pid=12473/tid=12480] ppid=12471 vsize=1180452 CPUtime=1120.85 cores=1,3,5,7
/proc/12473/task/12480/stat : 12480 (plingeling) R 12471 12473 4856 0 -1 4202560 580010 1251 0 0 112003 82 0 0 25 0 5 0 654775744 1208782848 266794 33554432000 4194304 4417452 140733942156064 18446744073709551615 4364737 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=12473/tid=12481] ppid=12471 vsize=1180452 CPUtime=1110.66 cores=1,3,5,7
/proc/12473/task/12481/stat : 12481 (plingeling) R 12471 12473 4856 0 -1 4202560 551728 1251 0 0 110990 76 0 0 25 0 5 0 654775744 1208782848 266794 33554432000 4194304 4417452 140733942156064 18446744073709551615 4354506 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=12473/tid=12482] ppid=12471 vsize=1180452 CPUtime=1120.85 cores=1,3,5,7
/proc/12473/task/12482/stat : 12482 (plingeling) R 12471 12473 4856 0 -1 4202560 671874 1251 0 0 111992 93 0 0 25 0 5 0 654775744 1208782848 266794 33554432000 4194304 4417452 140733942156064 18446744073709551615 4364829 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=12473/tid=12483] ppid=12471 vsize=1180452 CPUtime=1120.85 cores=1,3,5,7
/proc/12473/task/12483/stat : 12483 (plingeling) R 12471 12473 4856 0 -1 4202560 350728 1251 0 0 112041 44 0 0 25 0 5 0 654775744 1208782848 266794 33554432000 4194304 4417452 140733942156064 18446744073709551615 4364589 0 0 4096 17442 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 4474.7
Current children cumulated vsize (KiB) 1180452

[startup+1182.3 s]
/proc/loadavg: 8.07 8.13 7.90 9/293 12526
/proc/meminfo: memFree=19585340/32951124 swapFree=66457188/67111528
[pid=12473] ppid=12471 vsize=1128852 CPUtime=4714.17 cores=1,3,5,7
/proc/12473/stat : 12473 (plingeling) S 12471 12473 4856 0 -1 4202496 2298570 1251 0 0 471099 318 0 0 25 0 5 0 654775599 1155944448 253894 33554432000 4194304 4417452 140733942156064 18446744073709551615 232347695077 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/12473/statm: 282213 253894 180 55 0 280099 0
[pid=12473/tid=12480] ppid=12471 vsize=1128852 CPUtime=1180.86 cores=1,3,5,7
/proc/12473/task/12480/stat : 12480 (plingeling) R 12471 12473 4856 0 -1 4202560 624165 1251 0 0 117998 88 0 0 25 0 5 0 654775744 1155944448 253894 33554432000 4194304 4417452 140733942156064 18446744073709551615 4250977 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=12473/tid=12481] ppid=12471 vsize=1128852 CPUtime=1170.12 cores=1,3,5,7
/proc/12473/task/12481/stat : 12481 (plingeling) R 12471 12473 4856 0 -1 4202560 580677 1251 0 0 116931 81 0 0 25 0 5 0 654775744 1155944448 253894 33554432000 4194304 4417452 140733942156064 18446744073709551615 4364632 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=12473/tid=12482] ppid=12471 vsize=1128852 CPUtime=1180.85 cores=1,3,5,7
/proc/12473/task/12482/stat : 12482 (plingeling) R 12471 12473 4856 0 -1 4202560 710905 1251 0 0 117987 98 0 0 25 0 5 0 654775744 1155944448 253894 33554432000 4194304 4417452 140733942156064 18446744073709551615 4366385 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=12473/tid=12483] ppid=12471 vsize=1128852 CPUtime=1180.86 cores=1,3,5,7
/proc/12473/task/12483/stat : 12483 (plingeling) R 12471 12473 4856 0 -1 4202560 361029 1251 0 0 118040 46 0 0 25 0 5 0 654775744 1155944448 253894 33554432000 4194304 4417452 140733942156064 18446744073709551615 4364579 0 0 4096 17442 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 4714.17
Current children cumulated vsize (KiB) 1128852



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1203.9 s]
/proc/loadavg: 7.56 8.02 7.87 5/284 12545
/proc/meminfo: memFree=20449400/32951124 swapFree=66457188/67111528
[pid=12473] ppid=12471 vsize=1159840 CPUtime=4800.39 cores=1,3,5,7
/proc/12473/stat : 12473 (plingeling) S 12471 12473 4856 0 -1 4202496 2347277 1251 0 0 479714 325 0 0 25 0 5 0 654775599 1187676160 261641 33554432000 4194304 4417452 140733942156064 18446744073709551615 232347695077 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/12473/statm: 289960 261641 180 55 0 287846 0
[pid=12473/tid=12480] ppid=12471 vsize=1159840 CPUtime=1202.46 cores=1,3,5,7
/proc/12473/task/12480/stat : 12480 (plingeling) R 12471 12473 4856 0 -1 4202560 644809 1251 0 0 120155 91 0 0 25 0 5 0 654775744 1187676160 261641 33554432000 4194304 4417452 140733942156064 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=12473/tid=12481] ppid=12471 vsize=1159840 CPUtime=1191.52 cores=1,3,5,7
/proc/12473/task/12481/stat : 12481 (plingeling) R 12471 12473 4856 0 -1 4202560 599141 1251 0 0 119069 83 0 0 25 0 5 0 654775744 1187676160 261641 33554432000 4194304 4417452 140733942156064 18446744073709551615 4366385 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=12473/tid=12482] ppid=12471 vsize=1159840 CPUtime=1202.46 cores=1,3,5,7
/proc/12473/task/12482/stat : 12482 (plingeling) R 12471 12473 4856 0 -1 4202560 719097 1251 0 0 120146 100 0 0 25 0 5 0 654775744 1187676160 261641 33554432000 4194304 4417452 140733942156064 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=12473/tid=12483] ppid=12471 vsize=1159840 CPUtime=1202.47 cores=1,3,5,7
/proc/12473/task/12483/stat : 12483 (plingeling) R 12471 12473 4856 0 -1 4202560 362436 1251 0 0 120201 46 0 0 25 0 5 0 654775744 1187676160 261641 33554432000 4194304 4417452 140733942156064 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 4800.39
Current children cumulated vsize (KiB) 1159840

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1203.96
CPU time (s): 4800.47
CPU user time (s): 4797.18
CPU system time (s): 3.2935
CPU usage (%): 398.725
Max. virtual memory (cumulated for all children) (KiB): 1410568

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4797.18
system time used= 3.2935
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 2348528
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 159
involuntary context switches= 23031

runsolver used 3.10953 second user time and 7.84981 second system time

The end

Launcher Data 

Begin job on node132 at 2011-05-15 05:56:14
IDJOB=3371004
IDBENCH=85640
IDSOLVER=1848
FILE ID=node132/3371004-1305431774
RUNJOBID= node132-1305431769-12373
PBS_JOBID= 13324569
Free space on /tmp= 73356 MiB

SOLVER NAME= Plingeling 587f (fixed)
BENCH NAME= SAT05/crafted/lynce05/social-golfer-problem/sgp_5-6-8.shuffled-as.sat05-2669.cnf
COMMAND LINE= plingeling -t NBCORE BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3371004-1305431774/watcher-3371004-1305431774 -o /tmp/evaluation-result-3371004-1305431774/solver-3371004-1305431774 -C 4800 -W 1300 -M 15500  plingeling -t 4 HOME/instance-3371004-1305431774.cnf

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 4229175ff4382a4625ce92a19d20dde4
RANDOM SEED=1279750574

node132.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.833
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.66
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.833
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.833
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.76
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.833
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.833
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.77
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.833
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.67
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.833
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.833
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      21455044 kB
Buffers:        288256 kB
Cached:        5615208 kB
SwapCached:       6904 kB
Active:        4860540 kB
Inactive:      6329068 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      21455044 kB
SwapTotal:    67111528 kB
SwapFree:     66457188 kB
Dirty:           12836 kB
Writeback:           0 kB
AnonPages:     5284316 kB
Mapped:          19340 kB
Slab:           218724 kB
PageTables:      24536 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 34840796 kB
VmallocTotal: 34359738367 kB
VmallocUsed:     33868 kB
VmallocChunk: 34359703231 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73356 MiB
End job on node132 at 2011-05-15 06:16:20