Trace number 3386071

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
SArTagnan 2011-05-15 (fixed)? (TO) 4800.55 1205.31

General information on the benchmark

NameSAT03/handmade/anton/UNSAT/
SGI_30_70_22_70_7-dir.shuffled-as.sat03-154.cnf
MD5SUMaa9ee2fa26214e80fac6d004d5d0b003
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables660
Number of clauses56654
Sum of the clauses size113924
Maximum clause length30
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 256632
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 522

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3386071-1305582251/watcher-3386071-1305582251 -o /tmp/evaluation-result-3386071-1305582251/solver-3386071-1305582251 -C 4800 -W 1300 -M 15500 SArTagnan HOME/instance-3386071-1305582251.cnf -threads=4 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 8.10 8.09 7.97 5/459 8327
/proc/meminfo: memFree=9561336/32951124 swapFree=65980224/67111528
[pid=8327] ppid=8325 vsize=20280 CPUtime=0 cores=1,3,5,7
/proc/8327/stat : 8327 (SArTagnan) R 8325 8327 7803 0 -1 4202496 703 0 0 0 0 0 0 0 25 0 1 0 650640583 20766720 498 33554432000 4194304 4625164 140737406932544 18446744073709551615 228095450880 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/8327/statm: 5070 498 296 106 0 573 0
[pid=8327/tid=8328] ppid=8325 vsize=54464 CPUtime=0 cores=1,3,5,7
/proc/8327/task/8328/stat : 8328 (SArTagnan) R 8325 8327 7803 0 -1 4202560 0 0 0 0 0 0 0 0 25 0 4 0 650640585 55771136 1109 33554432000 4194304 4625164 140737406932544 18446744073709551615 228095507441 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=8327/tid=8329] ppid=8325 vsize=54464 CPUtime=0 cores=1,3,5,7
/proc/8327/task/8329/stat : 8329 (SArTagnan) R 8325 8327 7803 0 -1 4202560 0 0 0 0 0 0 0 0 25 0 4 0 650640585 55771136 1109 33554432000 4194304 4625164 140737406932544 18446744073709551615 228095507441 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=8327/tid=8330] ppid=8325 vsize=54464 CPUtime=0 cores=1,3,5,7
/proc/8327/task/8330/stat : 8330 (SArTagnan) R 8325 8327 7803 0 -1 4202560 0 0 0 0 0 0 0 0 25 0 4 0 650640585 55771136 1109 33554432000 4194304 4625164 140737406932544 18446744073709551615 228095507441 0 0 4096 2 0 0 0 -1 1 0 0 0

[startup+0.82857 s]
/proc/loadavg: 8.10 8.09 7.97 5/459 8327
/proc/meminfo: memFree=9561336/32951124 swapFree=65980224/67111528
[pid=8327] ppid=8325 vsize=261148 CPUtime=3.25 cores=1,3,5,7
/proc/8327/stat : 8327 (SArTagnan) R 8325 8327 7803 0 -1 4202496 12016 0 0 0 323 2 0 0 25 0 4 0 650640583 267415552 9138 33554432000 4194304 4625164 140737406932544 18446744073709551615 4511866 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/8327/statm: 65287 9138 358 106 0 60790 0
[pid=8327/tid=8328] ppid=8325 vsize=261148 CPUtime=0.8 cores=1,3,5,7
/proc/8327/task/8328/stat : 8328 (SArTagnan) R 8325 8327 7803 0 -1 4202560 2215 0 0 0 80 0 0 0 25 0 4 0 650640585 267415552 9138 33554432000 4194304 4625164 140737406932544 18446744073709551615 4339865 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=8327/tid=8329] ppid=8325 vsize=261148 CPUtime=0.8 cores=1,3,5,7
/proc/8327/task/8329/stat : 8329 (SArTagnan) R 8325 8327 7803 0 -1 4202560 2699 0 0 0 80 0 0 0 18 0 4 0 650640585 267415552 9138 33554432000 4194304 4625164 140737406932544 18446744073709551615 4351824 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=8327/tid=8330] ppid=8325 vsize=261148 CPUtime=0.8 cores=1,3,5,7
/proc/8327/task/8330/stat : 8330 (SArTagnan) R 8325 8327 7803 0 -1 4202560 1131 0 0 0 80 0 0 0 19 0 4 0 650640585 267415552 9138 33554432000 4194304 4625164 140737406932544 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 3.25
Current children cumulated vsize (KiB) 261148

[startup+0.900558 s]
/proc/loadavg: 8.10 8.09 7.97 5/459 8327
/proc/meminfo: memFree=9561336/32951124 swapFree=65980224/67111528
[pid=8327] ppid=8325 vsize=261148 CPUtime=3.53 cores=1,3,5,7
/proc/8327/stat : 8327 (SArTagnan) R 8325 8327 7803 0 -1 4202496 12132 0 0 0 351 2 0 0 25 0 4 0 650640583 267415552 9254 33554432000 4194304 4625164 140737406932544 18446744073709551615 4514720 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/8327/statm: 65287 9254 358 106 0 60790 0
[pid=8327/tid=8328] ppid=8325 vsize=261148 CPUtime=0.87 cores=1,3,5,7
/proc/8327/task/8328/stat : 8328 (SArTagnan) R 8325 8327 7803 0 -1 4202560 2258 0 0 0 87 0 0 0 25 0 4 0 650640585 267415552 9254 33554432000 4194304 4625164 140737406932544 18446744073709551615 4351866 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=8327/tid=8329] ppid=8325 vsize=261148 CPUtime=0.87 cores=1,3,5,7
/proc/8327/task/8329/stat : 8329 (SArTagnan) R 8325 8327 7803 0 -1 4202560 2736 0 0 0 87 0 0 0 19 0 4 0 650640585 267415552 9254 33554432000 4194304 4625164 140737406932544 18446744073709551615 4339612 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=8327/tid=8330] ppid=8325 vsize=261148 CPUtime=0.87 cores=1,3,5,7
/proc/8327/task/8330/stat : 8330 (SArTagnan) R 8325 8327 7803 0 -1 4202560 1140 0 0 0 87 0 0 0 19 0 4 0 650640585 267415552 9254 33554432000 4194304 4625164 140737406932544 18446744073709551615 4547411 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 3.53
Current children cumulated vsize (KiB) 261148

[startup+1.00054 s]
/proc/loadavg: 8.10 8.09 7.97 5/459 8327
/proc/meminfo: memFree=9561336/32951124 swapFree=65980224/67111528
[pid=8327] ppid=8325 vsize=261148 CPUtime=3.93 cores=1,3,5,7
/proc/8327/stat : 8327 (SArTagnan) R 8325 8327 7803 0 -1 4202496 12342 0 0 0 391 2 0 0 25 0 4 0 650640583 267415552 9461 33554432000 4194304 4625164 140737406932544 18446744073709551615 4511800 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/8327/statm: 65287 9461 358 106 0 60790 0
[pid=8327/tid=8328] ppid=8325 vsize=261148 CPUtime=0.97 cores=1,3,5,7
/proc/8327/task/8328/stat : 8328 (SArTagnan) R 8325 8327 7803 0 -1 4202560 2286 0 0 0 97 0 0 0 25 0 4 0 650640585 267415552 9461 33554432000 4194304 4625164 140737406932544 18446744073709551615 4352280 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=8327/tid=8329] ppid=8325 vsize=261148 CPUtime=0.97 cores=1,3,5,7
/proc/8327/task/8329/stat : 8329 (SArTagnan) R 8325 8327 7803 0 -1 4202560 2809 0 0 0 97 0 0 0 19 0 4 0 650640585 267415552 9461 33554432000 4194304 4625164 140737406932544 18446744073709551615 4352157 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=8327/tid=8330] ppid=8325 vsize=261148 CPUtime=0.97 cores=1,3,5,7
/proc/8327/task/8330/stat : 8330 (SArTagnan) R 8325 8327 7803 0 -1 4202560 1172 0 0 0 97 0 0 0 19 0 4 0 650640585 267415552 9461 33554432000 4194304 4625164 140737406932544 18446744073709551615 4547431 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 3.93
Current children cumulated vsize (KiB) 261148

[startup+1.10052 s]
/proc/loadavg: 8.10 8.09 7.97 5/459 8327
/proc/meminfo: memFree=9561336/32951124 swapFree=65980224/67111528
[pid=8327] ppid=8325 vsize=261148 CPUtime=4.33 cores=1,3,5,7
/proc/8327/stat : 8327 (SArTagnan) R 8325 8327 7803 0 -1 4202496 12630 0 0 0 431 2 0 0 25 0 4 0 650640583 267415552 9718 33554432000 4194304 4625164 140737406932544 18446744073709551615 4511973 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/8327/statm: 65287 9718 359 106 0 60790 0
[pid=8327/tid=8328] ppid=8325 vsize=261148 CPUtime=1.07 cores=1,3,5,7
/proc/8327/task/8328/stat : 8328 (SArTagnan) R 8325 8327 7803 0 -1 4202560 2322 0 0 0 107 0 0 0 25 0 4 0 650640585 267415552 9718 33554432000 4194304 4625164 140737406932544 18446744073709551615 4352021 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=8327/tid=8329] ppid=8325 vsize=261148 CPUtime=1.07 cores=1,3,5,7
/proc/8327/task/8329/stat : 8329 (SArTagnan) R 8325 8327 7803 0 -1 4202560 2868 0 0 0 107 0 0 0 19 0 4 0 650640585 267415552 9718 33554432000 4194304 4625164 140737406932544 18446744073709551615 4352280 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=8327/tid=8330] ppid=8325 vsize=261148 CPUtime=1.07 cores=1,3,5,7
/proc/8327/task/8330/stat : 8330 (SArTagnan) R 8325 8327 7803 0 -1 4202560 1255 0 0 0 107 0 0 0 19 0 4 0 650640585 267415552 9718 33554432000 4194304 4625164 140737406932544 18446744073709551615 4547311 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 4.33
Current children cumulated vsize (KiB) 261148

[startup+1.50045 s]
/proc/loadavg: 8.10 8.09 7.97 5/459 8327
/proc/meminfo: memFree=9561336/32951124 swapFree=65980224/67111528
[pid=8327] ppid=8325 vsize=269236 CPUtime=5.94 cores=1,3,5,7
/proc/8327/stat : 8327 (SArTagnan) R 8325 8327 7803 0 -1 4202496 16669 0 0 0 591 3 0 0 25 0 4 0 650640583 275697664 11921 33554432000 4194304 4625164 140737406932544 18446744073709551615 4512475 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/8327/statm: 67309 11921 384 106 0 62812 0
[pid=8327/tid=8328] ppid=8325 vsize=269236 CPUtime=1.47 cores=1,3,5,7
/proc/8327/task/8328/stat : 8328 (SArTagnan) R 8325 8327 7803 0 -1 4202560 3175 0 0 0 147 0 0 0 25 0 4 0 650640585 275697664 11921 33554432000 4194304 4625164 140737406932544 18446744073709551615 4352021 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=8327/tid=8329] ppid=8325 vsize=269236 CPUtime=1.47 cores=1,3,5,7
/proc/8327/task/8329/stat : 8329 (SArTagnan) R 8325 8327 7803 0 -1 4202560 3705 0 0 0 147 0 0 0 20 0 4 0 650640585 275697664 11921 33554432000 4194304 4625164 140737406932544 18446744073709551615 4352296 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=8327/tid=8330] ppid=8325 vsize=269236 CPUtime=1.47 cores=1,3,5,7
/proc/8327/task/8330/stat : 8330 (SArTagnan) R 8325 8327 7803 0 -1 4202560 3048 0 0 0 147 0 0 0 20 0 4 0 650640585 275697664 11921 33554432000 4194304 4625164 140737406932544 18446744073709551615 4334910 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 5.94
Current children cumulated vsize (KiB) 269236

[startup+3.10117 s]
/proc/loadavg: 7.77 8.02 7.95 5/458 8332
/proc/meminfo: memFree=10500096/32951124 swapFree=65980224/67111528
[pid=8327] ppid=8325 vsize=282556 CPUtime=12.3 cores=1,3,5,7
/proc/8327/stat : 8327 (SArTagnan) R 8325 8327 7803 0 -1 4202496 24141 0 0 0 1227 3 0 0 25 0 4 0 650640583 289337344 15006 33554432000 4194304 4625164 140737406932544 18446744073709551615 4512057 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/8327/statm: 70639 15006 346 106 0 66142 0
[pid=8327/tid=8328] ppid=8325 vsize=282556 CPUtime=3.07 cores=1,3,5,7
/proc/8327/task/8328/stat : 8328 (SArTagnan) R 8325 8327 7803 0 -1 4202560 4959 0 0 0 307 0 0 0 25 0 4 0 650640585 289337344 15006 33554432000 4194304 4625164 140737406932544 18446744073709551615 4351844 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=8327/tid=8329] ppid=8325 vsize=282556 CPUtime=3.08 cores=1,3,5,7
/proc/8327/task/8329/stat : 8329 (SArTagnan) R 8325 8327 7803 0 -1 4202560 5588 0 0 0 307 1 0 0 25 0 4 0 650640585 289337344 15006 33554432000 4194304 4625164 140737406932544 18446744073709551615 4351989 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=8327/tid=8330] ppid=8325 vsize=282556 CPUtime=3.04 cores=1,3,5,7
/proc/8327/task/8330/stat : 8330 (SArTagnan) R 8325 8327 7803 0 -1 4202560 4531 0 0 0 304 0 0 0 25 0 4 0 650640585 289337344 15006 33554432000 4194304 4625164 140737406932544 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 12.3
Current children cumulated vsize (KiB) 282556

[startup+6.31756 s]
/proc/loadavg: 7.77 8.02 7.95 9/463 8362
/proc/meminfo: memFree=10413736/32951124 swapFree=65980224/67111528
[pid=8327] ppid=8325 vsize=302572 CPUtime=25.12 cores=1,3,5,7
/proc/8327/stat : 8327 (SArTagnan) R 8325 8327 7803 0 -1 4202496 57712 0 0 0 2504 8 0 0 25 0 4 0 650640583 309833728 22250 33554432000 4194304 4625164 140737406932544 18446744073709551615 4512009 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/8327/statm: 75643 22250 360 106 0 71146 0
[pid=8327/tid=8328] ppid=8325 vsize=302572 CPUtime=6.28 cores=1,3,5,7
/proc/8327/task/8328/stat : 8328 (SArTagnan) R 8325 8327 7803 0 -1 4202560 8355 0 0 0 627 1 0 0 25 0 4 0 650640585 309833728 22250 33554432000 4194304 4625164 140737406932544 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=8327/tid=8329] ppid=8325 vsize=302572 CPUtime=6.29 cores=1,3,5,7
/proc/8327/task/8329/stat : 8329 (SArTagnan) R 8325 8327 7803 0 -1 4202560 9288 0 0 0 627 2 0 0 25 0 4 0 650640585 309833728 22250 33554432000 4194304 4625164 140737406932544 18446744073709551615 228095118338 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=8327/tid=8330] ppid=8325 vsize=302572 CPUtime=6.21 cores=1,3,5,7
/proc/8327/task/8330/stat : 8330 (SArTagnan) R 8325 8327 7803 0 -1 4202560 28364 0 0 0 618 3 0 0 25 0 4 0 650640585 309833728 22250 33554432000 4194304 4625164 140737406932544 18446744073709551615 4547280 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 25.12
Current children cumulated vsize (KiB) 302572

[startup+12.7004 s]
/proc/loadavg: 7.79 8.02 7.95 9/463 8363
/proc/meminfo: memFree=10337740/32951124 swapFree=65980224/67111528
[pid=8327] ppid=8325 vsize=329632 CPUtime=50.56 cores=1,3,5,7
/proc/8327/stat : 8327 (SArTagnan) R 8325 8327 7803 0 -1 4202496 93218 0 0 0 5040 16 0 0 25 0 4 0 650640583 337543168 34643 33554432000 4194304 4625164 140737406932544 18446744073709551615 4329151 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/8327/statm: 82408 34643 408 106 0 77911 0
[pid=8327/tid=8328] ppid=8325 vsize=329632 CPUtime=12.66 cores=1,3,5,7
/proc/8327/task/8328/stat : 8328 (SArTagnan) R 8325 8327 7803 0 -1 4202560 14337 0 0 0 1263 3 0 0 25 0 4 0 650640585 337543168 34643 33554432000 4194304 4625164 140737406932544 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=8327/tid=8329] ppid=8325 vsize=329632 CPUtime=12.67 cores=1,3,5,7
/proc/8327/task/8329/stat : 8329 (SArTagnan) R 8325 8327 7803 0 -1 4202560 15403 0 0 0 1264 3 0 0 25 0 4 0 650640585 337543168 34643 33554432000 4194304 4625164 140737406932544 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=8327/tid=8330] ppid=8325 vsize=329632 CPUtime=12.51 cores=1,3,5,7
/proc/8327/task/8330/stat : 8330 (SArTagnan) R 8325 8327 7803 0 -1 4202560 47738 0 0 0 1245 6 0 0 25 0 4 0 650640585 337543168 34643 33554432000 4194304 4625164 140737406932544 18446744073709551615 4335407 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 50.56
Current children cumulated vsize (KiB) 329632

[startup+25.501 s]
/proc/loadavg: 7.83 8.02 7.95 9/463 8363
/proc/meminfo: memFree=10225900/32951124 swapFree=65980224/67111528
[pid=8327] ppid=8325 vsize=358976 CPUtime=101.57 cores=1,3,5,7
/proc/8327/stat : 8327 (SArTagnan) R 8325 8327 7803 0 -1 4202496 270282 0 0 0 10112 45 0 0 25 0 4 0 650640583 367591424 47596 33554432000 4194304 4625164 140737406932544 18446744073709551615 4512009 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/8327/statm: 89744 47596 349 106 0 85247 0
[pid=8327/tid=8328] ppid=8325 vsize=358976 CPUtime=25.46 cores=1,3,5,7
/proc/8327/task/8328/stat : 8328 (SArTagnan) R 8325 8327 7803 0 -1 4202560 20878 0 0 0 2541 5 0 0 25 0 4 0 650640585 367591424 47596 33554432000 4194304 4625164 140737406932544 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=8327/tid=8329] ppid=8325 vsize=358976 CPUtime=25.47 cores=1,3,5,7
/proc/8327/task/8329/stat : 8329 (SArTagnan) R 8325 8327 7803 0 -1 4202560 23645 0 0 0 2540 7 0 0 25 0 4 0 650640585 367591424 47596 33554432000 4194304 4625164 140737406932544 18446744073709551615 4352739 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=8327/tid=8330] ppid=8325 vsize=358976 CPUtime=25.11 cores=1,3,5,7
/proc/8327/task/8330/stat : 8330 (SArTagnan) R 8325 8327 7803 0 -1 4202560 202148 0 0 0 2482 29 0 0 25 0 4 0 650640585 367591424 47596 33554432000 4194304 4625164 140737406932544 18446744073709551615 4334485 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 101.57
Current children cumulated vsize (KiB) 358976

[startup+51.1003 s]
/proc/loadavg: 7.89 8.02 7.95 9/463 8364
/proc/meminfo: memFree=10017188/32951124 swapFree=65980224/67111528
[pid=8327] ppid=8325 vsize=504124 CPUtime=203.58 cores=1,3,5,7
/proc/8327/stat : 8327 (SArTagnan) R 8325 8327 7803 0 -1 4202496 504969 0 0 0 20273 85 0 0 25 0 4 0 650640583 516222976 80446 33554432000 4194304 4625164 140737406932544 18446744073709551615 4393080 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/8327/statm: 126031 80446 417 106 0 121534 0
[pid=8327/tid=8328] ppid=8325 vsize=504124 CPUtime=51.05 cores=1,3,5,7
/proc/8327/task/8328/stat : 8328 (SArTagnan) R 8325 8327 7803 0 -1 4202560 42910 0 0 0 5094 11 0 0 25 0 4 0 650640585 516222976 80446 33554432000 4194304 4625164 140737406932544 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=8327/tid=8329] ppid=8325 vsize=504124 CPUtime=51.07 cores=1,3,5,7
/proc/8327/task/8329/stat : 8329 (SArTagnan) R 8325 8327 7803 0 -1 4202560 34691 0 0 0 5095 12 0 0 25 0 4 0 650640585 516222976 80446 33554432000 4194304 4625164 140737406932544 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=8327/tid=8330] ppid=8325 vsize=504124 CPUtime=50.33 cores=1,3,5,7
/proc/8327/task/8330/stat : 8330 (SArTagnan) R 8325 8327 7803 0 -1 4202560 375855 0 0 0 4980 53 0 0 25 0 4 0 650640585 516222976 80446 33554432000 4194304 4625164 140737406932544 18446744073709551615 4552410 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 203.58
Current children cumulated vsize (KiB) 504124

[startup+102.301 s]
/proc/loadavg: 7.99 8.03 7.95 9/463 8365
/proc/meminfo: memFree=9572608/32951124 swapFree=65980224/67111528
[pid=8327] ppid=8325 vsize=861796 CPUtime=407.58 cores=1,3,5,7
/proc/8327/stat : 8327 (SArTagnan) R 8325 8327 7803 0 -1 4202496 974400 0 0 0 40592 166 0 0 25 0 4 0 650640583 882479104 147441 33554432000 4194304 4625164 140737406932544 18446744073709551615 4393061 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/8327/statm: 215449 147441 612 106 0 210952 0
[pid=8327/tid=8328] ppid=8325 vsize=861796 CPUtime=102.24 cores=1,3,5,7
/proc/8327/task/8328/stat : 8328 (SArTagnan) R 8325 8327 7803 0 -1 4202560 63711 0 0 0 10203 21 0 0 25 0 4 0 650640585 882479104 147441 33554432000 4194304 4625164 140737406932544 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=8327/tid=8329] ppid=8325 vsize=861796 CPUtime=102.27 cores=1,3,5,7
/proc/8327/task/8329/stat : 8329 (SArTagnan) R 8325 8327 7803 0 -1 4202560 51884 0 0 0 10209 18 0 0 25 0 4 0 650640585 882479104 147441 33554432000 4194304 4625164 140737406932544 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=8327/tid=8330] ppid=8325 vsize=861796 CPUtime=100.74 cores=1,3,5,7
/proc/8327/task/8330/stat : 8330 (SArTagnan) R 8325 8327 7803 0 -1 4202560 688041 0 0 0 9973 101 0 0 25 0 4 0 650640585 882479104 147441 33554432000 4194304 4625164 140737406932544 18446744073709551615 4547431 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 407.58
Current children cumulated vsize (KiB) 861796

[startup+162.301 s]

################
# More data... #
################


[startup+702.3 s]
/proc/loadavg: 8.16 8.12 8.02 9/463 8381
/proc/meminfo: memFree=3873500/32951124 swapFree=65980224/67111528
[pid=8327] ppid=8325 vsize=5228528 CPUtime=2798.15 cores=1,3,5,7
/proc/8327/stat : 8327 (SArTagnan) R 8325 8327 7803 0 -1 4202496 6680653 0 0 0 278770 1045 0 0 25 0 4 0 650640583 5354012672 1084750 33554432000 4194304 4625164 140737406932544 18446744073709551615 4511885 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/8327/statm: 1307132 1084750 347 106 0 1302635 0
[pid=8327/tid=8328] ppid=8325 vsize=5228528 CPUtime=702.06 cores=1,3,5,7
/proc/8327/task/8328/stat : 8328 (SArTagnan) R 8325 8327 7803 0 -1 4202560 153092 0 0 0 70158 48 0 0 25 0 4 0 650640585 5354012672 1084750 33554432000 4194304 4625164 140737406932544 18446744073709551615 4330841 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=8327/tid=8329] ppid=8325 vsize=5228528 CPUtime=702.26 cores=1,3,5,7
/proc/8327/task/8329/stat : 8329 (SArTagnan) R 8325 8327 7803 0 -1 4202560 136118 0 0 0 70156 70 0 0 25 0 4 0 650640585 5354012672 1084750 33554432000 4194304 4625164 140737406932544 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=8327/tid=8330] ppid=8325 vsize=5228528 CPUtime=691.5 cores=1,3,5,7
/proc/8327/task/8330/stat : 8330 (SArTagnan) R 8325 8327 7803 0 -1 4202560 4159563 0 0 0 68533 617 0 0 25 0 4 0 650640585 5354012672 1084750 33554432000 4194304 4625164 140737406932544 18446744073709551615 4339646 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 2798.15
Current children cumulated vsize (KiB) 5228528

[startup+762.301 s]
/proc/loadavg: 8.16 8.12 8.02 9/463 8383
/proc/meminfo: memFree=2854684/32951124 swapFree=65980224/67111528
[pid=8327] ppid=8325 vsize=5298712 CPUtime=3037.22 cores=1,3,5,7
/proc/8327/stat : 8327 (SArTagnan) R 8325 8327 7803 0 -1 4202496 6977688 0 0 0 302621 1101 0 0 25 0 4 0 650640583 5425881088 1102432 33554432000 4194304 4625164 140737406932544 18446744073709551615 4393089 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/8327/statm: 1324678 1102432 347 106 0 1320181 0
[pid=8327/tid=8328] ppid=8325 vsize=5298712 CPUtime=762.05 cores=1,3,5,7
/proc/8327/task/8328/stat : 8328 (SArTagnan) R 8325 8327 7803 0 -1 4202560 153358 0 0 0 76157 48 0 0 25 0 4 0 650640585 5425881088 1102432 33554432000 4194304 4625164 140737406932544 18446744073709551615 4488046 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=8327/tid=8329] ppid=8325 vsize=5298712 CPUtime=762.26 cores=1,3,5,7
/proc/8327/task/8329/stat : 8329 (SArTagnan) R 8325 8327 7803 0 -1 4202560 172780 0 0 0 76145 81 0 0 25 0 4 0 650640585 5425881088 1102432 33554432000 4194304 4625164 140737406932544 18446744073709551615 4351795 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=8327/tid=8330] ppid=8325 vsize=5298712 CPUtime=750.56 cores=1,3,5,7
/proc/8327/task/8330/stat : 8330 (SArTagnan) R 8325 8327 7803 0 -1 4202560 4414512 0 0 0 74396 660 0 0 25 0 4 0 650640585 5425881088 1102432 33554432000 4194304 4625164 140737406932544 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 3037.22
Current children cumulated vsize (KiB) 5298712

[startup+822.301 s]
/proc/loadavg: 8.16 8.13 8.03 9/463 8384
/proc/meminfo: memFree=1784036/32951124 swapFree=65980224/67111528
[pid=8327] ppid=8325 vsize=5454808 CPUtime=3276.28 cores=1,3,5,7
/proc/8327/stat : 8327 (SArTagnan) R 8325 8327 7803 0 -1 4202496 7487711 0 0 0 326445 1183 0 0 25 0 4 0 650640583 5585723392 1115473 33554432000 4194304 4625164 140737406932544 18446744073709551615 4329151 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/8327/statm: 1363702 1115473 350 106 0 1359205 0
[pid=8327/tid=8328] ppid=8325 vsize=5454808 CPUtime=822.03 cores=1,3,5,7
/proc/8327/task/8328/stat : 8328 (SArTagnan) R 8325 8327 7803 0 -1 4202560 196731 0 0 0 82149 54 0 0 25 0 4 0 650640585 5585723392 1115473 33554432000 4194304 4625164 140737406932544 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=8327/tid=8329] ppid=8325 vsize=5454808 CPUtime=822.26 cores=1,3,5,7
/proc/8327/task/8329/stat : 8329 (SArTagnan) R 8325 8327 7803 0 -1 4202560 175773 0 0 0 82143 83 0 0 25 0 4 0 650640585 5585723392 1115473 33554432000 4194304 4625164 140737406932544 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=8327/tid=8330] ppid=8325 vsize=5454808 CPUtime=809.65 cores=1,3,5,7
/proc/8327/task/8330/stat : 8330 (SArTagnan) R 8325 8327 7803 0 -1 4202560 4829660 0 0 0 80238 727 0 0 25 0 4 0 650640585 5585723392 1115473 33554432000 4194304 4625164 140737406932544 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 3276.28
Current children cumulated vsize (KiB) 5454808

[startup+882.301 s]
/proc/loadavg: 8.16 8.13 8.03 9/463 8386
/proc/meminfo: memFree=1345416/32951124 swapFree=65980224/67111528
[pid=8327] ppid=8325 vsize=5459956 CPUtime=3515.34 cores=1,3,5,7
/proc/8327/stat : 8327 (SArTagnan) R 8325 8327 7803 0 -1 4202496 7945707 0 0 0 350271 1263 0 0 25 0 4 0 650640583 5590994944 1123333 33554432000 4194304 4625164 140737406932544 18446744073709551615 4511904 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/8327/statm: 1364989 1123333 365 106 0 1360492 0
[pid=8327/tid=8328] ppid=8325 vsize=5459956 CPUtime=882.02 cores=1,3,5,7
/proc/8327/task/8328/stat : 8328 (SArTagnan) R 8325 8327 7803 0 -1 4202560 197449 0 0 0 88148 54 0 0 25 0 4 0 650640585 5590994944 1123333 33554432000 4194304 4625164 140737406932544 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=8327/tid=8329] ppid=8325 vsize=5459956 CPUtime=882.26 cores=1,3,5,7
/proc/8327/task/8329/stat : 8329 (SArTagnan) R 8325 8327 7803 0 -1 4202560 179744 0 0 0 88138 88 0 0 25 0 4 0 650640585 5590994944 1123333 33554432000 4194304 4625164 140737406932544 18446744073709551615 4351781 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=8327/tid=8330] ppid=8325 vsize=5459956 CPUtime=868.71 cores=1,3,5,7
/proc/8327/task/8330/stat : 8330 (SArTagnan) R 8325 8327 7803 0 -1 4202560 5281360 0 0 0 86070 801 0 0 25 0 4 0 650640585 5590994944 1123333 33554432000 4194304 4625164 140737406932544 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 3515.34
Current children cumulated vsize (KiB) 5459956

[startup+942.301 s]
/proc/loadavg: 8.09 8.12 8.03 9/463 8387
/proc/meminfo: memFree=1834108/32951124 swapFree=65980224/67111528
[pid=8327] ppid=8325 vsize=5470236 CPUtime=3754.02 cores=1,3,5,7
/proc/8327/stat : 8327 (SArTagnan) R 8325 8327 7803 0 -1 4202496 8403135 0 0 0 374044 1358 0 0 25 0 4 0 650640583 5601521664 1132112 33554432000 4194304 4625164 140737406932544 18446744073709551615 4512054 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/8327/statm: 1367559 1132112 347 106 0 1363062 0
[pid=8327/tid=8328] ppid=8325 vsize=5470236 CPUtime=942.03 cores=1,3,5,7
/proc/8327/task/8328/stat : 8328 (SArTagnan) R 8325 8327 7803 0 -1 4202560 197770 0 0 0 94148 55 0 0 25 0 4 0 650640585 5601521664 1132112 33554432000 4194304 4625164 140737406932544 18446744073709551615 4330841 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=8327/tid=8329] ppid=8325 vsize=5470236 CPUtime=941.87 cores=1,3,5,7
/proc/8327/task/8329/stat : 8329 (SArTagnan) R 8325 8327 7803 0 -1 4202560 183254 0 0 0 94094 93 0 0 25 0 4 0 650640585 5601521664 1132112 33554432000 4194304 4625164 140737406932544 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=8327/tid=8330] ppid=8325 vsize=5470236 CPUtime=927.79 cores=1,3,5,7
/proc/8327/task/8330/stat : 8330 (SArTagnan) R 8325 8327 7803 0 -1 4202560 5729114 0 0 0 91889 890 0 0 25 0 4 0 650640585 5601521664 1132112 33554432000 4194304 4625164 140737406932544 18446744073709551615 4547280 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 3754.02
Current children cumulated vsize (KiB) 5470236

[startup+1002.3 s]
/proc/loadavg: 8.08 8.11 8.03 9/463 8389
/proc/meminfo: memFree=1554864/32951124 swapFree=65980224/67111528
[pid=8327] ppid=8325 vsize=5594784 CPUtime=3993.05 cores=1,3,5,7
/proc/8327/stat : 8327 (SArTagnan) R 8325 8327 7803 0 -1 4202496 8879148 0 0 0 397843 1462 0 0 25 0 4 0 650640583 5729058816 1174356 33554432000 4194304 4625164 140737406932544 18446744073709551615 4393080 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/8327/statm: 1398696 1174356 347 106 0 1394199 0
[pid=8327/tid=8328] ppid=8325 vsize=5594784 CPUtime=1001.99 cores=1,3,5,7
/proc/8327/task/8328/stat : 8328 (SArTagnan) R 8325 8327 7803 0 -1 4202560 204358 0 0 0 100143 56 0 0 25 0 4 0 650640585 5729058816 1174356 33554432000 4194304 4625164 140737406932544 18446744073709551615 4330841 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=8327/tid=8329] ppid=8325 vsize=5594784 CPUtime=1001.85 cores=1,3,5,7
/proc/8327/task/8329/stat : 8329 (SArTagnan) R 8325 8327 7803 0 -1 4202560 189907 0 0 0 100086 99 0 0 25 0 4 0 650640585 5729058816 1174356 33554432000 4194304 4625164 140737406932544 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=8327/tid=8330] ppid=8325 vsize=5594784 CPUtime=986.87 cores=1,3,5,7
/proc/8327/task/8330/stat : 8330 (SArTagnan) R 8325 8327 7803 0 -1 4202560 6150037 0 0 0 97711 976 0 0 25 0 4 0 650640585 5729058816 1174356 33554432000 4194304 4625164 140737406932544 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 3993.05
Current children cumulated vsize (KiB) 5594784

[startup+1062.32 s]
/proc/loadavg: 8.02 8.09 8.03 9/463 8400
/proc/meminfo: memFree=1209324/32951124 swapFree=65980224/67111528
[pid=8327] ppid=8325 vsize=5665424 CPUtime=4231.37 cores=1,3,5,7
/proc/8327/stat : 8327 (SArTagnan) R 8325 8327 7803 0 -1 4202496 9273679 0 0 0 421589 1548 0 0 25 0 4 0 650640583 5801394176 1197015 33554432000 4194304 4625164 140737406932544 18446744073709551615 4512009 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/8327/statm: 1416356 1197015 347 106 0 1411859 0
[pid=8327/tid=8328] ppid=8325 vsize=5665424 CPUtime=1061.99 cores=1,3,5,7
/proc/8327/task/8328/stat : 8328 (SArTagnan) R 8325 8327 7803 0 -1 4202560 204698 0 0 0 106143 56 0 0 25 0 4 0 650640585 5801394176 1197015 33554432000 4194304 4625164 140737406932544 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=8327/tid=8329] ppid=8325 vsize=5665424 CPUtime=1061.85 cores=1,3,5,7
/proc/8327/task/8329/stat : 8329 (SArTagnan) R 8325 8327 7803 0 -1 4202560 194788 0 0 0 106079 106 0 0 25 0 4 0 650640585 5801394176 1197015 33554432000 4194304 4625164 140737406932544 18446744073709551615 4339541 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=8327/tid=8330] ppid=8325 vsize=5665424 CPUtime=1045.94 cores=1,3,5,7
/proc/8327/task/8330/stat : 8330 (SArTagnan) R 8325 8327 7803 0 -1 4202560 6506741 0 0 0 103550 1044 0 0 25 0 4 0 650640585 5801394176 1197015 33554432000 4194304 4625164 140737406932544 18446744073709551615 4351801 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 4231.37
Current children cumulated vsize (KiB) 5665424

[startup+1122.3 s]
/proc/loadavg: 8.05 8.08 8.03 9/463 8401
/proc/meminfo: memFree=1088568/32951124 swapFree=65980224/67111528
[pid=8327] ppid=8325 vsize=5665424 CPUtime=4470.38 cores=1,3,5,7
/proc/8327/stat : 8327 (SArTagnan) R 8325 8327 7803 0 -1 4202496 9283326 0 0 0 445487 1551 0 0 25 0 4 0 650640583 5801394176 1198576 33554432000 4194304 4625164 140737406932544 18446744073709551615 4392981 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/8327/statm: 1416356 1198576 347 106 0 1411859 0
[pid=8327/tid=8328] ppid=8325 vsize=5665424 CPUtime=1121.96 cores=1,3,5,7
/proc/8327/task/8328/stat : 8328 (SArTagnan) R 8325 8327 7803 0 -1 4202560 205225 0 0 0 112140 56 0 0 25 0 4 0 650640585 5801394176 1198576 33554432000 4194304 4625164 140737406932544 18446744073709551615 4330841 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=8327/tid=8329] ppid=8325 vsize=5665424 CPUtime=1121.84 cores=1,3,5,7
/proc/8327/task/8329/stat : 8329 (SArTagnan) R 8325 8327 7803 0 -1 4202560 194923 0 0 0 112078 106 0 0 25 0 4 0 650640585 5801394176 1198576 33554432000 4194304 4625164 140737406932544 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=8327/tid=8330] ppid=8325 vsize=5665424 CPUtime=1105.01 cores=1,3,5,7
/proc/8327/task/8330/stat : 8330 (SArTagnan) R 8325 8327 7803 0 -1 4202560 6515725 0 0 0 109455 1046 0 0 25 0 4 0 650640585 5801394176 1198576 33554432000 4194304 4625164 140737406932544 18446744073709551615 4334728 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 4470.38
Current children cumulated vsize (KiB) 5665424

[startup+1182.3 s]
/proc/loadavg: 8.05 8.08 8.03 9/463 8403
/proc/meminfo: memFree=757972/32951124 swapFree=65980224/67111528
[pid=8327] ppid=8325 vsize=5701296 CPUtime=4709.42 cores=1,3,5,7
/proc/8327/stat : 8327 (SArTagnan) R 8325 8327 7803 0 -1 4202496 9302959 0 0 0 469388 1554 0 0 25 0 4 0 650640583 5838127104 1200363 33554432000 4194304 4625164 140737406932544 18446744073709551615 4519369 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/8327/statm: 1425324 1200363 347 106 0 1420827 0
[pid=8327/tid=8328] ppid=8325 vsize=5701296 CPUtime=1181.95 cores=1,3,5,7
/proc/8327/task/8328/stat : 8328 (SArTagnan) R 8325 8327 7803 0 -1 4202560 205633 0 0 0 118138 57 0 0 25 0 4 0 650640585 5838127104 1200363 33554432000 4194304 4625164 140737406932544 18446744073709551615 4330841 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=8327/tid=8329] ppid=8325 vsize=5701296 CPUtime=1181.84 cores=1,3,5,7
/proc/8327/task/8329/stat : 8329 (SArTagnan) R 8325 8327 7803 0 -1 4202560 195252 0 0 0 118078 106 0 0 25 0 4 0 650640585 5838127104 1200363 33554432000 4194304 4625164 140737406932544 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=8327/tid=8330] ppid=8325 vsize=5701296 CPUtime=1164.08 cores=1,3,5,7
/proc/8327/task/8330/stat : 8330 (SArTagnan) R 8325 8327 7803 0 -1 4202560 6534615 0 0 0 115358 1050 0 0 25 0 4 0 650640585 5838127104 1200363 33554432000 4194304 4625164 140737406932544 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 4709.42
Current children cumulated vsize (KiB) 5701296



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1205.1 s]
/proc/loadavg: 8.09 8.09 8.03 9/463 8403
/proc/meminfo: memFree=719020/32951124 swapFree=65980224/67111528
[pid=8327] ppid=8325 vsize=5701296 CPUtime=4800.32 cores=1,3,5,7
/proc/8327/stat : 8327 (SArTagnan) R 8325 8327 7803 0 -1 4202496 9303622 0 0 0 478477 1555 0 0 25 0 4 0 650640583 5838127104 1201026 33554432000 4194304 4625164 140737406932544 18446744073709551615 4393080 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/8327/statm: 1425324 1201026 347 106 0 1420827 0
[pid=8327/tid=8328] ppid=8325 vsize=5701296 CPUtime=1204.77 cores=1,3,5,7
/proc/8327/task/8328/stat : 8328 (SArTagnan) R 8325 8327 7803 0 -1 4202560 205736 0 0 0 120420 57 0 0 25 0 4 0 650640585 5838127104 1201026 33554432000 4194304 4625164 140737406932544 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=8327/tid=8329] ppid=8325 vsize=5701296 CPUtime=1204.65 cores=1,3,5,7
/proc/8327/task/8329/stat : 8329 (SArTagnan) R 8325 8327 7803 0 -1 4202560 195439 0 0 0 120359 106 0 0 25 0 4 0 650640585 5838127104 1201026 33554432000 4194304 4625164 140737406932544 18446744073709551615 228095109382 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=8327/tid=8330] ppid=8325 vsize=5701296 CPUtime=1186.54 cores=1,3,5,7
/proc/8327/task/8330/stat : 8330 (SArTagnan) R 8325 8327 7803 0 -1 4202560 6534961 0 0 0 117604 1050 0 0 25 0 4 0 650640585 5838127104 1201026 33554432000 4194304 4625164 140737406932544 18446744073709551615 4552402 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 4800.32
Current children cumulated vsize (KiB) 5701296

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1205.22 s]
/proc/loadavg: 8.09 8.09 8.03 6/462 8404
/proc/meminfo: memFree=3248132/32951124 swapFree=65980224/67111528
[pid=8327] ppid=8325 vsize=0 CPUtime=4800.46 cores=1,3,5,7
/proc/8327/stat : 8327 (SArTagnan) Z 8325 8327 7803 0 -1 4203548 9303623 0 0 0 478481 1565 0 0 25 0 2 0 650640583 0 0 33554432000 0 0 0 0 0 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/8327/statm: 0 0 0 0 0 0 0
[pid=8327/tid=8330] ppid=8325 vsize=0 CPUtime=1186.65 cores=1,3,5,7
/proc/8327/task/8330/stat : 8330 (SArTagnan) R 8325 8327 7803 0 -1 4203588 6534962 0 0 0 117604 1061 0 0 25 0 2 0 650640585 0 0 33554432000 0 0 0 0 0 0 0 4096 2 18446744073709551615 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 4800.46
Current children cumulated vsize (KiB) 0

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1205.31
CPU time (s): 4800.55
CPU user time (s): 4784.82
CPU system time (s): 15.7286
CPU usage (%): 398.284
Max. virtual memory (cumulated for all children) (KiB): 6356016

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4784.82
system time used= 15.7286
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 9303623
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 14489
involuntary context switches= 32251

runsolver used 5.09722 second user time and 13.4879 second system time

The end

Launcher Data 

Begin job on node142 at 2011-05-16 23:44:11
IDJOB=3386071
IDBENCH=83976
IDSOLVER=1871
FILE ID=node142/3386071-1305582251
RUNJOBID= node142-1305581044-8209
PBS_JOBID= 13350222
Free space on /tmp= 73568 MiB

SOLVER NAME= SArTagnan 2011-05-15 (fixed)
BENCH NAME= SAT03/handmade/anton/UNSAT/SGI_30_70_22_70_7-dir.shuffled-as.sat03-154.cnf
COMMAND LINE= SArTagnan BENCHNAME -threads=NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3386071-1305582251/watcher-3386071-1305582251 -o /tmp/evaluation-result-3386071-1305582251/solver-3386071-1305582251 -C 4800 -W 1300 -M 15500  SArTagnan HOME/instance-3386071-1305582251.cnf -threads=4

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= aa9ee2fa26214e80fac6d004d5d0b003
RANDOM SEED=1463292187

node142.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.69
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5131.95
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.67
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.81
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:       9561616 kB
Buffers:        355900 kB
Cached:        4973480 kB
SwapCached:      11512 kB
Active:       19889752 kB
Inactive:      3126384 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:       9561616 kB
SwapTotal:    67111528 kB
SwapFree:     65980224 kB
Dirty:             828 kB
Writeback:           0 kB
AnonPages:    17684144 kB
Mapped:          27772 kB
Slab:           237384 kB
PageTables:      67856 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 115739592 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73568 MiB
End job on node142 at 2011-05-17 00:04:18