Trace number 3385936

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
SArTagnan 2011-05-15 (fixed)? (TO) 3922.44 1300.06

General information on the benchmark

NameSAT02/handmade/simon/
satex-challenges/f600.shuffled.cnf
MD5SUMd42133fd7674f41611be43d1b8ca7db6
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark0.011997
Satisfiable
(Un)Satisfiability was proved
Number of variables600
Number of clauses2550
Sum of the clauses size7650
Maximum clause length3
Minimum clause length3
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 32550
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 50

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3385936-1305583433/watcher-3385936-1305583433 -o /tmp/evaluation-result-3385936-1305583433/solver-3385936-1305583433 -C 4800 -W 1300 -M 15500 SArTagnan HOME/instance-3385936-1305583433.cnf -threads=4 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 10.13 10.02 8.11 3/480 19429
/proc/meminfo: memFree=5263272/32951132 swapFree=59792360/67111528
[pid=19429] ppid=19427 vsize=49948 CPUtime=0.02 cores=0,2,4,6
/proc/19429/stat : 19429 (SArTagnan) R 19427 19429 19292 0 -1 4202496 609 0 0 0 2 0 0 0 23 0 4 0 669941999 51146752 546 33554432000 4194304 4625164 140734140344384 18446744073709551615 47128145401778 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/19429/statm: 12487 546 301 106 0 7990 0
[pid=19429/tid=19430] ppid=19427 vsize=49948 CPUtime=0 cores=0,2,4,6
/proc/19429/task/19430/stat : 19430 (SArTagnan) R 19427 19429 19292 0 -1 4202560 0 0 0 0 0 0 0 0 25 0 4 0 669941999 51146752 546 33554432000 4194304 4625164 140734140344384 18446744073709551615 47128145401778 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=19429/tid=19431] ppid=19427 vsize=49948 CPUtime=0 cores=0,2,4,6
/proc/19429/task/19431/stat : 19431 (SArTagnan) R 19427 19429 19292 0 -1 4202560 0 0 0 0 0 0 0 0 25 0 4 0 669941999 51146752 546 33554432000 4194304 4625164 140734140344384 18446744073709551615 242970606577 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=19429/tid=19432] ppid=19427 vsize=49948 CPUtime=0.01 cores=0,2,4,6
/proc/19429/task/19432/stat : 19432 (SArTagnan) R 19427 19429 19292 0 -1 4202560 1 0 0 0 1 0 0 0 25 0 4 0 669941999 51146752 546 33554432000 4194304 4625164 140734140344384 18446744073709551615 47128145401778 0 0 4096 2 0 0 0 -1 0 0 0 0

[startup+0.071419 s]
/proc/loadavg: 10.13 10.02 8.11 3/480 19429
/proc/meminfo: memFree=5263272/32951132 swapFree=59792360/67111528
[pid=19429] ppid=19427 vsize=181416 CPUtime=0.18 cores=0,2,4,6
/proc/19429/stat : 19429 (SArTagnan) R 19427 19429 19292 0 -1 4202496 837 0 0 0 18 0 0 0 25 0 4 0 669941999 185769984 774 33554432000 4194304 4625164 140734140344384 18446744073709551615 242970211013 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/19429/statm: 45354 781 337 106 0 40857 0
[pid=19429/tid=19430] ppid=19427 vsize=181416 CPUtime=0.04 cores=0,2,4,6
/proc/19429/task/19430/stat : 19430 (SArTagnan) R 19427 19429 19292 0 -1 4202560 0 0 0 0 4 0 0 0 25 0 4 0 669941999 185769984 781 33554432000 4194304 4625164 140734140344384 18446744073709551615 47128145401778 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=19429/tid=19431] ppid=19427 vsize=181416 CPUtime=0 cores=0,2,4,6
/proc/19429/task/19431/stat : 19431 (SArTagnan) R 19427 19429 19292 0 -1 4202560 46 0 0 0 0 0 0 0 25 0 4 0 669941999 185769984 781 33554432000 4194304 4625164 140734140344384 18446744073709551615 4352021 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=19429/tid=19432] ppid=19427 vsize=181416 CPUtime=0.06 cores=0,2,4,6
/proc/19429/task/19432/stat : 19432 (SArTagnan) R 19427 19429 19292 0 -1 4202560 89 0 0 0 6 0 0 0 25 0 4 0 669941999 185769984 781 33554432000 4194304 4625164 140734140344384 18446744073709551615 242970247376 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 0.18
Current children cumulated vsize (KiB) 181416

[startup+0.100838 s]
/proc/loadavg: 10.13 10.02 8.11 3/480 19429
/proc/meminfo: memFree=5263272/32951132 swapFree=59792360/67111528
[pid=19429] ppid=19427 vsize=248332 CPUtime=0.27 cores=0,2,4,6
/proc/19429/stat : 19429 (SArTagnan) R 19427 19429 19292 0 -1 4202496 1809 0 0 0 27 0 0 0 25 0 4 0 669941999 254291968 1352 33554432000 4194304 4625164 140734140344384 18446744073709551615 4511948 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/19429/statm: 62083 1352 343 106 0 57586 0
[pid=19429/tid=19430] ppid=19427 vsize=248332 CPUtime=0.07 cores=0,2,4,6
/proc/19429/task/19430/stat : 19430 (SArTagnan) R 19427 19429 19292 0 -1 4202560 267 0 0 0 7 0 0 0 25 0 4 0 669941999 254291968 1352 33554432000 4194304 4625164 140734140344384 18446744073709551615 4352021 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=19429/tid=19431] ppid=19427 vsize=248332 CPUtime=0 cores=0,2,4,6
/proc/19429/task/19431/stat : 19431 (SArTagnan) R 19427 19429 19292 0 -1 4202560 153 0 0 0 0 0 0 0 25 0 4 0 669941999 254291968 1352 33554432000 4194304 4625164 140734140344384 18446744073709551615 242970655214 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=19429/tid=19432] ppid=19427 vsize=248332 CPUtime=0.09 cores=0,2,4,6
/proc/19429/task/19432/stat : 19432 (SArTagnan) R 19427 19429 19292 0 -1 4202560 345 0 0 0 9 0 0 0 25 0 4 0 669941999 254291968 1352 33554432000 4194304 4625164 140734140344384 18446744073709551615 4352047 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 0.27
Current children cumulated vsize (KiB) 248332

[startup+0.300804 s]
/proc/loadavg: 10.13 10.02 8.11 3/480 19429
/proc/meminfo: memFree=5263272/32951132 swapFree=59792360/67111528
[pid=19429] ppid=19427 vsize=249316 CPUtime=0.87 cores=0,2,4,6
/proc/19429/stat : 19429 (SArTagnan) R 19427 19429 19292 0 -1 4202496 2649 0 0 0 87 0 0 0 25 0 4 0 669941999 255299584 1830 33554432000 4194304 4625164 140734140344384 18446744073709551615 4511866 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/19429/statm: 62329 1830 343 106 0 57832 0
[pid=19429/tid=19430] ppid=19427 vsize=249316 CPUtime=0.27 cores=0,2,4,6
/proc/19429/task/19430/stat : 19430 (SArTagnan) R 19427 19429 19292 0 -1 4202560 600 0 0 0 27 0 0 0 25 0 4 0 669941999 255299584 1830 33554432000 4194304 4625164 140734140344384 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=19429/tid=19431] ppid=19427 vsize=249316 CPUtime=0.01 cores=0,2,4,6
/proc/19429/task/19431/stat : 19431 (SArTagnan) R 19427 19429 19292 0 -1 4202560 165 0 0 0 1 0 0 0 25 0 4 0 669941999 255299584 1830 33554432000 4194304 4625164 140734140344384 18446744073709551615 242970655214 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=19429/tid=19432] ppid=19427 vsize=249316 CPUtime=0.29 cores=0,2,4,6
/proc/19429/task/19432/stat : 19432 (SArTagnan) R 19427 19429 19292 0 -1 4202560 644 0 0 0 29 0 0 0 25 0 4 0 669941999 255299584 1830 33554432000 4194304 4625164 140734140344384 18446744073709551615 4334728 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 0.87
Current children cumulated vsize (KiB) 249316

[startup+0.700737 s]
/proc/loadavg: 10.13 10.02 8.11 3/480 19429
/proc/meminfo: memFree=5263272/32951132 swapFree=59792360/67111528
[pid=19429] ppid=19427 vsize=251288 CPUtime=2.07 cores=0,2,4,6
/proc/19429/stat : 19429 (SArTagnan) R 19427 19429 19292 0 -1 4202496 4476 0 0 0 207 0 0 0 25 0 4 0 669941999 257318912 3005 33554432000 4194304 4625164 140734140344384 18446744073709551615 4512142 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/19429/statm: 62822 3005 343 106 0 58325 0
[pid=19429/tid=19430] ppid=19427 vsize=251288 CPUtime=0.67 cores=0,2,4,6
/proc/19429/task/19430/stat : 19430 (SArTagnan) R 19427 19429 19292 0 -1 4202560 1373 0 0 0 67 0 0 0 25 0 4 0 669941999 257318912 3005 33554432000 4194304 4625164 140734140344384 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=19429/tid=19431] ppid=19427 vsize=251288 CPUtime=0.18 cores=0,2,4,6
/proc/19429/task/19431/stat : 19431 (SArTagnan) R 19427 19429 19292 0 -1 4202560 495 0 0 0 18 0 0 0 25 0 4 0 669941999 257318912 3005 33554432000 4194304 4625164 140734140344384 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=19429/tid=19432] ppid=19427 vsize=251288 CPUtime=0.69 cores=0,2,4,6
/proc/19429/task/19432/stat : 19432 (SArTagnan) R 19427 19429 19292 0 -1 4202560 1222 0 0 0 69 0 0 0 25 0 4 0 669941999 257318912 3005 33554432000 4194304 4625164 140734140344384 18446744073709551615 4335156 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 2.07
Current children cumulated vsize (KiB) 251288

[startup+1.5006 s]
/proc/loadavg: 10.20 10.03 8.13 12/490 19442
/proc/meminfo: memFree=5225448/32951132 swapFree=59792360/67111528
[pid=19429] ppid=19427 vsize=255752 CPUtime=4.44 cores=0,2,4,6
/proc/19429/stat : 19429 (SArTagnan) R 19427 19429 19292 0 -1 4202496 7236 0 0 0 444 0 0 0 25 0 4 0 669941999 261890048 4425 33554432000 4194304 4625164 140734140344384 18446744073709551615 4511800 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/19429/statm: 63938 4425 344 106 0 59441 0
[pid=19429/tid=19430] ppid=19427 vsize=255752 CPUtime=1.45 cores=0,2,4,6
/proc/19429/task/19430/stat : 19430 (SArTagnan) R 19427 19429 19292 0 -1 4202560 2336 0 0 0 145 0 0 0 25 0 4 0 669941999 261890048 4425 33554432000 4194304 4625164 140734140344384 18446744073709551615 4351777 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=19429/tid=19431] ppid=19427 vsize=255752 CPUtime=0.58 cores=0,2,4,6
/proc/19429/task/19431/stat : 19431 (SArTagnan) R 19427 19429 19292 0 -1 4202560 1105 0 0 0 58 0 0 0 25 0 4 0 669941999 261890048 4425 33554432000 4194304 4625164 140734140344384 18446744073709551615 4464962 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=19429/tid=19432] ppid=19427 vsize=255752 CPUtime=1.49 cores=0,2,4,6
/proc/19429/task/19432/stat : 19432 (SArTagnan) R 19427 19429 19292 0 -1 4202560 2365 0 0 0 149 0 0 0 25 0 4 0 669941999 261890048 4425 33554432000 4194304 4625164 140734140344384 18446744073709551615 4351901 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 4.44
Current children cumulated vsize (KiB) 255752

[startup+3.10032 s]
/proc/loadavg: 10.20 10.03 8.13 11/490 19442
/proc/meminfo: memFree=5210692/32951132 swapFree=59792360/67111528
[pid=19429] ppid=19427 vsize=260304 CPUtime=9.2 cores=0,2,4,6
/proc/19429/stat : 19429 (SArTagnan) R 19427 19429 19292 0 -1 4202496 11652 0 0 0 919 1 0 0 25 0 4 0 669941999 266551296 7316 33554432000 4194304 4625164 140734140344384 18446744073709551615 4511970 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/19429/statm: 65076 7316 344 106 0 60579 0
[pid=19429/tid=19430] ppid=19427 vsize=260304 CPUtime=2.34 cores=0,2,4,6
/proc/19429/task/19430/stat : 19430 (SArTagnan) R 19427 19429 19292 0 -1 4202560 3566 0 0 0 234 0 0 0 25 0 4 0 669941999 266551296 7316 33554432000 4194304 4625164 140734140344384 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=19429/tid=19431] ppid=19427 vsize=260304 CPUtime=2.02 cores=0,2,4,6
/proc/19429/task/19431/stat : 19431 (SArTagnan) R 19427 19429 19292 0 -1 4202560 3038 0 0 0 202 0 0 0 25 0 4 0 669941999 266551296 7316 33554432000 4194304 4625164 140734140344384 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=19429/tid=19432] ppid=19427 vsize=260304 CPUtime=2.34 cores=0,2,4,6
/proc/19429/task/19432/stat : 19432 (SArTagnan) R 19427 19429 19292 0 -1 4202560 2832 0 0 0 234 0 0 0 25 0 4 0 669941999 266551296 7316 33554432000 4194304 4625164 140734140344384 18446744073709551615 4552445 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 9.2
Current children cumulated vsize (KiB) 260304

[startup+6.30077 s]
/proc/loadavg: 10.20 10.03 8.13 12/490 19442
/proc/meminfo: memFree=5180604/32951132 swapFree=59792360/67111528
[pid=19429] ppid=19427 vsize=266172 CPUtime=18.74 cores=0,2,4,6
/proc/19429/stat : 19429 (SArTagnan) R 19427 19429 19292 0 -1 4202496 26242 0 0 0 1870 4 0 0 25 0 4 0 669941999 272560128 10945 33554432000 4194304 4625164 140734140344384 18446744073709551615 4512009 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/19429/statm: 66543 10945 345 106 0 62046 0
[pid=19429/tid=19430] ppid=19427 vsize=266172 CPUtime=3.94 cores=0,2,4,6
/proc/19429/task/19430/stat : 19430 (SArTagnan) R 19427 19429 19292 0 -1 4202560 5018 0 0 0 393 1 0 0 25 0 4 0 669941999 272560128 10945 33554432000 4194304 4625164 140734140344384 18446744073709551615 4351839 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=19429/tid=19431] ppid=19427 vsize=266172 CPUtime=4.23 cores=0,2,4,6
/proc/19429/task/19431/stat : 19431 (SArTagnan) R 19427 19429 19292 0 -1 4202560 5050 0 0 0 423 0 0 0 25 0 4 0 669941999 272560128 10945 33554432000 4194304 4625164 140734140344384 18446744073709551615 4351804 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=19429/tid=19432] ppid=19427 vsize=266172 CPUtime=4.88 cores=0,2,4,6
/proc/19429/task/19432/stat : 19432 (SArTagnan) R 19427 19429 19292 0 -1 4202560 12994 0 0 0 487 1 0 0 25 0 4 0 669941999 272560128 10945 33554432000 4194304 4625164 140734140344384 18446744073709551615 4552369 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 18.74
Current children cumulated vsize (KiB) 266172

[startup+12.7007 s]
/proc/loadavg: 10.17 10.03 8.15 11/490 19442
/proc/meminfo: memFree=5140668/32951132 swapFree=59792360/67111528
[pid=19429] ppid=19427 vsize=279484 CPUtime=37.82 cores=0,2,4,6
/proc/19429/stat : 19429 (SArTagnan) R 19427 19429 19292 0 -1 4202496 55441 0 0 0 3773 9 0 0 25 0 4 0 669941999 286191616 15958 33554432000 4194304 4625164 140734140344384 18446744073709551615 4356539 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/19429/statm: 69871 15958 359 106 0 65374 0
[pid=19429/tid=19430] ppid=19427 vsize=279484 CPUtime=9.72 cores=0,2,4,6
/proc/19429/task/19430/stat : 19430 (SArTagnan) R 19427 19429 19292 0 -1 4202560 8480 0 0 0 970 2 0 0 25 0 4 0 669941999 286191616 15958 33554432000 4194304 4625164 140734140344384 18446744073709551615 4351827 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=19429/tid=19431] ppid=19427 vsize=279484 CPUtime=7.43 cores=0,2,4,6
/proc/19429/task/19431/stat : 19431 (SArTagnan) R 19427 19429 19292 0 -1 4202560 7549 0 0 0 742 1 0 0 25 0 4 0 669941999 286191616 15958 33554432000 4194304 4625164 140734140344384 18446744073709551615 4375232 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=19429/tid=19432] ppid=19427 vsize=279484 CPUtime=8.6 cores=0,2,4,6
/proc/19429/task/19432/stat : 19432 (SArTagnan) R 19427 19429 19292 0 -1 4202560 35369 0 0 0 855 5 0 0 25 0 4 0 669941999 286191616 15958 33554432000 4194304 4625164 140734140344384 18446744073709551615 4547221 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 37.82
Current children cumulated vsize (KiB) 279484

[startup+25.5005 s]
/proc/loadavg: 10.30 10.06 8.18 11/490 19444
/proc/meminfo: memFree=5077816/32951132 swapFree=59792360/67111528
[pid=19429] ppid=19427 vsize=301116 CPUtime=76.01 cores=0,2,4,6
/proc/19429/stat : 19429 (SArTagnan) R 19427 19429 19292 0 -1 4202496 114679 0 0 0 7583 18 0 0 25 0 4 0 669941999 308342784 23310 33554432000 4194304 4625164 140734140344384 18446744073709551615 4511970 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/19429/statm: 75279 23310 384 106 0 70782 0
[pid=19429/tid=19430] ppid=19427 vsize=301116 CPUtime=22.26 cores=0,2,4,6
/proc/19429/task/19430/stat : 19430 (SArTagnan) R 19427 19429 19292 0 -1 4202560 16487 0 0 0 2223 3 0 0 25 0 4 0 669941999 308342784 23310 33554432000 4194304 4625164 140734140344384 18446744073709551615 4339549 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=19429/tid=19431] ppid=19427 vsize=301116 CPUtime=13.87 cores=0,2,4,6
/proc/19429/task/19431/stat : 19431 (SArTagnan) R 19427 19429 19292 0 -1 4202560 11266 0 0 0 1385 2 0 0 25 0 4 0 669941999 308342784 23310 33554432000 4194304 4625164 140734140344384 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=19429/tid=19432] ppid=19427 vsize=301116 CPUtime=15 cores=0,2,4,6
/proc/19429/task/19432/stat : 19432 (SArTagnan) R 19427 19429 19292 0 -1 4202560 81606 0 0 0 1489 11 0 0 25 0 4 0 669941999 308342784 23310 33554432000 4194304 4625164 140734140344384 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 76.01
Current children cumulated vsize (KiB) 301116

[startup+51.1011 s]
/proc/loadavg: 10.27 10.07 8.23 11/490 19444
/proc/meminfo: memFree=4990852/32951132 swapFree=59792360/67111528
[pid=19429] ppid=19427 vsize=322468 CPUtime=152.39 cores=0,2,4,6
/proc/19429/stat : 19429 (SArTagnan) R 19427 19429 19292 0 -1 4202496 209177 0 0 0 15203 36 0 0 25 0 4 0 669941999 330207232 32993 33554432000 4194304 4625164 140734140344384 18446744073709551615 4329142 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/19429/statm: 80617 32994 410 106 0 76120 0
[pid=19429/tid=19430] ppid=19427 vsize=322468 CPUtime=47.45 cores=0,2,4,6
/proc/19429/task/19430/stat : 19430 (SArTagnan) R 19427 19429 19292 0 -1 4202560 23735 0 0 0 4741 4 0 0 25 0 4 0 669941999 330207232 32994 33554432000 4194304 4625164 140734140344384 18446744073709551615 4351975 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=19429/tid=19431] ppid=19427 vsize=322468 CPUtime=26.71 cores=0,2,4,6
/proc/19429/task/19431/stat : 19431 (SArTagnan) R 19427 19429 19292 0 -1 4202560 16394 0 0 0 2667 4 0 0 25 0 4 0 669941999 330207232 32994 33554432000 4194304 4625164 140734140344384 18446744073709551615 4351827 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=19429/tid=19432] ppid=19427 vsize=322468 CPUtime=27.75 cores=0,2,4,6
/proc/19429/task/19432/stat : 19432 (SArTagnan) R 19427 19429 19292 0 -1 4202560 160651 0 0 0 2750 25 0 0 25 0 4 0 669941999 330207232 32994 33554432000 4194304 4625164 140734140344384 18446744073709551615 4339447 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 152.39
Current children cumulated vsize (KiB) 322468

[startup+102.318 s]
/proc/loadavg: 10.16 10.07 8.33 11/490 19446
/proc/meminfo: memFree=4846864/32951132 swapFree=59792360/67111528
[pid=19429] ppid=19427 vsize=332864 CPUtime=305.19 cores=0,2,4,6
/proc/19429/stat : 19429 (SArTagnan) R 19427 19429 19292 0 -1 4202496 323703 0 0 0 30461 58 0 0 25 0 4 0 669941999 340852736 48604 33554432000 4194304 4625164 140734140344384 18446744073709551615 4512156 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/19429/statm: 83216 48604 441 106 0 78719 0
[pid=19429/tid=19430] ppid=19427 vsize=332864 CPUtime=97.83 cores=0,2,4,6
/proc/19429/task/19430/stat : 19430 (SArTagnan) R 19427 19429 19292 0 -1 4202560 27630 0 0 0 9777 6 0 0 25 0 4 0 669941999 340852736 48604 33554432000 4194304 4625164 140734140344384 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=19429/tid=19431] ppid=19427 vsize=332864 CPUtime=52.19 cores=0,2,4,6
/proc/19429/task/19431/stat : 19431 (SArTagnan) R 19427 19429 19292 0 -1 4202560 23052 0 0 0 5214 5 0 0 25 0 4 0 669941999 340852736 48604 33554432000 4194304 4625164 140734140344384 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=19429/tid=19432] ppid=19427 vsize=332864 CPUtime=53.49 cores=0,2,4,6
/proc/19429/task/19432/stat : 19432 (SArTagnan) R 19427 19429 19292 0 -1 4202560 259670 0 0 0 5306 43 0 0 25 0 4 0 669941999 340852736 48604 33554432000 4194304 4625164 140734140344384 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 305.19
Current children cumulated vsize (KiB) 332864

[startup+162.301 s]

################
# More data... #
################

[pid=19429] ppid=19427 vsize=771468 CPUtime=2139.36 cores=0,2,4,6
/proc/19429/stat : 19429 (SArTagnan) R 19427 19429 19292 0 -1 4202496 1355177 0 0 0 213660 276 0 0 25 0 4 0 669941999 789983232 141191 33554432000 4194304 4625164 140734140344384 18446744073709551615 4511904 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/19429/statm: 192867 141191 995 106 0 188370 0
[pid=19429/tid=19430] ppid=19427 vsize=771468 CPUtime=411.83 cores=0,2,4,6
/proc/19429/task/19430/stat : 19430 (SArTagnan) R 19427 19429 19292 0 -1 4202560 65885 0 0 0 41140 43 0 0 25 0 4 0 669941999 789983232 141191 33554432000 4194304 4625164 140734140344384 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=19429/tid=19431] ppid=19427 vsize=771468 CPUtime=603.11 cores=0,2,4,6
/proc/19429/task/19431/stat : 19431 (SArTagnan) R 19427 19429 19292 0 -1 4202560 79214 0 0 0 60292 19 0 0 25 0 4 0 669941999 789983232 141191 33554432000 4194304 4625164 140734140344384 18446744073709551615 4351918 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=19429/tid=19432] ppid=19427 vsize=771468 CPUtime=423.23 cores=0,2,4,6
/proc/19429/task/19432/stat : 19432 (SArTagnan) R 19427 19429 19292 0 -1 4202560 1161869 0 0 0 42127 196 0 0 25 0 4 0 669941999 789983232 141191 33554432000 4194304 4625164 140734140344384 18446744073709551615 4351918 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 2139.36
Current children cumulated vsize (KiB) 771468

[startup+762.319 s]
/proc/loadavg: 10.12 10.16 9.26 11/490 19465
/proc/meminfo: memFree=3633016/32951132 swapFree=59792360/67111528
[pid=19429] ppid=19427 vsize=845200 CPUtime=2318.38 cores=0,2,4,6
/proc/19429/stat : 19429 (SArTagnan) R 19427 19429 19292 0 -1 4202496 1501797 0 0 0 231536 302 0 0 25 0 4 0 669941999 865484800 148386 33554432000 4194304 4625164 140734140344384 18446744073709551615 4512009 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/19429/statm: 211300 148386 963 106 0 206803 0
[pid=19429/tid=19430] ppid=19427 vsize=845200 CPUtime=448.25 cores=0,2,4,6
/proc/19429/task/19430/stat : 19430 (SArTagnan) R 19427 19429 19292 0 -1 4202560 84765 0 0 0 44779 46 0 0 25 0 4 0 669941999 865484800 148386 33554432000 4194304 4625164 140734140344384 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=19429/tid=19431] ppid=19427 vsize=845200 CPUtime=653.95 cores=0,2,4,6
/proc/19429/task/19431/stat : 19431 (SArTagnan) R 19427 19429 19292 0 -1 4202560 81000 0 0 0 65374 21 0 0 25 0 4 0 669941999 865484800 148386 33554432000 4194304 4625164 140734140344384 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=19429/tid=19432] ppid=19427 vsize=845200 CPUtime=455.03 cores=0,2,4,6
/proc/19429/task/19432/stat : 19432 (SArTagnan) R 19427 19429 19292 0 -1 4202560 1276790 0 0 0 45288 215 0 0 25 0 4 0 669941999 865484800 148386 33554432000 4194304 4625164 140734140344384 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 2318.38
Current children cumulated vsize (KiB) 845200

[startup+822.3 s]
/proc/loadavg: 10.08 10.15 9.31 11/490 19467
/proc/meminfo: memFree=3554992/32951132 swapFree=59792360/67111528
[pid=19429] ppid=19427 vsize=851272 CPUtime=2497.31 cores=0,2,4,6
/proc/19429/stat : 19429 (SArTagnan) R 19427 19429 19292 0 -1 4202496 1663410 0 0 0 249403 328 0 0 25 0 4 0 669941999 871702528 151878 33554432000 4194304 4625164 140734140344384 18446744073709551615 4512009 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/19429/statm: 212818 151878 886 106 0 208321 0
[pid=19429/tid=19430] ppid=19427 vsize=851272 CPUtime=508.24 cores=0,2,4,6
/proc/19429/task/19430/stat : 19430 (SArTagnan) R 19427 19429 19292 0 -1 4202560 87160 0 0 0 50777 47 0 0 25 0 4 0 669941999 871702528 151878 33554432000 4194304 4625164 140734140344384 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=19429/tid=19431] ppid=19427 vsize=851272 CPUtime=683.48 cores=0,2,4,6
/proc/19429/task/19431/stat : 19431 (SArTagnan) R 19427 19429 19292 0 -1 4202560 81740 0 0 0 68326 22 0 0 25 0 4 0 669941999 871702528 151878 33554432000 4194304 4625164 140734140344384 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=19429/tid=19432] ppid=19427 vsize=851272 CPUtime=484.52 cores=0,2,4,6
/proc/19429/task/19432/stat : 19432 (SArTagnan) R 19427 19429 19292 0 -1 4202560 1434884 0 0 0 48213 239 0 0 25 0 4 0 669941999 871702528 151878 33554432000 4194304 4625164 140734140344384 18446744073709551615 4339591 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 2497.31
Current children cumulated vsize (KiB) 851272

[startup+882.301 s]
/proc/loadavg: 10.18 10.16 9.36 11/490 19469
/proc/meminfo: memFree=3477460/32951132 swapFree=59792360/67111528
[pid=19429] ppid=19427 vsize=857344 CPUtime=2676.27 cores=0,2,4,6
/proc/19429/stat : 19429 (SArTagnan) R 19427 19429 19292 0 -1 4202496 1839251 0 0 0 267271 356 0 0 25 0 4 0 669941999 877920256 156050 33554432000 4194304 4625164 140734140344384 18446744073709551615 4512009 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/19429/statm: 214336 156050 786 106 0 209839 0
[pid=19429/tid=19430] ppid=19427 vsize=857344 CPUtime=567.86 cores=0,2,4,6
/proc/19429/task/19430/stat : 19430 (SArTagnan) R 19427 19429 19292 0 -1 4202560 89311 0 0 0 56738 48 0 0 25 0 4 0 669941999 877920256 156050 33554432000 4194304 4625164 140734140344384 18446744073709551615 4351981 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=19429/tid=19431] ppid=19427 vsize=857344 CPUtime=713.2 cores=0,2,4,6
/proc/19429/task/19431/stat : 19431 (SArTagnan) R 19427 19429 19292 0 -1 4202560 82680 0 0 0 71297 23 0 0 25 0 4 0 669941999 877920256 156050 33554432000 4194304 4625164 140734140344384 18446744073709551615 4351818 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=19429/tid=19432] ppid=19427 vsize=857344 CPUtime=514.21 cores=0,2,4,6
/proc/19429/task/19432/stat : 19432 (SArTagnan) R 19427 19429 19292 0 -1 4202560 1607340 0 0 0 51157 264 0 0 25 0 4 0 669941999 877920256 156050 33554432000 4194304 4625164 140734140344384 18446744073709551615 4351901 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 2676.27
Current children cumulated vsize (KiB) 857344

[startup+942.301 s]
/proc/loadavg: 10.23 10.18 9.42 11/490 19471
/proc/meminfo: memFree=3383560/32951132 swapFree=59792360/67111528
[pid=19429] ppid=19427 vsize=909808 CPUtime=2855.26 cores=0,2,4,6
/proc/19429/stat : 19429 (SArTagnan) R 19427 19429 19292 0 -1 4202496 2047652 0 0 0 285140 386 0 0 25 0 4 0 669941999 931643392 164027 33554432000 4194304 4625164 140734140344384 18446744073709551615 4512818 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/19429/statm: 227452 164027 567 106 0 222955 0
[pid=19429/tid=19430] ppid=19427 vsize=909808 CPUtime=626.89 cores=0,2,4,6
/proc/19429/task/19430/stat : 19430 (SArTagnan) R 19427 19429 19292 0 -1 4202560 91968 0 0 0 62640 49 0 0 25 0 4 0 669941999 931643392 164027 33554432000 4194304 4625164 140734140344384 18446744073709551615 4339643 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=19429/tid=19431] ppid=19427 vsize=909808 CPUtime=743.2 cores=0,2,4,6
/proc/19429/task/19431/stat : 19431 (SArTagnan) R 19427 19429 19292 0 -1 4202560 108401 0 0 0 74293 27 0 0 25 0 4 0 669941999 931643392 164027 33554432000 4194304 4625164 140734140344384 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=19429/tid=19432] ppid=19427 vsize=909808 CPUtime=544.22 cores=0,2,4,6
/proc/19429/task/19432/stat : 19432 (SArTagnan) R 19427 19429 19292 0 -1 4202560 1787203 0 0 0 54133 289 0 0 25 0 4 0 669941999 931643392 164027 33554432000 4194304 4625164 140734140344384 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 2855.26
Current children cumulated vsize (KiB) 909808

[startup+1002.3 s]
/proc/loadavg: 10.21 10.17 9.46 11/490 19473
/proc/meminfo: memFree=3321656/32951132 swapFree=59792360/67111528
[pid=19429] ppid=19427 vsize=916408 CPUtime=3034.23 cores=0,2,4,6
/proc/19429/stat : 19429 (SArTagnan) R 19427 19429 19292 0 -1 4202496 2232535 0 0 0 303011 412 0 0 25 0 4 0 669941999 938401792 167643 33554432000 4194304 4625164 140734140344384 18446744073709551615 4511904 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/19429/statm: 229102 167643 574 106 0 224605 0
[pid=19429/tid=19430] ppid=19427 vsize=916408 CPUtime=685.92 cores=0,2,4,6
/proc/19429/task/19430/stat : 19430 (SArTagnan) R 19427 19429 19292 0 -1 4202560 93845 0 0 0 68542 50 0 0 25 0 4 0 669941999 938401792 167643 33554432000 4194304 4625164 140734140344384 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=19429/tid=19431] ppid=19427 vsize=916408 CPUtime=773.21 cores=0,2,4,6
/proc/19429/task/19431/stat : 19431 (SArTagnan) R 19427 19429 19292 0 -1 4202560 108568 0 0 0 77294 27 0 0 25 0 4 0 669941999 938401792 167643 33554432000 4194304 4625164 140734140344384 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=19429/tid=19432] ppid=19427 vsize=916408 CPUtime=574.21 cores=0,2,4,6
/proc/19429/task/19432/stat : 19432 (SArTagnan) R 19427 19429 19292 0 -1 4202560 1970024 0 0 0 57108 313 0 0 25 0 4 0 669941999 938401792 167643 33554432000 4194304 4625164 140734140344384 18446744073709551615 4339612 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 3034.23
Current children cumulated vsize (KiB) 916408

[startup+1062.3 s]
/proc/loadavg: 10.13 10.16 9.50 11/490 19473
/proc/meminfo: memFree=3248464/32951132 swapFree=59792360/67111528
[pid=19429] ppid=19427 vsize=920236 CPUtime=3213.25 cores=0,2,4,6
/proc/19429/stat : 19429 (SArTagnan) R 19427 19429 19292 0 -1 4202496 2411193 0 0 0 320886 439 0 0 25 0 4 0 669941999 942321664 169410 33554432000 4194304 4625164 140734140344384 18446744073709551615 4512009 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/19429/statm: 230059 169410 561 106 0 225562 0
[pid=19429/tid=19430] ppid=19427 vsize=920236 CPUtime=721.98 cores=0,2,4,6
/proc/19429/task/19430/stat : 19430 (SArTagnan) R 19427 19429 19292 0 -1 4202560 94963 0 0 0 72147 51 0 0 25 0 4 0 669941999 942321664 169410 33554432000 4194304 4625164 140734140344384 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=19429/tid=19431] ppid=19427 vsize=920236 CPUtime=826.61 cores=0,2,4,6
/proc/19429/task/19431/stat : 19431 (SArTagnan) R 19427 19429 19292 0 -1 4202560 109198 0 0 0 82634 27 0 0 25 0 4 0 669941999 942321664 169410 33554432000 4194304 4625164 140734140344384 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=19429/tid=19432] ppid=19427 vsize=920236 CPUtime=603.81 cores=0,2,4,6
/proc/19429/task/19432/stat : 19432 (SArTagnan) R 19427 19429 19292 0 -1 4202560 2146874 0 0 0 60043 338 0 0 25 0 4 0 669941999 942321664 169410 33554432000 4194304 4625164 140734140344384 18446744073709551615 4547280 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 3213.25
Current children cumulated vsize (KiB) 920236

[startup+1122.3 s]
/proc/loadavg: 10.15 10.15 9.54 11/490 19475
/proc/meminfo: memFree=3170568/32951132 swapFree=59792360/67111528
[pid=19429] ppid=19427 vsize=923536 CPUtime=3392.23 cores=0,2,4,6
/proc/19429/stat : 19429 (SArTagnan) R 19427 19429 19292 0 -1 4202496 2639912 0 0 0 338748 475 0 0 25 0 4 0 669941999 945700864 173070 33554432000 4194304 4625164 140734140344384 18446744073709551615 4512156 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/19429/statm: 230884 173070 562 106 0 226387 0
[pid=19429/tid=19430] ppid=19427 vsize=923536 CPUtime=751.58 cores=0,2,4,6
/proc/19429/task/19430/stat : 19430 (SArTagnan) R 19427 19429 19292 0 -1 4202560 96343 0 0 0 75107 51 0 0 25 0 4 0 669941999 945700864 173070 33554432000 4194304 4625164 140734140344384 18446744073709551615 4351777 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=19429/tid=19431] ppid=19427 vsize=923536 CPUtime=878.72 cores=0,2,4,6
/proc/19429/task/19431/stat : 19431 (SArTagnan) R 19427 19429 19292 0 -1 4202560 109831 0 0 0 87844 28 0 0 25 0 4 0 669941999 945700864 173070 33554432000 4194304 4625164 140734140344384 18446744073709551615 4339554 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=19429/tid=19432] ppid=19427 vsize=923536 CPUtime=641.15 cores=0,2,4,6
/proc/19429/task/19432/stat : 19432 (SArTagnan) R 19427 19429 19292 0 -1 4202560 2373568 0 0 0 63742 373 0 0 25 0 4 0 669941999 945700864 173070 33554432000 4194304 4625164 140734140344384 18446744073709551615 4335165 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 3392.23
Current children cumulated vsize (KiB) 923536

[startup+1182.3 s]
/proc/loadavg: 10.21 10.17 9.58 11/490 19477
/proc/meminfo: memFree=3070720/32951132 swapFree=59792360/67111528
[pid=19429] ppid=19427 vsize=1050596 CPUtime=3571.22 cores=0,2,4,6
/proc/19429/stat : 19429 (SArTagnan) R 19427 19429 19292 0 -1 4202496 2972264 0 0 0 356596 526 0 0 25 0 4 0 669941999 1075810304 187219 33554432000 4194304 4625164 140734140344384 18446744073709551615 4512009 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/19429/statm: 262649 187219 431 106 0 258152 0
[pid=19429/tid=19430] ppid=19427 vsize=1050596 CPUtime=781.57 cores=0,2,4,6
/proc/19429/task/19430/stat : 19430 (SArTagnan) R 19427 19429 19292 0 -1 4202560 97402 0 0 0 78106 51 0 0 25 0 4 0 669941999 1075810304 187219 33554432000 4194304 4625164 140734140344384 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=19429/tid=19431] ppid=19427 vsize=1050596 CPUtime=908.72 cores=0,2,4,6
/proc/19429/task/19431/stat : 19431 (SArTagnan) R 19427 19429 19292 0 -1 4202560 110607 0 0 0 90844 28 0 0 25 0 4 0 669941999 1075810304 187219 33554432000 4194304 4625164 140734140344384 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=19429/tid=19432] ppid=19427 vsize=1050596 CPUtime=700.21 cores=0,2,4,6
/proc/19429/task/19432/stat : 19432 (SArTagnan) R 19427 19429 19292 0 -1 4202560 2693774 0 0 0 69601 420 0 0 25 0 4 0 669941999 1075810304 187219 33554432000 4194304 4625164 140734140344384 18446744073709551615 4552369 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 3571.22
Current children cumulated vsize (KiB) 1050596

[startup+1242.3 s]
/proc/loadavg: 10.20 10.18 9.62 11/490 19479
/proc/meminfo: memFree=3016260/32951132 swapFree=59792360/67111528
[pid=19429] ppid=19427 vsize=997572 CPUtime=3750.22 cores=0,2,4,6
/proc/19429/stat : 19429 (SArTagnan) R 19427 19429 19292 0 -1 4202496 3174318 0 0 0 374463 559 0 0 25 0 4 0 669941999 1021513728 191999 33554432000 4194304 4625164 140734140344384 18446744073709551615 4511930 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/19429/statm: 249393 191999 416 106 0 244896 0
[pid=19429/tid=19430] ppid=19427 vsize=997572 CPUtime=820.34 cores=0,2,4,6
/proc/19429/task/19430/stat : 19430 (SArTagnan) R 19427 19429 19292 0 -1 4202560 97990 0 0 0 81982 52 0 0 25 0 4 0 669941999 1021513728 191999 33554432000 4194304 4625164 140734140344384 18446744073709551615 4351781 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=19429/tid=19431] ppid=19427 vsize=997572 CPUtime=955.6 cores=0,2,4,6
/proc/19429/task/19431/stat : 19431 (SArTagnan) R 19427 19429 19292 0 -1 4202560 112063 0 0 0 95530 30 0 0 25 0 4 0 669941999 1021513728 191999 33554432000 4194304 4625164 140734140344384 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=19429/tid=19432] ppid=19427 vsize=997572 CPUtime=733.59 cores=0,2,4,6
/proc/19429/task/19432/stat : 19432 (SArTagnan) R 19427 19429 19292 0 -1 4202560 2893184 0 0 0 72910 449 0 0 25 0 4 0 669941999 1021513728 191999 33554432000 4194304 4625164 140734140344384 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 3750.22
Current children cumulated vsize (KiB) 997572



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+1300 s]
/proc/loadavg: 10.22 10.19 9.65 12/490 19481
/proc/meminfo: memFree=2965388/32951132 swapFree=59792360/67111528
[pid=19429] ppid=19427 vsize=1064396 CPUtime=3922.37 cores=0,2,4,6
/proc/19429/stat : 19429 (SArTagnan) R 19427 19429 19292 0 -1 4202496 3332401 0 0 0 391654 583 0 0 25 0 4 0 669941999 1089941504 196373 33554432000 4194304 4625164 140734140344384 18446744073709551615 4519334 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/19429/statm: 266099 196373 428 106 0 261602 0
[pid=19429/tid=19430] ppid=19427 vsize=1064396 CPUtime=878.05 cores=0,2,4,6
/proc/19429/task/19430/stat : 19430 (SArTagnan) R 19427 19429 19292 0 -1 4202560 98664 0 0 0 87753 52 0 0 25 0 4 0 669941999 1089941504 196373 33554432000 4194304 4625164 140734140344384 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=19429/tid=19431] ppid=19427 vsize=1064396 CPUtime=983.99 cores=0,2,4,6
/proc/19429/task/19431/stat : 19431 (SArTagnan) R 19427 19429 19292 0 -1 4202560 112654 0 0 0 98369 30 0 0 25 0 4 0 669941999 1089941504 196373 33554432000 4194304 4625164 140734140344384 18446744073709551615 4339591 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=19429/tid=19432] ppid=19427 vsize=1064396 CPUtime=761.99 cores=0,2,4,6
/proc/19429/task/19432/stat : 19432 (SArTagnan) R 19427 19429 19292 0 -1 4202560 3049264 0 0 0 75727 472 0 0 25 0 4 0 669941999 1089941504 196373 33554432000 4194304 4625164 140734140344384 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 3922.37
Current children cumulated vsize (KiB) 1064396

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1300.06
CPU time (s): 3922.44
CPU user time (s): 3916.57
CPU system time (s): 5.87311
CPU usage (%): 301.712
Max. virtual memory (cumulated for all children) (KiB): 1064396

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 3916.57
system time used= 5.87311
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 3332401
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 375
involuntary context switches= 46827

runsolver used 6.06008 second user time and 14.8457 second system time

The end

Launcher Data 

Begin job on node128 at 2011-05-17 00:03:54
IDJOB=3385936
IDBENCH=87732
IDSOLVER=1871
FILE ID=node128/3385936-1305583433
RUNJOBID= node128-1305582130-19310
PBS_JOBID= 13350295
Free space on /tmp= 73496 MiB

SOLVER NAME= SArTagnan 2011-05-15 (fixed)
BENCH NAME= SAT02/handmade/simon/satex-challenges/f600.shuffled.cnf
COMMAND LINE= SArTagnan BENCHNAME -threads=NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3385936-1305583433/watcher-3385936-1305583433 -o /tmp/evaluation-result-3385936-1305583433/solver-3385936-1305583433 -C 4800 -W 1300 -M 15500  SArTagnan HOME/instance-3385936-1305583433.cnf -threads=4

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= d42133fd7674f41611be43d1b8ca7db6
RANDOM SEED=412212672

node128.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.852
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.70
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.852
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.852
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.852
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.852
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.852
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.852
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.852
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5434.49
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951132 kB
MemFree:       5263304 kB
Buffers:         71352 kB
Cached:         664752 kB
SwapCached:     122436 kB
Active:       12388368 kB
Inactive:     15027988 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951132 kB
LowFree:       5263304 kB
SwapTotal:    67111528 kB
SwapFree:     59792360 kB
Dirty:             392 kB
Writeback:          16 kB
AnonPages:    26566104 kB
Mapped:          19044 kB
Slab:            95868 kB
PageTables:     107004 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587092 kB
Committed_AS: 153058544 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296000 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73496 MiB
End job on node128 at 2011-05-17 00:25:36