Trace number 3385975

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
SArTagnan 2011-05-15 (fixed)? (TO) 4800.23 1204.93

General information on the benchmark

NameSAT03/handmade/anton/UNSAT/
SGI_30_70_26_40_6-dir.shuffled-as.sat03-163.cnf
MD5SUMc06088cac8521bfe72bbb4c9ad8d39fb
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables780
Number of clauses66810
Sum of the clauses size134348
Maximum clause length30
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 266784
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 526

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3385975-1305582154/watcher-3385975-1305582154 -o /tmp/evaluation-result-3385975-1305582154/solver-3385975-1305582154 -C 4800 -W 1300 -M 15500 SArTagnan HOME/instance-3385975-1305582154.cnf -threads=4 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 0.00 0.00 0.00 1/476 32308
/proc/meminfo: memFree=9968736/32951124 swapFree=56316216/67111528
[pid=32308] ppid=32306 vsize=21068 CPUtime=0.01 cores=1,3,5,7
/proc/32308/stat : 32308 (SArTagnan) R 32306 32308 32280 0 -1 4202496 1081 0 0 0 1 0 0 0 22 0 1 0 669817788 21573632 606 33554432000 4194304 4625164 140736978302160 18446744073709551615 212436016896 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/32308/statm: 5267 606 296 106 0 770 0

[startup+0.0960051 s]
/proc/loadavg: 0.00 0.00 0.00 1/476 32308
/proc/meminfo: memFree=9968736/32951124 swapFree=56316216/67111528
[pid=32308] ppid=32306 vsize=188184 CPUtime=0.22 cores=1,3,5,7
/proc/32308/stat : 32308 (SArTagnan) R 32306 32308 32280 0 -1 4202496 3030 0 0 0 22 0 0 0 23 0 4 0 669817788 192700416 2391 33554432000 4194304 4625164 140736978302160 18446744073709551615 4512054 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/32308/statm: 47046 2391 343 106 0 42549 0
Current children cumulated CPU time (s) 0.22
Current children cumulated vsize (KiB) 188184

[startup+0.100989 s]
/proc/loadavg: 0.00 0.00 0.00 1/476 32308
/proc/meminfo: memFree=9968736/32951124 swapFree=56316216/67111528
[pid=32308] ppid=32306 vsize=188184 CPUtime=0.23 cores=1,3,5,7
/proc/32308/stat : 32308 (SArTagnan) R 32306 32308 32280 0 -1 4202496 3039 0 0 0 23 0 0 0 23 0 4 0 669817788 192700416 2400 33554432000 4194304 4625164 140736978302160 18446744073709551615 4508797 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/32308/statm: 47046 2400 344 106 0 42549 0
Current children cumulated CPU time (s) 0.23
Current children cumulated vsize (KiB) 188184

[startup+0.300953 s]
/proc/loadavg: 0.00 0.00 0.00 1/476 32308
/proc/meminfo: memFree=9968736/32951124 swapFree=56316216/67111528
[pid=32308] ppid=32306 vsize=191792 CPUtime=0.98 cores=1,3,5,7
/proc/32308/stat : 32308 (SArTagnan) R 32306 32308 32280 0 -1 4202496 5626 0 0 0 97 1 0 0 23 0 4 0 669817788 196395008 4057 33554432000 4194304 4625164 140736978302160 18446744073709551615 4511967 0 0 4096 2 18446744073709551615 0 0 17 3 0 0 0
/proc/32308/statm: 47948 4057 345 106 0 43451 0
Current children cumulated CPU time (s) 0.98
Current children cumulated vsize (KiB) 191792

[startup+0.700878 s]
/proc/loadavg: 0.00 0.00 0.00 1/476 32308
/proc/meminfo: memFree=9968736/32951124 swapFree=56316216/67111528
[pid=32308] ppid=32306 vsize=196492 CPUtime=2.58 cores=1,3,5,7
/proc/32308/stat : 32308 (SArTagnan) R 32306 32308 32280 0 -1 4202496 9411 0 0 0 256 2 0 0 25 0 4 0 669817788 201207808 7146 33554432000 4194304 4625164 140736978302160 18446744073709551615 4512035 0 0 4096 2 18446744073709551615 0 0 17 3 0 0 0
/proc/32308/statm: 49123 7146 346 106 0 44626 0
Current children cumulated CPU time (s) 2.58
Current children cumulated vsize (KiB) 196492

[startup+1.50073 s]
/proc/loadavg: 0.00 0.00 0.00 9/488 32325
/proc/meminfo: memFree=9905316/32951124 swapFree=56316216/67111528
[pid=32308] ppid=32306 vsize=201060 CPUtime=5.75 cores=1,3,5,7
/proc/32308/stat : 32308 (SArTagnan) R 32306 32308 32280 0 -1 4202496 15234 0 0 0 573 2 0 0 25 0 4 0 669817788 205885440 10201 33554432000 4194304 4625164 140736978302160 18446744073709551615 4521552 0 0 4096 2 18446744073709551615 0 0 17 3 0 0 0
/proc/32308/statm: 50265 10201 353 106 0 45768 0
[pid=32308/tid=32310] ppid=32306 vsize=201060 CPUtime=1.37 cores=1,3,5,7
/proc/32308/task/32310/stat : 32310 (SArTagnan) R 32306 32308 32280 0 -1 4202560 2059 0 0 0 137 0 0 0 25 0 4 0 669817790 205885440 10201 33554432000 4194304 4625164 140736978302160 18446744073709551615 4352010 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=32308/tid=32311] ppid=32306 vsize=201060 CPUtime=1.45 cores=1,3,5,7
/proc/32308/task/32311/stat : 32311 (SArTagnan) R 32306 32308 32280 0 -1 4202560 2139 0 0 0 145 0 0 0 25 0 4 0 669817790 205885440 10201 33554432000 4194304 4625164 140736978302160 18446744073709551615 4351786 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=32308/tid=32312] ppid=32306 vsize=201060 CPUtime=1.45 cores=1,3,5,7
/proc/32308/task/32312/stat : 32312 (SArTagnan) R 32306 32308 32280 0 -1 4202560 4735 0 0 0 145 0 0 0 25 0 4 0 669817790 205885440 10201 33554432000 4194304 4625164 140736978302160 18446744073709551615 4291670 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 5.75
Current children cumulated vsize (KiB) 201060

[startup+3.10043 s]
/proc/loadavg: 0.64 0.13 0.04 9/488 32325
/proc/meminfo: memFree=9875196/32951124 swapFree=56316216/67111528
[pid=32308] ppid=32306 vsize=208120 CPUtime=12.13 cores=1,3,5,7
/proc/32308/stat : 32308 (SArTagnan) R 32306 32308 32280 0 -1 4202496 26257 0 0 0 1210 3 0 0 25 0 4 0 669817788 213114880 14725 33554432000 4194304 4625164 140736978302160 18446744073709551615 4519682 0 0 4096 2 18446744073709551615 0 0 17 3 0 0 0
/proc/32308/statm: 52030 14725 383 106 0 47533 0
[pid=32308/tid=32310] ppid=32306 vsize=208120 CPUtime=2.97 cores=1,3,5,7
/proc/32308/task/32310/stat : 32310 (SArTagnan) R 32306 32308 32280 0 -1 4202560 3141 0 0 0 297 0 0 0 25 0 4 0 669817790 213114880 14725 33554432000 4194304 4625164 140736978302160 18446744073709551615 4339612 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=32308/tid=32311] ppid=32306 vsize=208120 CPUtime=3.05 cores=1,3,5,7
/proc/32308/task/32311/stat : 32311 (SArTagnan) R 32306 32308 32280 0 -1 4202560 3333 0 0 0 305 0 0 0 25 0 4 0 669817790 213114880 14725 33554432000 4194304 4625164 140736978302160 18446744073709551615 4352280 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=32308/tid=32312] ppid=32306 vsize=208120 CPUtime=3.03 cores=1,3,5,7
/proc/32308/task/32312/stat : 32312 (SArTagnan) R 32306 32308 32280 0 -1 4202560 11693 0 0 0 302 1 0 0 25 0 4 0 669817790 213114880 14725 33554432000 4194304 4625164 140736978302160 18446744073709551615 4334728 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 12.13
Current children cumulated vsize (KiB) 208120

[startup+6.30082 s]
/proc/loadavg: 0.64 0.13 0.04 9/488 32325
/proc/meminfo: memFree=9825724/32951124 swapFree=56316216/67111528
[pid=32308] ppid=32306 vsize=299412 CPUtime=24.89 cores=1,3,5,7
/proc/32308/stat : 32308 (SArTagnan) R 32306 32308 32280 0 -1 4202496 38419 0 0 0 2483 6 0 0 25 0 4 0 669817788 306597888 19506 33554432000 4194304 4625164 140736978302160 18446744073709551615 4511904 0 0 4096 2 18446744073709551615 0 0 17 3 0 0 0
/proc/32308/statm: 74853 19506 353 106 0 70356 0
[pid=32308/tid=32310] ppid=32306 vsize=299412 CPUtime=6.17 cores=1,3,5,7
/proc/32308/task/32310/stat : 32310 (SArTagnan) R 32306 32308 32280 0 -1 4202560 5139 0 0 0 617 0 0 0 25 0 4 0 669817790 306597888 19506 33554432000 4194304 4625164 140736978302160 18446744073709551615 4351827 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=32308/tid=32311] ppid=32306 vsize=299412 CPUtime=6.26 cores=1,3,5,7
/proc/32308/task/32311/stat : 32311 (SArTagnan) R 32306 32308 32280 0 -1 4202560 6448 0 0 0 625 1 0 0 25 0 4 0 669817790 306597888 19506 33554432000 4194304 4625164 140736978302160 18446744073709551615 4316710 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=32308/tid=32312] ppid=32306 vsize=299412 CPUtime=6.18 cores=1,3,5,7
/proc/32308/task/32312/stat : 32312 (SArTagnan) R 32306 32308 32280 0 -1 4202560 15096 0 0 0 616 2 0 0 25 0 4 0 669817790 306597888 19506 33554432000 4194304 4625164 140736978302160 18446744073709551615 4375426 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 24.89
Current children cumulated vsize (KiB) 299412

[startup+12.7006 s]
/proc/loadavg: 1.92 0.42 0.14 9/488 32325
/proc/meminfo: memFree=9758184/32951124 swapFree=56316216/67111528
[pid=32308] ppid=32306 vsize=315672 CPUtime=50.39 cores=1,3,5,7
/proc/32308/stat : 32308 (SArTagnan) R 32306 32308 32280 0 -1 4202496 85161 0 0 0 5024 15 0 0 25 0 4 0 669817788 323248128 29525 33554432000 4194304 4625164 140736978302160 18446744073709551615 4512449 0 0 4096 2 18446744073709551615 0 0 17 3 0 0 0
/proc/32308/statm: 78918 29525 388 106 0 74421 0
[pid=32308/tid=32310] ppid=32306 vsize=315672 CPUtime=12.56 cores=1,3,5,7
/proc/32308/task/32310/stat : 32310 (SArTagnan) R 32306 32308 32280 0 -1 4202560 11232 0 0 0 1255 1 0 0 25 0 4 0 669817790 323248128 29525 33554432000 4194304 4625164 140736978302160 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=32308/tid=32311] ppid=32306 vsize=315672 CPUtime=12.66 cores=1,3,5,7
/proc/32308/task/32311/stat : 32311 (SArTagnan) R 32306 32308 32280 0 -1 4202560 9142 0 0 0 1264 2 0 0 25 0 4 0 669817790 323248128 29525 33554432000 4194304 4625164 140736978302160 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=32308/tid=32312] ppid=32306 vsize=315672 CPUtime=12.49 cores=1,3,5,7
/proc/32308/task/32312/stat : 32312 (SArTagnan) R 32306 32308 32280 0 -1 4202560 47556 0 0 0 1241 8 0 0 25 0 4 0 669817790 323248128 29525 33554432000 4194304 4625164 140736978302160 18446744073709551615 4561283 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 50.39
Current children cumulated vsize (KiB) 315672

[startup+25.5012 s]
/proc/loadavg: 2.85 0.67 0.22 9/488 32326
/proc/meminfo: memFree=9631588/32951124 swapFree=56316216/67111528
[pid=32308] ppid=32306 vsize=349280 CPUtime=101.38 cores=1,3,5,7
/proc/32308/stat : 32308 (SArTagnan) R 32306 32308 32280 0 -1 4202496 169130 0 0 0 10109 29 0 0 25 0 4 0 669817788 357662720 48468 33554432000 4194304 4625164 140736978302160 18446744073709551615 4393074 0 0 4096 2 18446744073709551615 0 0 17 3 0 0 0
/proc/32308/statm: 87320 48468 386 106 0 82823 0
[pid=32308/tid=32310] ppid=32306 vsize=349280 CPUtime=25.36 cores=1,3,5,7
/proc/32308/task/32310/stat : 32310 (SArTagnan) R 32306 32308 32280 0 -1 4202560 17970 0 0 0 2534 2 0 0 25 0 4 0 669817790 357662720 48468 33554432000 4194304 4625164 140736978302160 18446744073709551615 4351878 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=32308/tid=32311] ppid=32306 vsize=349280 CPUtime=25.45 cores=1,3,5,7
/proc/32308/task/32311/stat : 32311 (SArTagnan) R 32306 32308 32280 0 -1 4202560 17413 0 0 0 2541 4 0 0 25 0 4 0 669817790 357662720 48468 33554432000 4194304 4625164 140736978302160 18446744073709551615 4352280 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=32308/tid=32312] ppid=32306 vsize=349280 CPUtime=25.07 cores=1,3,5,7
/proc/32308/task/32312/stat : 32312 (SArTagnan) R 32306 32308 32280 0 -1 4202560 96620 0 0 0 2492 15 0 0 25 0 4 0 669817790 357662720 48468 33554432000 4194304 4625164 140736978302160 18446744073709551615 4352010 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 101.38
Current children cumulated vsize (KiB) 349280

[startup+51.1004 s]
/proc/loadavg: 4.68 1.28 0.43 9/488 32326
/proc/meminfo: memFree=9390500/32951124 swapFree=56316216/67111528
[pid=32308] ppid=32306 vsize=489432 CPUtime=203.38 cores=1,3,5,7
/proc/32308/stat : 32308 (SArTagnan) R 32306 32308 32280 0 -1 4202496 306102 0 0 0 20284 54 0 0 25 0 4 0 669817788 501178368 89713 33554432000 4194304 4625164 140736978302160 18446744073709551615 4512326 0 0 4096 2 18446744073709551615 0 0 17 3 0 0 0
/proc/32308/statm: 122358 89713 395 106 0 117861 0
[pid=32308/tid=32310] ppid=32306 vsize=489432 CPUtime=50.97 cores=1,3,5,7
/proc/32308/task/32310/stat : 32310 (SArTagnan) R 32306 32308 32280 0 -1 4202560 31557 0 0 0 5088 9 0 0 25 0 4 0 669817790 501178368 89713 33554432000 4194304 4625164 140736978302160 18446744073709551615 4351894 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=32308/tid=32311] ppid=32306 vsize=489432 CPUtime=51.05 cores=1,3,5,7
/proc/32308/task/32311/stat : 32311 (SArTagnan) R 32306 32308 32280 0 -1 4202560 20885 0 0 0 5098 7 0 0 25 0 4 0 669817790 501178368 89713 33554432000 4194304 4625164 140736978302160 18446744073709551615 4351814 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=32308/tid=32312] ppid=32306 vsize=489432 CPUtime=50.29 cores=1,3,5,7
/proc/32308/task/32312/stat : 32312 (SArTagnan) R 32306 32308 32280 0 -1 4202560 146025 0 0 0 5006 23 0 0 25 0 4 0 669817790 501178368 89713 33554432000 4194304 4625164 140736978302160 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 203.38
Current children cumulated vsize (KiB) 489432

[startup+102.319 s]
/proc/loadavg: 6.71 2.42 0.87 9/488 32328
/proc/meminfo: memFree=9058016/32951124 swapFree=56316216/67111528
[pid=32308] ppid=32306 vsize=874196 CPUtime=407.46 cores=1,3,5,7
/proc/32308/stat : 32308 (SArTagnan) R 32306 32308 32280 0 -1 4202496 505439 0 0 0 40658 88 0 0 25 0 4 0 669817788 895176704 149148 33554432000 4194304 4625164 140736978302160 18446744073709551615 4512057 0 0 4096 2 18446744073709551615 0 0 17 3 0 0 0
/proc/32308/statm: 218549 149148 451 106 0 214052 0
[pid=32308/tid=32310] ppid=32306 vsize=874196 CPUtime=102.19 cores=1,3,5,7
/proc/32308/task/32310/stat : 32310 (SArTagnan) R 32306 32308 32280 0 -1 4202560 46116 0 0 0 10205 14 0 0 25 0 4 0 669817790 895176704 149148 33554432000 4194304 4625164 140736978302160 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=32308/tid=32311] ppid=32306 vsize=874196 CPUtime=102.26 cores=1,3,5,7
/proc/32308/task/32311/stat : 32311 (SArTagnan) R 32306 32308 32280 0 -1 4202560 29806 0 0 0 10216 10 0 0 25 0 4 0 669817790 895176704 149148 33554432000 4194304 4625164 140736978302160 18446744073709551615 4352739 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=32308/tid=32312] ppid=32306 vsize=874196 CPUtime=100.71 cores=1,3,5,7
/proc/32308/task/32312/stat : 32312 (SArTagnan) R 32306 32308 32280 0 -1 4202560 238097 0 0 0 10035 36 0 0 25 0 4 0 669817790 895176704 149148 33554432000 4194304 4625164 140736978302160 18446744073709551615 4334728 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 407.46
Current children cumulated vsize (KiB) 874196

[startup+162.3 s]
/proc/loadavg: 7.48 3.35 1.28 9/488 32329
/proc/meminfo: memFree=8727276/32951124 swapFree=56316216/67111528
[pid=32308] ppid=32306 vsize=1096124 CPUtime=646.46 cores=1,3,5,7
/proc/32308/stat : 32308 (SArTagnan) R 32306 32308 32280 0 -1 4202496 852122 0 0 0 64495 151 0 0 25 0 4 0 669817788 1122430976 199826 33554432000 4194304 4625164 140736978302160 18446744073709551615 4511904 0 0 4096 2 18446744073709551615 0 0 17 3 0 0 0
/proc/32308/statm: 274031 199826 441 106 0 269534 0
[pid=32308/tid=32310] ppid=32306 vsize=1096124 CPUtime=162.16 cores=1,3,5,7
/proc/32308/task/32310/stat : 32310 (SArTagnan) R 32306 32308 32280 0 -1 4202560 67334 0 0 0 16197 19 0 0 25 0 4 0 669817790 1122430976 199826 33554432000 4194304 4625164 140736978302160 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=32308/tid=32311] ppid=32306 vsize=1096124 CPUtime=162.24 cores=1,3,5,7
/proc/32308/task/32311/stat : 32311 (SArTagnan) R 32306 32308 32280 0 -1 4202560 47815 0 0 0 16204 20 0 0 25 0 4 0 669817790 1122430976 199826 33554432000 4194304 4625164 140736978302160 18446744073709551615 4462375 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=32308/tid=32312] ppid=32306 vsize=1096124 CPUtime=159.78 cores=1,3,5,7
/proc/32308/task/32312/stat : 32312 (SArTagnan) R 32306 32308 32280 0 -1 4202560 432239 0 0 0 15912 66 0 0 25 0 4 0 669817790 1122430976 199826 33554432000 4194304 4625164 140736978302160 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 646.46
Current children cumulated vsize (KiB) 1096124

[startup+222.301 s]
/proc/loadavg: 7.85 4.27 1.73 9/488 32331
/proc/meminfo: memFree=8410544/32951124 swapFree=56316216/67111528
[pid=32308] ppid=32306 vsize=1367976 CPUtime=885.53 cores=1,3,5,7
/proc/32308/stat : 32308 (SArTagnan) R 32306 32308 32280 0 -1 4202496 1065728 0 0 0 88358 195 0 0 25 0 4 0 669817788 1400807424 251806 33554432000 4194304 4625164 140736978302160 18446744073709551615 4511904 0 0 4096 2 18446744073709551615 0 0 17 3 0 0 0
/proc/32308/statm: 341994 251806 348 106 0 337497 0
[pid=32308/tid=32310] ppid=32306 vsize=1367976 CPUtime=222.16 cores=1,3,5,7
/proc/32308/task/32310/stat : 32310 (SArTagnan) R 32306 32308 32280 0 -1 4202560 71042 0 0 0 22194 22 0 0 25 0 4 0 669817790 1400807424 251806 33554432000 4194304 4625164 140736978302160 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=32308/tid=32311] ppid=32306 vsize=1367976 CPUtime=222.24 cores=1,3,5,7
/proc/32308/task/32311/stat : 32311 (SArTagnan) R 32306 32308 32280 0 -1 4202560 54265 0 0 0 22194 30 0 0 25 0 4 0 669817790 1400807424 251806 33554432000 4194304 4625164 140736978302160 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=32308/tid=32312] ppid=32306 vsize=1367976 CPUtime=218.84 cores=1,3,5,7
/proc/32308/task/32312/stat : 32312 (SArTagnan) R 32306 32308 32280 0 -1 4202560 507193 0 0 0 21808 76 0 0 25 0 4 0 669817790 1400807424 251806 33554432000 4194304 4625164 140736978302160 18446744073709551615 4552336 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 885.53
Current children cumulated vsize (KiB) 1367976

[startup+282.301 s]

################
# More data... #
################

Current children cumulated CPU time (s) 2558.93
Current children cumulated vsize (KiB) 2723000

[startup+702.3 s]
/proc/loadavg: 8.14 7.35 4.30 9/488 32344
/proc/meminfo: memFree=6860264/32951124 swapFree=56316216/67111528
[pid=32308] ppid=32306 vsize=2725536 CPUtime=2797.95 cores=1,3,5,7
/proc/32308/stat : 32308 (SArTagnan) R 32306 32308 32280 0 -1 4202496 4371593 0 0 0 279080 715 0 0 25 0 4 0 669817788 2790948864 537129 33554432000 4194304 4625164 140736978302160 18446744073709551615 4511930 0 0 4096 2 18446744073709551615 0 0 17 7 0 0 0
/proc/32308/statm: 681384 537129 347 106 0 676887 0
[pid=32308/tid=32310] ppid=32306 vsize=2725536 CPUtime=702.18 cores=1,3,5,7
/proc/32308/task/32310/stat : 32310 (SArTagnan) R 32306 32308 32280 0 -1 4202560 156311 0 0 0 70166 52 0 0 25 0 4 0 669817790 2790948864 537129 33554432000 4194304 4625164 140736978302160 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=32308/tid=32311] ppid=32306 vsize=2725536 CPUtime=702.23 cores=1,3,5,7
/proc/32308/task/32311/stat : 32311 (SArTagnan) R 32306 32308 32280 0 -1 4202560 107575 0 0 0 70169 54 0 0 25 0 4 0 669817790 2790948864 537129 33554432000 4194304 4625164 140736978302160 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=32308/tid=32312] ppid=32306 vsize=2725536 CPUtime=694.24 cores=1,3,5,7
/proc/32308/task/32312/stat : 32312 (SArTagnan) R 32306 32308 32280 0 -1 4202560 3031061 0 0 0 68980 444 0 0 25 0 4 0 669817790 2790948864 537129 33554432000 4194304 4625164 140736978302160 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 2797.95
Current children cumulated vsize (KiB) 2725536

[startup+762.318 s]
/proc/loadavg: 8.11 7.48 4.54 9/488 32345
/proc/meminfo: memFree=6742792/32951124 swapFree=56316216/67111528
[pid=32308] ppid=32306 vsize=2734768 CPUtime=3037.08 cores=1,3,5,7
/proc/32308/stat : 32308 (SArTagnan) R 32306 32308 32280 0 -1 4202496 4623607 0 0 0 302953 755 0 0 25 0 4 0 669817788 2800402432 558087 33554432000 4194304 4625164 140736978302160 18446744073709551615 4512009 0 0 4096 2 18446744073709551615 0 0 17 7 0 0 0
/proc/32308/statm: 683692 558087 347 106 0 679195 0
[pid=32308/tid=32310] ppid=32306 vsize=2734768 CPUtime=762.2 cores=1,3,5,7
/proc/32308/task/32310/stat : 32310 (SArTagnan) R 32306 32308 32280 0 -1 4202560 157476 0 0 0 76166 54 0 0 25 0 4 0 669817790 2800402432 558087 33554432000 4194304 4625164 140736978302160 18446744073709551615 4488046 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=32308/tid=32311] ppid=32306 vsize=2734768 CPUtime=762.25 cores=1,3,5,7
/proc/32308/task/32311/stat : 32311 (SArTagnan) R 32306 32308 32280 0 -1 4202560 108035 0 0 0 76171 54 0 0 25 0 4 0 669817790 2800402432 558087 33554432000 4194304 4625164 140736978302160 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=32308/tid=32312] ppid=32306 vsize=2734768 CPUtime=754.25 cores=1,3,5,7
/proc/32308/task/32312/stat : 32312 (SArTagnan) R 32306 32308 32280 0 -1 4202560 3258316 0 0 0 74949 476 0 0 25 0 4 0 669817790 2800402432 558087 33554432000 4194304 4625164 140736978302160 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 3037.08
Current children cumulated vsize (KiB) 2734768

[startup+822.301 s]
/proc/loadavg: 8.08 7.59 4.75 9/488 32347
/proc/meminfo: memFree=6645536/32951124 swapFree=56316216/67111528
[pid=32308] ppid=32306 vsize=2863504 CPUtime=3276.09 cores=1,3,5,7
/proc/32308/stat : 32308 (SArTagnan) R 32306 32308 32280 0 -1 4202496 4940855 0 0 0 326806 803 0 0 25 0 4 0 669817788 2932228096 569615 33554432000 4194304 4625164 140736978302160 18446744073709551615 4519388 0 0 4096 2 18446744073709551615 0 0 17 7 0 0 0
/proc/32308/statm: 715876 569615 351 106 0 711379 0
[pid=32308/tid=32310] ppid=32306 vsize=2863504 CPUtime=822.19 cores=1,3,5,7
/proc/32308/task/32310/stat : 32310 (SArTagnan) R 32306 32308 32280 0 -1 4202560 157571 0 0 0 82165 54 0 0 25 0 4 0 669817790 2932228096 569615 33554432000 4194304 4625164 140736978302160 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=32308/tid=32311] ppid=32306 vsize=2863504 CPUtime=822.23 cores=1,3,5,7
/proc/32308/task/32311/stat : 32311 (SArTagnan) R 32306 32308 32280 0 -1 4202560 108598 0 0 0 82168 55 0 0 25 0 4 0 669817790 2932228096 569615 33554432000 4194304 4625164 140736978302160 18446744073709551615 4351814 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=32308/tid=32312] ppid=32306 vsize=2863504 CPUtime=814.24 cores=1,3,5,7
/proc/32308/task/32312/stat : 32312 (SArTagnan) R 32306 32308 32280 0 -1 4202560 3505969 0 0 0 80910 514 0 0 25 0 4 0 669817790 2932228096 569615 33554432000 4194304 4625164 140736978302160 18446744073709551615 4351818 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 3276.09
Current children cumulated vsize (KiB) 2863504

[startup+882.3 s]
/proc/loadavg: 8.07 7.68 4.96 9/488 32349
/proc/meminfo: memFree=6413368/32951124 swapFree=56316216/67111528
[pid=32308] ppid=32306 vsize=2896276 CPUtime=3515.14 cores=1,3,5,7
/proc/32308/stat : 32308 (SArTagnan) R 32306 32308 32280 0 -1 4202496 5295060 0 0 0 350654 860 0 0 25 0 4 0 669817788 2965786624 617267 33554432000 4194304 4625164 140736978302160 18446744073709551615 4519391 0 0 4096 2 18446744073709551615 0 0 17 7 0 0 0
/proc/32308/statm: 724069 617267 347 106 0 719572 0
[pid=32308/tid=32310] ppid=32306 vsize=2896276 CPUtime=882.18 cores=1,3,5,7
/proc/32308/task/32310/stat : 32310 (SArTagnan) R 32306 32308 32280 0 -1 4202560 158001 0 0 0 88164 54 0 0 25 0 4 0 669817790 2965786624 617267 33554432000 4194304 4625164 140736978302160 18446744073709551615 4488037 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=32308/tid=32311] ppid=32306 vsize=2896276 CPUtime=882.23 cores=1,3,5,7
/proc/32308/task/32311/stat : 32311 (SArTagnan) R 32306 32308 32280 0 -1 4202560 109322 0 0 0 88168 55 0 0 25 0 4 0 669817790 2965786624 617267 33554432000 4194304 4625164 140736978302160 18446744073709551615 4339612 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=32308/tid=32312] ppid=32306 vsize=2896276 CPUtime=874.24 cores=1,3,5,7
/proc/32308/task/32312/stat : 32312 (SArTagnan) R 32306 32308 32280 0 -1 4202560 3796268 0 0 0 86866 558 0 0 25 0 4 0 669817790 2965786624 617267 33554432000 4194304 4625164 140736978302160 18446744073709551615 4352014 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 3515.14
Current children cumulated vsize (KiB) 2896276

[startup+942.301 s]
/proc/loadavg: 8.11 7.76 5.14 9/488 32350
/proc/meminfo: memFree=6200288/32951124 swapFree=56316216/67111528
[pid=32308] ppid=32306 vsize=3457948 CPUtime=3754.19 cores=1,3,5,7
/proc/32308/stat : 32308 (SArTagnan) R 32306 32308 32280 0 -1 4202496 5705059 0 0 0 374504 915 0 0 25 0 4 0 669817788 3540938752 658251 33554432000 4194304 4625164 140736978302160 18446744073709551615 4511930 0 0 4096 2 18446744073709551615 0 0 17 7 0 0 0
/proc/32308/statm: 864487 658251 347 106 0 859990 0
[pid=32308/tid=32310] ppid=32306 vsize=3457948 CPUtime=942.19 cores=1,3,5,7
/proc/32308/task/32310/stat : 32310 (SArTagnan) R 32306 32308 32280 0 -1 4202560 158051 0 0 0 94165 54 0 0 25 0 4 0 669817790 3540938752 658251 33554432000 4194304 4625164 140736978302160 18446744073709551615 4330841 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=32308/tid=32311] ppid=32306 vsize=3457948 CPUtime=942.23 cores=1,3,5,7
/proc/32308/task/32311/stat : 32311 (SArTagnan) R 32306 32308 32280 0 -1 4202560 109625 0 0 0 94168 55 0 0 25 0 4 0 669817790 3540938752 658251 33554432000 4194304 4625164 140736978302160 18446744073709551615 4352035 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=32308/tid=32312] ppid=32306 vsize=3457948 CPUtime=934.25 cores=1,3,5,7
/proc/32308/task/32312/stat : 32312 (SArTagnan) R 32306 32308 32280 0 -1 4202560 3894681 0 0 0 92852 573 0 0 25 0 4 0 669817790 3540938752 658251 33554432000 4194304 4625164 140736978302160 18446744073709551615 4335407 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 3754.19
Current children cumulated vsize (KiB) 3457948

[startup+1002.3 s]
/proc/loadavg: 8.18 7.85 5.35 9/488 32352
/proc/meminfo: memFree=6151288/32951124 swapFree=56316216/67111528
[pid=32308] ppid=32306 vsize=3468112 CPUtime=3993.22 cores=1,3,5,7
/proc/32308/stat : 32308 (SArTagnan) R 32306 32308 32280 0 -1 4202496 6025629 0 0 0 398350 972 0 0 25 0 4 0 669817788 3551346688 665345 33554432000 4194304 4625164 140736978302160 18446744073709551615 4511904 0 0 4096 2 18446744073709551615 0 0 17 7 0 0 0
/proc/32308/statm: 867028 665345 347 106 0 862531 0
[pid=32308/tid=32310] ppid=32306 vsize=3468112 CPUtime=1002.19 cores=1,3,5,7
/proc/32308/task/32310/stat : 32310 (SArTagnan) R 32306 32308 32280 0 -1 4202560 158374 0 0 0 100165 54 0 0 25 0 4 0 669817790 3551346688 665345 33554432000 4194304 4625164 140736978302160 18446744073709551615 4488046 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=32308/tid=32311] ppid=32306 vsize=3468112 CPUtime=1002.23 cores=1,3,5,7
/proc/32308/task/32311/stat : 32311 (SArTagnan) R 32306 32308 32280 0 -1 4202560 113022 0 0 0 100166 57 0 0 25 0 4 0 669817790 3551346688 665345 33554432000 4194304 4625164 140736978302160 18446744073709551615 4352035 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=32308/tid=32312] ppid=32306 vsize=3468112 CPUtime=994.25 cores=1,3,5,7
/proc/32308/task/32312/stat : 32312 (SArTagnan) R 32306 32308 32280 0 -1 4202560 4177954 0 0 0 98804 621 0 0 25 0 4 0 669817790 3551346688 665345 33554432000 4194304 4625164 140736978302160 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 3993.22
Current children cumulated vsize (KiB) 3468112

[startup+1062.3 s]
/proc/loadavg: 8.22 7.92 5.51 9/488 32353
/proc/meminfo: memFree=6069780/32951124 swapFree=56316216/67111528
[pid=32308] ppid=32306 vsize=3575220 CPUtime=4232.29 cores=1,3,5,7
/proc/32308/stat : 32308 (SArTagnan) R 32306 32308 32280 0 -1 4202496 6555446 0 0 0 422174 1055 0 0 25 0 4 0 669817788 3661025280 682012 33554432000 4194304 4625164 140736978302160 18446744073709551615 4511904 0 0 4096 2 18446744073709551615 0 0 17 7 0 0 0
/proc/32308/statm: 893805 682012 369 106 0 889308 0
[pid=32308/tid=32310] ppid=32306 vsize=3575220 CPUtime=1062.19 cores=1,3,5,7
/proc/32308/task/32310/stat : 32310 (SArTagnan) R 32306 32308 32280 0 -1 4202560 158826 0 0 0 106165 54 0 0 25 0 4 0 669817790 3661025280 682012 33554432000 4194304 4625164 140736978302160 18446744073709551615 4488046 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=32308/tid=32311] ppid=32306 vsize=3575220 CPUtime=1062.23 cores=1,3,5,7
/proc/32308/task/32311/stat : 32311 (SArTagnan) R 32306 32308 32280 0 -1 4202560 115271 0 0 0 106164 59 0 0 25 0 4 0 669817790 3661025280 682012 33554432000 4194304 4625164 140736978302160 18446744073709551615 4351801 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=32308/tid=32312] ppid=32306 vsize=3575220 CPUtime=1054.25 cores=1,3,5,7
/proc/32308/task/32312/stat : 32312 (SArTagnan) R 32306 32308 32280 0 -1 4202560 4682616 0 0 0 104729 696 0 0 25 0 4 0 669817790 3661025280 682012 33554432000 4194304 4625164 140736978302160 18446744073709551615 4334728 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 4232.29
Current children cumulated vsize (KiB) 3575220

[startup+1122.3 s]
/proc/loadavg: 8.24 7.98 5.70 9/488 32364
/proc/meminfo: memFree=5924392/32951124 swapFree=56316216/67111528
[pid=32308] ppid=32306 vsize=3606968 CPUtime=4471.33 cores=1,3,5,7
/proc/32308/stat : 32308 (SArTagnan) R 32306 32308 32280 0 -1 4202496 6948841 0 0 0 446009 1124 0 0 25 0 4 0 669817788 3693535232 711223 33554432000 4194304 4625164 140736978302160 18446744073709551615 4510186 0 0 4096 2 18446744073709551615 0 0 17 7 0 0 0
/proc/32308/statm: 901742 711223 347 106 0 897245 0
[pid=32308/tid=32310] ppid=32306 vsize=3606968 CPUtime=1122.19 cores=1,3,5,7
/proc/32308/task/32310/stat : 32310 (SArTagnan) R 32306 32308 32280 0 -1 4202560 159189 0 0 0 112165 54 0 0 25 0 4 0 669817790 3693535232 711223 33554432000 4194304 4625164 140736978302160 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=32308/tid=32311] ppid=32306 vsize=3606968 CPUtime=1122.23 cores=1,3,5,7
/proc/32308/task/32311/stat : 32311 (SArTagnan) R 32306 32308 32280 0 -1 4202560 118845 0 0 0 112159 64 0 0 25 0 4 0 669817790 3693535232 711223 33554432000 4194304 4625164 140736978302160 18446744073709551615 4352005 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=32308/tid=32312] ppid=32306 vsize=3606968 CPUtime=1114.25 cores=1,3,5,7
/proc/32308/task/32312/stat : 32312 (SArTagnan) R 32306 32308 32280 0 -1 4202560 5051067 0 0 0 110667 758 0 0 25 0 4 0 669817790 3693535232 711223 33554432000 4194304 4625164 140736978302160 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 4471.33
Current children cumulated vsize (KiB) 3606968

[startup+1182.3 s]
/proc/loadavg: 8.10 7.98 5.83 9/488 32366
/proc/meminfo: memFree=5872156/32951124 swapFree=56316216/67111528
[pid=32308] ppid=32306 vsize=3673712 CPUtime=4710.4 cores=1,3,5,7
/proc/32308/stat : 32308 (SArTagnan) R 32306 32308 32280 0 -1 4202496 7337204 0 0 0 469848 1192 0 0 25 0 4 0 669817788 3761881088 719445 33554432000 4194304 4625164 140736978302160 18446744073709551615 4511930 0 0 4096 2 18446744073709551615 0 0 17 7 0 0 0
/proc/32308/statm: 918428 719445 347 106 0 913931 0
[pid=32308/tid=32310] ppid=32306 vsize=3673712 CPUtime=1182.2 cores=1,3,5,7
/proc/32308/task/32310/stat : 32310 (SArTagnan) R 32306 32308 32280 0 -1 4202560 159550 0 0 0 118165 55 0 0 25 0 4 0 669817790 3761881088 719445 33554432000 4194304 4625164 140736978302160 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=32308/tid=32311] ppid=32306 vsize=3673712 CPUtime=1182.23 cores=1,3,5,7
/proc/32308/task/32311/stat : 32311 (SArTagnan) R 32306 32308 32280 0 -1 4202560 121315 0 0 0 118155 68 0 0 25 0 4 0 669817790 3761881088 719445 33554432000 4194304 4625164 140736978302160 18446744073709551615 4316929 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=32308/tid=32312] ppid=32306 vsize=3673712 CPUtime=1174.25 cores=1,3,5,7
/proc/32308/task/32312/stat : 32312 (SArTagnan) R 32306 32308 32280 0 -1 4202560 5433440 0 0 0 116605 820 0 0 25 0 4 0 669817790 3761881088 719445 33554432000 4194304 4625164 140736978302160 18446744073709551615 4547280 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 4710.4
Current children cumulated vsize (KiB) 3673712



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1204.8 s]
/proc/loadavg: 8.13 7.99 5.89 9/488 32366
/proc/meminfo: memFree=5846724/32951124 swapFree=56316216/67111528
[pid=32308] ppid=32306 vsize=3673712 CPUtime=4800.09 cores=1,3,5,7
/proc/32308/stat : 32308 (SArTagnan) R 32306 32308 32280 0 -1 4202496 7494280 0 0 0 478788 1221 0 0 25 0 4 0 669817788 3761881088 724328 33554432000 4194304 4625164 140736978302160 18446744073709551615 4512869 0 0 4096 2 18446744073709551615 0 0 17 7 0 0 0
/proc/32308/statm: 918428 724328 353 106 0 913931 0
[pid=32308/tid=32310] ppid=32306 vsize=3673712 CPUtime=1204.72 cores=1,3,5,7
/proc/32308/task/32310/stat : 32310 (SArTagnan) R 32306 32308 32280 0 -1 4202560 159623 0 0 0 120417 55 0 0 25 0 4 0 669817790 3761881088 724328 33554432000 4194304 4625164 140736978302160 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=32308/tid=32311] ppid=32306 vsize=3673712 CPUtime=1204.74 cores=1,3,5,7
/proc/32308/task/32311/stat : 32311 (SArTagnan) R 32306 32308 32280 0 -1 4202560 122967 0 0 0 120403 71 0 0 25 0 4 0 669817790 3761881088 724328 33554432000 4194304 4625164 140736978302160 18446744073709551615 4339564 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=32308/tid=32312] ppid=32306 vsize=3673712 CPUtime=1196.77 cores=1,3,5,7
/proc/32308/task/32312/stat : 32312 (SArTagnan) R 32306 32308 32280 0 -1 4202560 5587633 0 0 0 118832 845 0 0 25 0 4 0 669817790 3761881088 724328 33554432000 4194304 4625164 140736978302160 18446744073709551615 4339176 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 4800.09
Current children cumulated vsize (KiB) 3673712

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1204.92 s]
/proc/loadavg: 8.13 7.99 5.89 9/488 32366
/proc/meminfo: memFree=5846724/32951124 swapFree=56316216/67111528
[pid=32308] ppid=32306 vsize=0 CPUtime=4800.21 cores=1,3,5,7
/proc/32308/stat : 32308 (SArTagnan) R 32306 32308 32280 0 -1 4203524 7494285 0 0 0 478790 1231 0 0 25 0 1 0 669817788 0 0 33554432000 0 0 0 0 0 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/32308/statm: 0 0 0 0 0 0 0
Current children cumulated CPU time (s) 4800.21
Current children cumulated vsize (KiB) 0

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1204.93
CPU time (s): 4800.23
CPU user time (s): 4787.91
CPU system time (s): 12.3171
CPU usage (%): 398.383
Max. virtual memory (cumulated for all children) (KiB): 4383972

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4787.91
system time used= 12.3171
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 7494285
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 6003
involuntary context switches= 31482

runsolver used 5.08223 second user time and 13.7719 second system time

The end

Launcher Data 

Begin job on node102 at 2011-05-16 23:42:34
IDJOB=3385975
IDBENCH=83903
IDSOLVER=1871
FILE ID=node102/3385975-1305582154
RUNJOBID= node102-1305582154-32299
PBS_JOBID= 13350312
Free space on /tmp= 73580 MiB

SOLVER NAME= SArTagnan 2011-05-15 (fixed)
BENCH NAME= SAT03/handmade/anton/UNSAT/SGI_30_70_26_40_6-dir.shuffled-as.sat03-163.cnf
COMMAND LINE= SArTagnan BENCHNAME -threads=NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3385975-1305582154/watcher-3385975-1305582154 -o /tmp/evaluation-result-3385975-1305582154/solver-3385975-1305582154 -C 4800 -W 1300 -M 15500  SArTagnan HOME/instance-3385975-1305582154.cnf -threads=4

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= c06088cac8521bfe72bbb4c9ad8d39fb
RANDOM SEED=1615407170

node102.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.65
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.15
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:       9969008 kB
Buffers:        138760 kB
Cached:        1027180 kB
SwapCached:      33496 kB
Active:       14113412 kB
Inactive:      8617420 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:       9969008 kB
SwapTotal:    67111528 kB
SwapFree:     56316216 kB
Dirty:            1232 kB
Writeback:           0 kB
AnonPages:    21542384 kB
Mapped:          24380 kB
Slab:            80312 kB
PageTables:      99788 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 135451428 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73576 MiB
End job on node102 at 2011-05-17 00:02:41