Trace number 3385856

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
SArTagnan 2011-05-15 (fixed)? (TO) 4800.56 1233.95

General information on the benchmark

Namecrafted/anton/SRHD-SGI/
srhd-sgi-m62-q1327.5-n60-p15-s1351253.cnf
MD5SUMb23c52475e3d098cb9d5a92c025d6982
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark7.18991
Satisfiable
(Un)Satisfiability was proved
Number of variables3420
Number of clauses1120760
Sum of the clauses size2244820
Maximum clause length62
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 21120700
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 560

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3385856-1305583672/watcher-3385856-1305583672 -o /tmp/evaluation-result-3385856-1305583672/solver-3385856-1305583672 -C 4800 -W 1300 -M 15500 SArTagnan HOME/instance-3385856-1305583672.cnf -threads=4 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 10.10 10.02 8.52 8/434 14353
/proc/meminfo: memFree=16795828/32951124 swapFree=44485784/67111528
[pid=14353] ppid=14351 vsize=45804 CPUtime=0.01 cores=1,3,5,7
/proc/14353/stat : 14353 (SArTagnan) R 14351 14353 14137 0 -1 4202496 962 0 0 0 1 0 0 0 25 0 1 0 669967649 46903296 630 33554432000 4194304 4625164 140737116686384 18446744073709551615 4339447 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/14353/statm: 11451 630 296 106 0 6954 0

[startup+0.0312911 s]
/proc/loadavg: 10.10 10.02 8.52 8/434 14353
/proc/meminfo: memFree=16795828/32951124 swapFree=44485784/67111528
[pid=14353] ppid=14351 vsize=46640 CPUtime=0.02 cores=1,3,5,7
/proc/14353/stat : 14353 (SArTagnan) R 14351 14353 14137 0 -1 4202496 1588 0 0 0 2 0 0 0 25 0 1 0 669967649 47759360 837 33554432000 4194304 4625164 140737116686384 18446744073709551615 4339447 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/14353/statm: 11660 837 296 106 0 7163 0
Current children cumulated CPU time (s) 0.02
Current children cumulated vsize (KiB) 46640

[startup+0.100285 s]
/proc/loadavg: 10.10 10.02 8.52 8/434 14353
/proc/meminfo: memFree=16795828/32951124 swapFree=44485784/67111528
[pid=14353] ppid=14351 vsize=52764 CPUtime=0.09 cores=1,3,5,7
/proc/14353/stat : 14353 (SArTagnan) R 14351 14353 14137 0 -1 4202496 5652 0 0 0 9 0 0 0 25 0 1 0 669967649 54030336 1839 33554432000 4194304 4625164 140737116686384 18446744073709551615 4339447 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/14353/statm: 13191 1839 296 106 0 8694 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 52764

[startup+0.300211 s]
/proc/loadavg: 10.10 10.02 8.52 8/434 14353
/proc/meminfo: memFree=16795828/32951124 swapFree=44485784/67111528
[pid=14353] ppid=14351 vsize=276600 CPUtime=0.32 cores=1,3,5,7
/proc/14353/stat : 14353 (SArTagnan) R 14351 14353 14137 0 -1 4202496 23832 0 0 0 30 2 0 0 25 0 4 0 669967649 283238400 15241 33554432000 4194304 4625164 140737116686384 18446744073709551615 4500185 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/14353/statm: 69150 15241 332 106 0 64653 0
Current children cumulated CPU time (s) 0.32
Current children cumulated vsize (KiB) 276600

[startup+0.700139 s]
/proc/loadavg: 10.10 10.02 8.52 8/434 14353
/proc/meminfo: memFree=16795828/32951124 swapFree=44485784/67111528
[pid=14353] ppid=14351 vsize=311472 CPUtime=1.52 cores=1,3,5,7
/proc/14353/stat : 14353 (SArTagnan) R 14351 14353 14137 0 -1 4202496 46244 0 0 0 146 6 0 0 25 0 4 0 669967649 318947328 31088 33554432000 4194304 4625164 140737116686384 18446744073709551615 4360288 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/14353/statm: 77868 31088 431 106 0 73371 0
Current children cumulated CPU time (s) 1.52
Current children cumulated vsize (KiB) 311472

[startup+1.50099 s]
/proc/loadavg: 10.10 10.02 8.52 11/438 14357
/proc/meminfo: memFree=16640688/32951124 swapFree=44485784/67111528
[pid=14353] ppid=14351 vsize=381276 CPUtime=3.9 cores=1,3,5,7
/proc/14353/stat : 14353 (SArTagnan) R 14351 14353 14137 0 -1 4202496 50111 0 0 0 383 7 0 0 18 0 4 0 669967649 390426624 34754 33554432000 4194304 4625164 140737116686384 18446744073709551615 4512046 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/14353/statm: 95319 34754 343 106 0 90822 0
[pid=14353/tid=14355] ppid=14351 vsize=381276 CPUtime=0.88 cores=1,3,5,7
/proc/14353/task/14355/stat : 14355 (SArTagnan) R 14351 14353 14137 0 -1 4202560 1837 0 0 0 88 0 0 0 18 0 4 0 669967678 390426624 34754 33554432000 4194304 4625164 140737116686384 18446744073709551615 4351781 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=14353/tid=14356] ppid=14351 vsize=381276 CPUtime=1.19 cores=1,3,5,7
/proc/14353/task/14356/stat : 14356 (SArTagnan) R 14351 14353 14137 0 -1 4202560 1903 0 0 0 119 0 0 0 25 0 4 0 669967678 390426624 34754 33554432000 4194304 4625164 140737116686384 18446744073709551615 4352021 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=14353/tid=14357] ppid=14351 vsize=381276 CPUtime=0.55 cores=1,3,5,7
/proc/14353/task/14357/stat : 14357 (SArTagnan) R 14351 14353 14137 0 -1 4202560 359 0 0 0 55 0 0 0 25 0 4 0 669967678 390426624 34754 33554432000 4194304 4625164 140737116686384 18446744073709551615 4279928 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 3.9
Current children cumulated vsize (KiB) 381276

[startup+3.10069 s]
/proc/loadavg: 10.09 10.02 8.53 11/438 14357
/proc/meminfo: memFree=16605844/32951124 swapFree=44485784/67111528
[pid=14353] ppid=14351 vsize=403288 CPUtime=8.68 cores=1,3,5,7
/proc/14353/stat : 14353 (SArTagnan) R 14351 14353 14137 0 -1 4202496 58698 0 0 0 860 8 0 0 21 0 4 0 669967649 412966912 42573 33554432000 4194304 4625164 140737116686384 18446744073709551615 4509196 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/14353/statm: 100822 42573 347 106 0 96325 0
[pid=14353/tid=14355] ppid=14351 vsize=403288 CPUtime=1.71 cores=1,3,5,7
/proc/14353/task/14355/stat : 14355 (SArTagnan) R 14351 14353 14137 0 -1 4202560 3256 0 0 0 171 0 0 0 20 0 4 0 669967678 412966912 42573 33554432000 4194304 4625164 140737116686384 18446744073709551615 4352021 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=14353/tid=14356] ppid=14351 vsize=403288 CPUtime=2.79 cores=1,3,5,7
/proc/14353/task/14356/stat : 14356 (SArTagnan) R 14351 14353 14137 0 -1 4202560 7068 0 0 0 278 1 0 0 25 0 4 0 669967678 412966912 42573 33554432000 4194304 4625164 140737116686384 18446744073709551615 4352032 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=14353/tid=14357] ppid=14351 vsize=403288 CPUtime=1.3 cores=1,3,5,7
/proc/14353/task/14357/stat : 14357 (SArTagnan) R 14351 14353 14137 0 -1 4202560 2065 0 0 0 130 0 0 0 25 0 4 0 669967678 412966912 42573 33554432000 4194304 4625164 140737116686384 18446744073709551615 4334258 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 8.68
Current children cumulated vsize (KiB) 403288

[startup+6.3011 s]
/proc/loadavg: 10.09 10.02 8.53 11/438 14357
/proc/meminfo: memFree=16498784/32951124 swapFree=44485784/67111528
[pid=14353] ppid=14351 vsize=430272 CPUtime=18.24 cores=1,3,5,7
/proc/14353/stat : 14353 (SArTagnan) R 14351 14353 14137 0 -1 4202496 73392 0 0 0 1813 11 0 0 25 0 4 0 669967649 440598528 50725 33554432000 4194304 4625164 140737116686384 18446744073709551615 4511941 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/14353/statm: 107568 50725 365 106 0 103071 0
[pid=14353/tid=14355] ppid=14351 vsize=430272 CPUtime=4.47 cores=1,3,5,7
/proc/14353/task/14355/stat : 14355 (SArTagnan) R 14351 14353 14137 0 -1 4202560 5242 0 0 0 446 1 0 0 25 0 4 0 669967678 440598528 50725 33554432000 4194304 4625164 140737116686384 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=14353/tid=14356] ppid=14351 vsize=430272 CPUtime=4.78 cores=1,3,5,7
/proc/14353/task/14356/stat : 14356 (SArTagnan) R 14351 14353 14137 0 -1 4202560 10510 0 0 0 477 1 0 0 25 0 4 0 669967678 440598528 50725 33554432000 4194304 4625164 140737116686384 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=14353/tid=14357] ppid=14351 vsize=430272 CPUtime=2.9 cores=1,3,5,7
/proc/14353/task/14357/stat : 14357 (SArTagnan) R 14351 14353 14137 0 -1 4202560 3328 0 0 0 290 0 0 0 25 0 4 0 669967678 440598528 50725 33554432000 4194304 4625164 140737116686384 18446744073709551615 4547768 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 18.24
Current children cumulated vsize (KiB) 430272

[startup+12.7009 s]
/proc/loadavg: 10.15 10.03 8.55 11/438 14357
/proc/meminfo: memFree=15761612/32951124 swapFree=44485784/67111528
[pid=14353] ppid=14351 vsize=454928 CPUtime=37.34 cores=1,3,5,7
/proc/14353/stat : 14353 (SArTagnan) R 14351 14353 14137 0 -1 4202496 84825 0 0 0 3721 13 0 0 25 0 4 0 669967649 465846272 61550 33554432000 4194304 4625164 140737116686384 18446744073709551615 4512066 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/14353/statm: 113732 61550 450 106 0 109235 0
[pid=14353/tid=14355] ppid=14351 vsize=454928 CPUtime=8.1 cores=1,3,5,7
/proc/14353/task/14355/stat : 14355 (SArTagnan) R 14351 14353 14137 0 -1 4202560 8549 0 0 0 808 2 0 0 25 0 4 0 669967678 465846272 61550 33554432000 4194304 4625164 140737116686384 18446744073709551615 4352021 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=14353/tid=14356] ppid=14351 vsize=454928 CPUtime=7.94 cores=1,3,5,7
/proc/14353/task/14356/stat : 14356 (SArTagnan) R 14351 14353 14137 0 -1 4202560 15803 0 0 0 792 2 0 0 25 0 4 0 669967678 465846272 61550 33554432000 4194304 4625164 140737116686384 18446744073709551615 4464333 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=14353/tid=14357] ppid=14351 vsize=454928 CPUtime=8.8 cores=1,3,5,7
/proc/14353/task/14357/stat : 14357 (SArTagnan) R 14351 14353 14137 0 -1 4202560 4295 0 0 0 880 0 0 0 25 0 4 0 669967678 465846272 61550 33554432000 4194304 4625164 140737116686384 18446744073709551615 4352032 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 37.34
Current children cumulated vsize (KiB) 454928

[startup+25.5005 s]
/proc/loadavg: 10.13 10.03 8.56 11/438 14357
/proc/meminfo: memFree=15321284/32951124 swapFree=44485784/67111528
[pid=14353] ppid=14351 vsize=549092 CPUtime=76.82 cores=1,3,5,7
/proc/14353/stat : 14353 (SArTagnan) R 14351 14353 14137 0 -1 4202496 126736 0 0 0 7663 19 0 0 25 0 4 0 669967649 562270208 81699 33554432000 4194304 4625164 140737116686384 18446744073709551615 4519248 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/14353/statm: 137273 81699 487 106 0 132776 0
[pid=14353/tid=14355] ppid=14351 vsize=549092 CPUtime=14.47 cores=1,3,5,7
/proc/14353/task/14355/stat : 14355 (SArTagnan) R 14351 14353 14137 0 -1 4202560 13567 0 0 0 1444 3 0 0 25 0 4 0 669967678 562270208 81699 33554432000 4194304 4625164 140737116686384 18446744073709551615 4375281 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=14353/tid=14356] ppid=14351 vsize=549092 CPUtime=15.47 cores=1,3,5,7
/proc/14353/task/14356/stat : 14356 (SArTagnan) R 14351 14353 14137 0 -1 4202560 23319 0 0 0 1543 4 0 0 25 0 4 0 669967678 562270208 81699 33554432000 4194304 4625164 140737116686384 18446744073709551615 4351975 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=14353/tid=14357] ppid=14351 vsize=549092 CPUtime=21.59 cores=1,3,5,7
/proc/14353/task/14357/stat : 14357 (SArTagnan) R 14351 14353 14137 0 -1 4202560 30282 0 0 0 2156 3 0 0 25 0 4 0 669967678 562270208 81699 33554432000 4194304 4625164 140737116686384 18446744073709551615 4579601 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 76.82
Current children cumulated vsize (KiB) 549092

[startup+51.1008 s]
/proc/loadavg: 10.08 10.03 8.60 11/438 14358
/proc/meminfo: memFree=13827796/32951124 swapFree=44485784/67111528
[pid=14353] ppid=14351 vsize=689332 CPUtime=169.92 cores=1,3,5,7
/proc/14353/stat : 14353 (SArTagnan) R 14351 14353 14137 0 -1 4202496 268463 0 0 0 16949 43 0 0 25 0 4 0 669967649 705875968 125955 33554432000 4194304 4625164 140737116686384 18446744073709551615 4393061 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/14353/statm: 172333 125955 684 106 0 167836 0
[pid=14353/tid=14355] ppid=14351 vsize=689332 CPUtime=31.12 cores=1,3,5,7
/proc/14353/task/14355/stat : 14355 (SArTagnan) R 14351 14353 14137 0 -1 4202560 29280 0 0 0 3105 7 0 0 25 0 4 0 669967678 705875968 125955 33554432000 4194304 4625164 140737116686384 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=14353/tid=14356] ppid=14351 vsize=689332 CPUtime=40.71 cores=1,3,5,7
/proc/14353/task/14356/stat : 14356 (SArTagnan) R 14351 14353 14137 0 -1 4202560 35197 0 0 0 4065 6 0 0 25 0 4 0 669967678 705875968 125955 33554432000 4194304 4625164 140737116686384 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=14353/tid=14357] ppid=14351 vsize=689332 CPUtime=47.2 cores=1,3,5,7
/proc/14353/task/14357/stat : 14357 (SArTagnan) R 14351 14353 14137 0 -1 4202560 108790 0 0 0 4705 15 0 0 25 0 4 0 669967678 705875968 125955 33554432000 4194304 4625164 140737116686384 18446744073709551615 4352035 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 169.92
Current children cumulated vsize (KiB) 689332

[startup+102.317 s]
/proc/loadavg: 10.07 10.03 8.68 11/438 14359
/proc/meminfo: memFree=10160852/32951124 swapFree=44485784/67111528
[pid=14353] ppid=14351 vsize=1132768 CPUtime=330.31 cores=1,3,5,7
/proc/14353/stat : 14353 (SArTagnan) R 14351 14353 14137 0 -1 4202496 483163 0 0 0 32944 87 0 0 20 0 4 0 669967649 1159954432 210372 33554432000 4194304 4625164 140737116686384 18446744073709551615 4393074 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/14353/statm: 283192 210372 403 106 0 278695 0
[pid=14353/tid=14355] ppid=14351 vsize=1132768 CPUtime=63.8 cores=1,3,5,7
/proc/14353/task/14355/stat : 14355 (SArTagnan) R 14351 14353 14137 0 -1 4202560 55564 0 0 0 6358 22 0 0 19 0 4 0 669967678 1159954432 210372 33554432000 4194304 4625164 140737116686384 18446744073709551615 4352021 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=14353/tid=14356] ppid=14351 vsize=1132768 CPUtime=84.51 cores=1,3,5,7
/proc/14353/task/14356/stat : 14356 (SArTagnan) R 14351 14353 14137 0 -1 4202560 55447 0 0 0 8438 13 0 0 25 0 4 0 669967678 1159954432 210372 33554432000 4194304 4625164 140737116686384 18446744073709551615 4352014 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=14353/tid=14357] ppid=14351 vsize=1132768 CPUtime=96.18 cores=1,3,5,7
/proc/14353/task/14357/stat : 14357 (SArTagnan) R 14351 14353 14137 0 -1 4202560 119382 0 0 0 9600 18 0 0 25 0 4 0 669967678 1159954432 210372 33554432000 4194304 4625164 140737116686384 18446744073709551615 4334728 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 330.31
Current children cumulated vsize (KiB) 1132768

[startup+162.301 s]
/proc/loadavg: 9.00 9.80 8.68 7/429 14378
/proc/meminfo: memFree=20385776/32951124 swapFree=44485784/67111528
[pid=14353] ppid=14351 vsize=1496920 CPUtime=529.64 cores=1,3,5,7
/proc/14353/stat : 14353 (SArTagnan) R 14351 14353 14137 0 -1 4202496 674868 0 0 0 52826 138 0 0 25 0 4 0 669967649 1532846080 288388 33554432000 4194304 4625164 140737116686384 18446744073709551615 4512319 0 0 4096 2 18446744073709551615 0 0 17 3 0 0 0
/proc/14353/statm: 374230 288388 343 106 0 369733 0
[pid=14353/tid=14355] ppid=14351 vsize=1496920 CPUtime=103.47 cores=1,3,5,7
/proc/14353/task/14355/stat : 14355 (SArTagnan) R 14351 14353 14137 0 -1 4202560 79919 0 0 0 10311 36 0 0 25 0 4 0 669967678 1532846080 288388 33554432000 4194304 4625164 140737116686384 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=14353/tid=14356] ppid=14351 vsize=1496920 CPUtime=127.99 cores=1,3,5,7
/proc/14353/task/14356/stat : 14356 (SArTagnan) R 14351 14353 14137 0 -1 4202560 88155 0 0 0 12771 28 0 0 25 0 4 0 669967678 1532846080 288388 33554432000 4194304 4625164 140737116686384 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=14353/tid=14357] ppid=14351 vsize=1496920 CPUtime=155.52 cores=1,3,5,7
/proc/14353/task/14357/stat : 14357 (SArTagnan) R 14351 14353 14137 0 -1 4202560 126430 0 0 0 15532 20 0 0 25 0 4 0 669967678 1532846080 288388 33554432000 4194304 4625164 140737116686384 18446744073709551615 4334244 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 529.64
Current children cumulated vsize (KiB) 1496920

[startup+222.301 s]
/proc/loadavg: 7.01 9.05 8.50 7/429 14380
/proc/meminfo: memFree=20143968/32951124 swapFree=44485784/67111528
[pid=14353] ppid=14351 vsize=1822036 CPUtime=768.78 cores=1,3,5,7
/proc/14353/stat : 14353 (SArTagnan) R 14351 14353 14137 0 -1 4202496 857394 0 0 0 76710 168 0 0 25 0 4 0 669967649 1865764864 348529 33554432000 4194304 4625164 140737116686384 18446744073709551615 4393070 0 0 4096 2 18446744073709551615 0 0 17 3 0 0 0
/proc/14353/statm: 455509 348529 343 106 0 451012 0
[pid=14353/tid=14355] ppid=14351 vsize=1822036 CPUtime=163.41 cores=1,3,5,7
/proc/14353/task/14355/stat : 14355 (SArTagnan) R 14351 14353 14137 0 -1 4202560 80483 0 0 0 16304 37 0 0 25 0 4 0 669967678 1865764864 348529 33554432000 4194304 4625164 140737116686384 18446744073709551615 4488046 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=14353/tid=14356] ppid=14351 vsize=1822036 CPUtime=187.21 cores=1,3,5,7
/proc/14353/task/14356/stat : 14356 (SArTagnan) R 14351 14353 14137 0 -1 4202560 97301 0 0 0 18685 36 0 0 25 0 4 0 669967678 1865764864 348529 33554432000 4194304 4625164 140737116686384 18446744073709551615 4330841 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=14353/tid=14357] ppid=14351 vsize=1822036 CPUtime=215.53 cores=1,3,5,7
/proc/14353/task/14357/stat : 14357 (SArTagnan) R 14351 14353 14137 0 -1 4202560 135776 0 0 0 21531 22 0 0 25 0 4 0 669967678 1865764864 348529 33554432000 4194304 4625164 140737116686384 18446744073709551615 4552315 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 768.78
Current children cumulated vsize (KiB) 1822036

[startup+282.301 s]

################
# More data... #
################


[startup+702.301 s]
/proc/loadavg: 6.00 6.62 7.49 7/429 14392
/proc/meminfo: memFree=18969840/32951124 swapFree=44485784/67111528
[pid=14353] ppid=14351 vsize=3215664 CPUtime=2681.93 cores=1,3,5,7
/proc/14353/stat : 14353 (SArTagnan) R 14351 14353 14137 0 -1 4202496 4311377 0 0 0 267431 762 0 0 25 0 4 0 669967649 3292839936 642123 33554432000 4194304 4625164 140737116686384 18446744073709551615 4512009 0 0 4096 2 18446744073709551615 0 0 17 3 0 0 0
/proc/14353/statm: 803916 642123 640 106 0 799419 0
[pid=14353/tid=14355] ppid=14351 vsize=3215664 CPUtime=643.42 cores=1,3,5,7
/proc/14353/task/14355/stat : 14355 (SArTagnan) R 14351 14353 14137 0 -1 4202560 84621 0 0 0 64304 38 0 0 25 0 4 0 669967678 3292839936 642124 33554432000 4194304 4625164 140737116686384 18446744073709551615 4488046 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=14353/tid=14356] ppid=14351 vsize=3215664 CPUtime=660.42 cores=1,3,5,7
/proc/14353/task/14356/stat : 14356 (SArTagnan) R 14351 14353 14137 0 -1 4202560 99688 0 0 0 66003 39 0 0 25 0 4 0 669967678 3292839936 642124 33554432000 4194304 4625164 140737116686384 18446744073709551615 4330576 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=14353/tid=14357] ppid=14351 vsize=3215664 CPUtime=695.46 cores=1,3,5,7
/proc/14353/task/14357/stat : 14357 (SArTagnan) R 14351 14353 14137 0 -1 4202560 2683189 0 0 0 69100 446 0 0 25 0 4 0 669967678 3292839936 642124 33554432000 4194304 4625164 140737116686384 18446744073709551615 4339447 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 2681.93
Current children cumulated vsize (KiB) 3215664

[startup+762.317 s]
/proc/loadavg: 6.00 6.50 7.39 7/429 14394
/proc/meminfo: memFree=18896628/32951124 swapFree=44485784/67111528
[pid=14353] ppid=14351 vsize=3215664 CPUtime=2921.13 cores=1,3,5,7
/proc/14353/stat : 14353 (SArTagnan) R 14351 14353 14137 0 -1 4202496 4793577 0 0 0 291267 846 0 0 25 0 4 0 669967649 3292839936 659772 33554432000 4194304 4625164 140737116686384 18446744073709551615 4511904 0 0 4096 2 18446744073709551615 0 0 17 3 0 0 0
/proc/14353/statm: 803916 659772 640 106 0 799419 0
[pid=14353/tid=14355] ppid=14351 vsize=3215664 CPUtime=703.44 cores=1,3,5,7
/proc/14353/task/14355/stat : 14355 (SArTagnan) R 14351 14353 14137 0 -1 4202560 84726 0 0 0 70306 38 0 0 25 0 4 0 669967678 3292839936 659772 33554432000 4194304 4625164 140737116686384 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=14353/tid=14356] ppid=14351 vsize=3215664 CPUtime=719.57 cores=1,3,5,7
/proc/14353/task/14356/stat : 14356 (SArTagnan) R 14351 14353 14137 0 -1 4202560 99828 0 0 0 71918 39 0 0 25 0 4 0 669967678 3292839936 659772 33554432000 4194304 4625164 140737116686384 18446744073709551615 4330859 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=14353/tid=14357] ppid=14351 vsize=3215664 CPUtime=755.47 cores=1,3,5,7
/proc/14353/task/14357/stat : 14357 (SArTagnan) R 14351 14353 14137 0 -1 4202560 3130074 0 0 0 75027 520 0 0 25 0 4 0 669967678 3292839936 659772 33554432000 4194304 4625164 140737116686384 18446744073709551615 4334238 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 2921.13
Current children cumulated vsize (KiB) 3215664

[startup+822.3 s]
/proc/loadavg: 6.03 6.43 7.31 7/429 14396
/proc/meminfo: memFree=18594280/32951124 swapFree=44485784/67111528
[pid=14353] ppid=14351 vsize=3438452 CPUtime=3160.2 cores=1,3,5,7
/proc/14353/stat : 14353 (SArTagnan) R 14351 14353 14137 0 -1 4202496 5386036 0 0 0 315064 956 0 0 25 0 4 0 669967649 3520974848 733784 33554432000 4194304 4625164 140737116686384 18446744073709551615 4511904 0 0 4096 2 18446744073709551615 0 0 17 3 0 0 0
/proc/14353/statm: 859613 733784 640 106 0 855116 0
[pid=14353/tid=14355] ppid=14351 vsize=3438452 CPUtime=763.42 cores=1,3,5,7
/proc/14353/task/14355/stat : 14355 (SArTagnan) R 14351 14353 14137 0 -1 4202560 84961 0 0 0 76304 38 0 0 25 0 4 0 669967678 3520974848 733784 33554432000 4194304 4625164 140737116686384 18446744073709551615 4351777 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=14353/tid=14356] ppid=14351 vsize=3438452 CPUtime=778.72 cores=1,3,5,7
/proc/14353/task/14356/stat : 14356 (SArTagnan) R 14351 14353 14137 0 -1 4202560 119850 0 0 0 77831 41 0 0 25 0 4 0 669967678 3520974848 733784 33554432000 4194304 4625164 140737116686384 18446744073709551615 4330841 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=14353/tid=14357] ppid=14351 vsize=3438452 CPUtime=815.41 cores=1,3,5,7
/proc/14353/task/14357/stat : 14357 (SArTagnan) R 14351 14353 14137 0 -1 4202560 3583340 0 0 0 80943 598 0 0 25 0 4 0 669967678 3520974848 733785 33554432000 4194304 4625164 140737116686384 18446744073709551615 4339447 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 3160.2
Current children cumulated vsize (KiB) 3438452

[startup+882.3 s]
/proc/loadavg: 6.11 6.37 7.23 7/429 14397
/proc/meminfo: memFree=18559264/32951124 swapFree=44485784/67111528
[pid=14353] ppid=14351 vsize=3503988 CPUtime=3399.34 cores=1,3,5,7
/proc/14353/stat : 14353 (SArTagnan) R 14351 14353 14137 0 -1 4202496 5898820 0 0 0 338883 1051 0 0 25 0 4 0 669967649 3588083712 745021 33554432000 4194304 4625164 140737116686384 18446744073709551615 4512009 0 0 4096 2 18446744073709551615 0 0 17 3 0 0 0
/proc/14353/statm: 875997 745021 640 106 0 871500 0
[pid=14353/tid=14355] ppid=14351 vsize=3503988 CPUtime=823.42 cores=1,3,5,7
/proc/14353/task/14355/stat : 14355 (SArTagnan) R 14351 14353 14137 0 -1 4202560 85412 0 0 0 82304 38 0 0 25 0 4 0 669967678 3588083712 745021 33554432000 4194304 4625164 140737116686384 18446744073709551615 4330841 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=14353/tid=14356] ppid=14351 vsize=3503988 CPUtime=837.87 cores=1,3,5,7
/proc/14353/task/14356/stat : 14356 (SArTagnan) R 14351 14353 14137 0 -1 4202560 119892 0 0 0 83745 42 0 0 25 0 4 0 669967678 3588083712 745021 33554432000 4194304 4625164 140737116686384 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=14353/tid=14357] ppid=14351 vsize=3503988 CPUtime=875.41 cores=1,3,5,7
/proc/14353/task/14357/stat : 14357 (SArTagnan) R 14351 14353 14137 0 -1 4202560 4051501 0 0 0 86857 684 0 0 25 0 4 0 669967678 3588083712 745021 33554432000 4194304 4625164 140737116686384 18446744073709551615 4334728 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 3399.34
Current children cumulated vsize (KiB) 3503988

[startup+942.301 s]
/proc/loadavg: 6.19 6.34 7.17 7/429 14399
/proc/meminfo: memFree=18309608/32951124 swapFree=44485784/67111528
[pid=14353] ppid=14351 vsize=4233284 CPUtime=3638.5 cores=1,3,5,7
/proc/14353/stat : 14353 (SArTagnan) R 14351 14353 14137 0 -1 4202496 6792021 0 0 0 362656 1194 0 0 25 0 4 0 669967649 4334882816 805752 33554432000 4194304 4625164 140737116686384 18446744073709551615 4511904 0 0 4096 2 18446744073709551615 0 0 17 3 0 0 0
/proc/14353/statm: 1058321 805752 640 106 0 1053824 0
[pid=14353/tid=14355] ppid=14351 vsize=4233284 CPUtime=883.42 cores=1,3,5,7
/proc/14353/task/14355/stat : 14355 (SArTagnan) R 14351 14353 14137 0 -1 4202560 85632 0 0 0 88304 38 0 0 25 0 4 0 669967678 4334882816 805752 33554432000 4194304 4625164 140737116686384 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=14353/tid=14356] ppid=14351 vsize=4233284 CPUtime=897.01 cores=1,3,5,7
/proc/14353/task/14356/stat : 14356 (SArTagnan) R 14351 14353 14137 0 -1 4202560 119996 0 0 0 89659 42 0 0 25 0 4 0 669967678 4334882816 805752 33554432000 4194304 4625164 140737116686384 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=14353/tid=14357] ppid=14351 vsize=4233284 CPUtime=935.41 cores=1,3,5,7
/proc/14353/task/14357/stat : 14357 (SArTagnan) R 14351 14353 14137 0 -1 4202560 4521702 0 0 0 92769 772 0 0 25 0 4 0 669967678 4334882816 805752 33554432000 4194304 4625164 140737116686384 18446744073709551615 4547277 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 3638.5
Current children cumulated vsize (KiB) 4233284

[startup+1002.3 s]
/proc/loadavg: 6.12 6.29 7.09 7/429 14400
/proc/meminfo: memFree=18279060/32951124 swapFree=44485784/67111528
[pid=14353] ppid=14351 vsize=4242040 CPUtime=3877.62 cores=1,3,5,7
/proc/14353/stat : 14353 (SArTagnan) R 14351 14353 14137 0 -1 4202496 7335663 0 0 0 386469 1293 0 0 25 0 4 0 669967649 4343848960 814848 33554432000 4194304 4625164 140737116686384 18446744073709551615 4512009 0 0 4096 2 18446744073709551615 0 0 17 3 0 0 0
/proc/14353/statm: 1060510 814848 640 106 0 1056013 0
[pid=14353/tid=14355] ppid=14351 vsize=4242040 CPUtime=943.43 cores=1,3,5,7
/proc/14353/task/14355/stat : 14355 (SArTagnan) R 14351 14353 14137 0 -1 4202560 85928 0 0 0 94305 38 0 0 25 0 4 0 669967678 4343848960 814848 33554432000 4194304 4625164 140737116686384 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=14353/tid=14356] ppid=14351 vsize=4242040 CPUtime=956.13 cores=1,3,5,7
/proc/14353/task/14356/stat : 14356 (SArTagnan) R 14351 14353 14137 0 -1 4202560 120110 0 0 0 95571 42 0 0 25 0 4 0 669967678 4343848960 814848 33554432000 4194304 4625164 140737116686384 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=14353/tid=14357] ppid=14351 vsize=4242040 CPUtime=995.41 cores=1,3,5,7
/proc/14353/task/14357/stat : 14357 (SArTagnan) R 14351 14353 14137 0 -1 4202560 5039701 0 0 0 98676 865 0 0 25 0 4 0 669967678 4343848960 814848 33554432000 4194304 4625164 140737116686384 18446744073709551615 4552369 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 3877.62
Current children cumulated vsize (KiB) 4242040

[startup+1062.3 s]
/proc/loadavg: 6.12 6.25 7.03 7/429 14402
/proc/meminfo: memFree=18231164/32951124 swapFree=44485784/67111528
[pid=14353] ppid=14351 vsize=4242040 CPUtime=4116.77 cores=1,3,5,7
/proc/14353/stat : 14353 (SArTagnan) R 14351 14353 14137 0 -1 4202496 7857052 0 0 0 410297 1380 0 0 25 0 4 0 669967649 4343848960 825888 33554432000 4194304 4625164 140737116686384 18446744073709551615 4511904 0 0 4096 2 18446744073709551615 0 0 17 3 0 0 0
/proc/14353/statm: 1060510 825888 640 106 0 1056013 0
[pid=14353/tid=14355] ppid=14351 vsize=4242040 CPUtime=1003.43 cores=1,3,5,7
/proc/14353/task/14355/stat : 14355 (SArTagnan) R 14351 14353 14137 0 -1 4202560 86417 0 0 0 100305 38 0 0 25 0 4 0 669967678 4343848960 825888 33554432000 4194304 4625164 140737116686384 18446744073709551615 4330841 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=14353/tid=14356] ppid=14351 vsize=4242040 CPUtime=1015.29 cores=1,3,5,7
/proc/14353/task/14356/stat : 14356 (SArTagnan) R 14351 14353 14137 0 -1 4202560 120267 0 0 0 101487 42 0 0 25 0 4 0 669967678 4343848960 825888 33554432000 4194304 4625164 140737116686384 18446744073709551615 4330841 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=14353/tid=14357] ppid=14351 vsize=4242040 CPUtime=1055.41 cores=1,3,5,7
/proc/14353/task/14357/stat : 14357 (SArTagnan) R 14351 14353 14137 0 -1 4202560 5525598 0 0 0 104598 943 0 0 25 0 4 0 669967678 4343848960 825889 33554432000 4194304 4625164 140737116686384 18446744073709551615 4339639 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 4116.77
Current children cumulated vsize (KiB) 4242040

[startup+1122.3 s]
/proc/loadavg: 6.04 6.20 6.96 7/429 14404
/proc/meminfo: memFree=18195524/32951124 swapFree=44485784/67111528
[pid=14353] ppid=14351 vsize=4307576 CPUtime=4355.93 cores=1,3,5,7
/proc/14353/stat : 14353 (SArTagnan) R 14351 14353 14137 0 -1 4202496 8407747 0 0 0 434121 1472 0 0 25 0 4 0 669967649 4410957824 834592 33554432000 4194304 4625164 140737116686384 18446744073709551615 4511953 0 0 4096 2 18446744073709551615 0 0 17 3 0 0 0
/proc/14353/statm: 1076894 834592 640 106 0 1072397 0
[pid=14353/tid=14355] ppid=14351 vsize=4307576 CPUtime=1063.43 cores=1,3,5,7
/proc/14353/task/14355/stat : 14355 (SArTagnan) R 14351 14353 14137 0 -1 4202560 86688 0 0 0 106305 38 0 0 25 0 4 0 669967678 4410957824 834592 33554432000 4194304 4625164 140737116686384 18446744073709551615 4330600 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=14353/tid=14356] ppid=14351 vsize=4307576 CPUtime=1074.44 cores=1,3,5,7
/proc/14353/task/14356/stat : 14356 (SArTagnan) R 14351 14353 14137 0 -1 4202560 120378 0 0 0 107402 42 0 0 25 0 4 0 669967678 4410957824 834592 33554432000 4194304 4625164 140737116686384 18446744073709551615 4330841 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=14353/tid=14357] ppid=14351 vsize=4307576 CPUtime=1115.41 cores=1,3,5,7
/proc/14353/task/14357/stat : 14357 (SArTagnan) R 14351 14353 14137 0 -1 4202560 6027464 0 0 0 110518 1023 0 0 25 0 4 0 669967678 4410957824 834592 33554432000 4194304 4625164 140737116686384 18446744073709551615 4547280 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 4355.93
Current children cumulated vsize (KiB) 4307576

[startup+1182.3 s]
/proc/loadavg: 6.01 6.16 6.90 7/429 14405
/proc/meminfo: memFree=18146996/32951124 swapFree=44485784/67111528
[pid=14353] ppid=14351 vsize=4307576 CPUtime=4595.09 cores=1,3,5,7
/proc/14353/stat : 14353 (SArTagnan) R 14351 14353 14137 0 -1 4202496 8917592 0 0 0 457951 1558 0 0 25 0 4 0 669967649 4410957824 846873 33554432000 4194304 4625164 140737116686384 18446744073709551615 4393112 0 0 4096 2 18446744073709551615 0 0 17 3 0 0 0
/proc/14353/statm: 1076894 846873 642 106 0 1072397 0
[pid=14353/tid=14355] ppid=14351 vsize=4307576 CPUtime=1123.44 cores=1,3,5,7
/proc/14353/task/14355/stat : 14355 (SArTagnan) R 14351 14353 14137 0 -1 4202560 86852 0 0 0 112305 39 0 0 25 0 4 0 669967678 4410957824 846873 33554432000 4194304 4625164 140737116686384 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=14353/tid=14356] ppid=14351 vsize=4307576 CPUtime=1133.59 cores=1,3,5,7
/proc/14353/task/14356/stat : 14356 (SArTagnan) R 14351 14353 14137 0 -1 4202560 120538 0 0 0 113317 42 0 0 25 0 4 0 669967678 4410957824 846873 33554432000 4194304 4625164 140737116686384 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=14353/tid=14357] ppid=14351 vsize=4307576 CPUtime=1175.42 cores=1,3,5,7
/proc/14353/task/14357/stat : 14357 (SArTagnan) R 14351 14353 14137 0 -1 4202560 6497372 0 0 0 116441 1101 0 0 25 0 4 0 669967678 4410957824 846873 33554432000 4194304 4625164 140737116686384 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 4595.09
Current children cumulated vsize (KiB) 4307576



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1233.8 s]
/proc/loadavg: 6.00 6.13 6.85 7/429 14407
/proc/meminfo: memFree=18108748/32951124 swapFree=44485784/67111528
[pid=14353] ppid=14351 vsize=4307576 CPUtime=4800.41 cores=1,3,5,7
/proc/14353/stat : 14353 (SArTagnan) R 14351 14353 14137 0 -1 4202496 9372141 0 0 0 478406 1635 0 0 25 0 4 0 669967649 4410957824 855557 33554432000 4194304 4625164 140737116686384 18446744073709551615 4511930 0 0 4096 2 18446744073709551615 0 0 17 3 0 0 0
/proc/14353/statm: 1076894 855557 640 106 0 1072397 0
[pid=14353/tid=14355] ppid=14351 vsize=4307576 CPUtime=1174.96 cores=1,3,5,7
/proc/14353/task/14355/stat : 14355 (SArTagnan) R 14351 14353 14137 0 -1 4202560 86978 0 0 0 117457 39 0 0 25 0 4 0 669967678 4410957824 855557 33554432000 4194304 4625164 140737116686384 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=14353/tid=14356] ppid=14351 vsize=4307576 CPUtime=1184.36 cores=1,3,5,7
/proc/14353/task/14356/stat : 14356 (SArTagnan) R 14351 14353 14137 0 -1 4202560 120580 0 0 0 118394 42 0 0 25 0 4 0 669967678 4410957824 855557 33554432000 4194304 4625164 140737116686384 18446744073709551615 4330841 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=14353/tid=14357] ppid=14351 vsize=4307576 CPUtime=1226.93 cores=1,3,5,7
/proc/14353/task/14357/stat : 14357 (SArTagnan) R 14351 14353 14137 0 -1 4202560 6916246 0 0 0 121523 1170 0 0 25 0 4 0 669967678 4410957824 855557 33554432000 4194304 4625164 140737116686384 18446744073709551615 4547431 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 4800.41
Current children cumulated vsize (KiB) 4307576

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1233.92 s]
/proc/loadavg: 6.00 6.13 6.85 7/429 14407
/proc/meminfo: memFree=18108748/32951124 swapFree=44485784/67111528
[pid=14353] ppid=14351 vsize=0 CPUtime=4800.53 cores=1,3,5,7
/proc/14353/stat : 14353 (SArTagnan) Z 14351 14353 14137 0 -1 4203548 9372141 0 0 0 478408 1645 0 0 25 0 2 0 669967649 0 0 33554432000 0 0 0 0 0 0 0 4096 2 18446744073709551615 0 0 17 3 0 0 0
/proc/14353/statm: 0 0 0 0 0 0 0
[pid=14353/tid=14356] ppid=14351 vsize=0 CPUtime=1184.47 cores=1,3,5,7
/proc/14353/task/14356/stat : 14356 (SArTagnan) R 14351 14353 14137 0 -1 4203588 120580 0 0 0 118395 52 0 0 25 0 2 0 669967678 0 0 33554432000 0 0 0 0 0 0 0 4096 2 18446744073709551615 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 4800.53
Current children cumulated vsize (KiB) 0

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1233.95
CPU time (s): 4800.56
CPU user time (s): 4784.08
CPU system time (s): 16.4805
CPU usage (%): 389.042
Max. virtual memory (cumulated for all children) (KiB): 5688140

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4784.08
system time used= 16.4805
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 9372141
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 6345
involuntary context switches= 20019

runsolver used 5.21521 second user time and 12.3491 second system time

The end

Launcher Data 

Begin job on node105 at 2011-05-17 00:07:52
IDJOB=3385856
IDBENCH=88217
IDSOLVER=1871
FILE ID=node105/3385856-1305583672
RUNJOBID= node105-1305582154-14156
PBS_JOBID= 13350310
Free space on /tmp= 73424 MiB

SOLVER NAME= SArTagnan 2011-05-15 (fixed)
BENCH NAME= SAT11/crafted/anton/SRHD-SGI/srhd-sgi-m62-q1327.5-n60-p15-s1351253.cnf
COMMAND LINE= SArTagnan BENCHNAME -threads=NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3385856-1305583672/watcher-3385856-1305583672 -o /tmp/evaluation-result-3385856-1305583672/solver-3385856-1305583672 -C 4800 -W 1300 -M 15500  SArTagnan HOME/instance-3385856-1305583672.cnf -threads=4

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= b23c52475e3d098cb9d5a92c025d6982
RANDOM SEED=1718369888

node105.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.825
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.65
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.825
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.15
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.825
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.825
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.825
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5410.70
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.825
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.825
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.825
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      16795860 kB
Buffers:        326108 kB
Cached:        7283460 kB
SwapCached:      39636 kB
Active:        8727276 kB
Inactive:      7125064 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      16795860 kB
SwapTotal:    67111528 kB
SwapFree:     44485784 kB
Dirty:           14744 kB
Writeback:           0 kB
AnonPages:     8210652 kB
Mapped:          20144 kB
Slab:           144676 kB
PageTables:      90984 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 120816960 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73504 MiB
End job on node105 at 2011-05-17 00:28:28