Trace number 3258880

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
SArTagnan 2011-03-24? (TO) 4800.2 1201.98

General information on the benchmark

NameCRAFTED/rbsat/random/
forced/rbsat-v1150c84314gyes1.cnf
MD5SUMd6097a9814089eeede1d027388c17a02
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark1.3218
Satisfiable
(Un)Satisfiability was proved
Number of variables1150
Number of clauses84314
Sum of the clauses size169678
Maximum clause length23
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 284264
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 550

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3258880-1304056582/watcher-3258880-1304056582 -o /tmp/evaluation-result-3258880-1304056582/solver-3258880-1304056582 -C 4800 -W 1300 -M 15500 SArTagnan HOME/instance-3258880-1304056582.cnf -threads=4 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 3.56 4.13 5.32 2/178 2516
/proc/meminfo: memFree=22322180/32951124 swapFree=67111524/67111528
[pid=2516] ppid=2514 vsize=20632 CPUtime=0 cores=0,2,4,6
/proc/2516/stat : 2516 (SArTagnan) R 2514 2516 32466 0 -1 4202496 481 0 0 0 0 0 0 0 23 0 1 0 517256078 21127168 418 33554432000 4194304 4623224 140737019873504 18446744073709551615 255377301248 0 0 4096 2 0 0 0 17 4 0 0 0
/proc/2516/statm: 5201 427 296 105 0 705 0

[startup+0.051299 s]
/proc/loadavg: 3.56 4.13 5.32 2/178 2516
/proc/meminfo: memFree=22322180/32951124 swapFree=67111524/67111528
[pid=2516] ppid=2514 vsize=253800 CPUtime=0.12 cores=0,2,4,6
/proc/2516/stat : 2516 (SArTagnan) R 2514 2516 32466 0 -1 4202496 3026 0 0 0 12 0 0 0 24 0 4 0 517256078 259891200 2412 33554432000 4194304 4623224 140737019873504 18446744073709551615 4497639 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/2516/statm: 63450 2412 340 105 0 58954 0
Current children cumulated CPU time (s) 0.12
Current children cumulated vsize (KiB) 253800

[startup+0.10081 s]
/proc/loadavg: 3.56 4.13 5.32 2/178 2516
/proc/meminfo: memFree=22322180/32951124 swapFree=67111524/67111528
[pid=2516] ppid=2514 vsize=254768 CPUtime=0.32 cores=0,2,4,6
/proc/2516/stat : 2516 (SArTagnan) R 2514 2516 32466 0 -1 4202496 3696 0 0 0 32 0 0 0 24 0 4 0 517256078 260882432 3021 33554432000 4194304 4623224 140737019873504 18446744073709551615 4517479 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/2516/statm: 63692 3022 343 105 0 59196 0
Current children cumulated CPU time (s) 0.32
Current children cumulated vsize (KiB) 254768

[startup+0.300773 s]
/proc/loadavg: 3.56 4.13 5.32 2/178 2516
/proc/meminfo: memFree=22322180/32951124 swapFree=67111524/67111528
[pid=2516] ppid=2514 vsize=259316 CPUtime=1.12 cores=0,2,4,6
/proc/2516/stat : 2516 (SArTagnan) R 2514 2516 32466 0 -1 4202496 6172 0 0 0 112 0 0 0 25 0 4 0 517256078 265539584 4669 33554432000 4194304 4623224 140737019873504 18446744073709551615 4510169 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/2516/statm: 64829 4669 344 105 0 60333 0
Current children cumulated CPU time (s) 1.12
Current children cumulated vsize (KiB) 259316

[startup+0.7007 s]
/proc/loadavg: 3.56 4.13 5.32 2/178 2516
/proc/meminfo: memFree=22322180/32951124 swapFree=67111524/67111528
[pid=2516] ppid=2514 vsize=260556 CPUtime=2.72 cores=0,2,4,6
/proc/2516/stat : 2516 (SArTagnan) R 2514 2516 32466 0 -1 4202496 8527 0 0 0 271 1 0 0 25 0 4 0 517256078 266809344 6244 33554432000 4194304 4623224 140737019873504 18446744073709551615 4510169 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/2516/statm: 65139 6244 344 105 0 60643 0
Current children cumulated CPU time (s) 2.72
Current children cumulated vsize (KiB) 260556

[startup+1.50055 s]
/proc/loadavg: 3.56 4.13 5.32 9/188 2529
/proc/meminfo: memFree=22261100/32951124 swapFree=67111524/67111528
[pid=2516] ppid=2514 vsize=267980 CPUtime=5.92 cores=0,2,4,6
/proc/2516/stat : 2516 (SArTagnan) R 2514 2516 32466 0 -1 4202496 15329 0 0 0 590 2 0 0 25 0 4 0 517256078 274411520 9217 33554432000 4194304 4623224 140737019873504 18446744073709551615 4511047 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/2516/statm: 66995 9217 344 105 0 62499 0
[pid=2516/tid=2518] ppid=2514 vsize=267980 CPUtime=1.46 cores=0,2,4,6
/proc/2516/task/2518/stat : 2518 (SArTagnan) R 2514 2516 32466 0 -1 4202560 2436 0 0 0 146 0 0 0 25 0 4 0 517256080 274411520 9217 33554432000 4194304 4623224 140737019873504 18446744073709551615 255376960746 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=2516/tid=2519] ppid=2514 vsize=267980 CPUtime=1.46 cores=0,2,4,6
/proc/2516/task/2519/stat : 2519 (SArTagnan) R 2514 2516 32466 0 -1 4202560 2470 0 0 0 146 0 0 0 25 0 4 0 517256080 274411520 9217 33554432000 4194304 4623224 140737019873504 18446744073709551615 4377576 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=2516/tid=2520] ppid=2514 vsize=267980 CPUtime=1.47 cores=0,2,4,6
/proc/2516/task/2520/stat : 2520 (SArTagnan) R 2514 2516 32466 0 -1 4202560 4388 0 0 0 147 0 0 0 20 0 4 0 517256080 274411520 9217 33554432000 4194304 4623224 140737019873504 18446744073709551615 4545527 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 5.92
Current children cumulated vsize (KiB) 267980

[startup+3.10026 s]
/proc/loadavg: 3.91 4.19 5.33 10/188 2529
/proc/meminfo: memFree=22228984/32951124 swapFree=67111524/67111528
[pid=2516] ppid=2514 vsize=275212 CPUtime=12.31 cores=0,2,4,6
/proc/2516/stat : 2516 (SArTagnan) R 2514 2516 32466 0 -1 4202496 24317 0 0 0 1227 4 0 0 25 0 4 0 517256078 281817088 12659 33554432000 4194304 4623224 140737019873504 18446744073709551615 4511665 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/2516/statm: 68803 12659 344 105 0 64307 0
[pid=2516/tid=2518] ppid=2514 vsize=275212 CPUtime=3.05 cores=0,2,4,6
/proc/2516/task/2518/stat : 2518 (SArTagnan) R 2514 2516 32466 0 -1 4202560 3896 0 0 0 305 0 0 0 25 0 4 0 517256080 281817088 12659 33554432000 4194304 4623224 140737019873504 18446744073709551615 4376675 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=2516/tid=2519] ppid=2514 vsize=275212 CPUtime=3.06 cores=0,2,4,6
/proc/2516/task/2519/stat : 2519 (SArTagnan) R 2514 2516 32466 0 -1 4202560 4282 0 0 0 305 1 0 0 25 0 4 0 517256080 281817088 12659 33554432000 4194304 4623224 140737019873504 18446744073709551615 4376749 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=2516/tid=2520] ppid=2514 vsize=275212 CPUtime=3.07 cores=0,2,4,6
/proc/2516/task/2520/stat : 2520 (SArTagnan) R 2514 2516 32466 0 -1 4202560 8307 0 0 0 306 1 0 0 25 0 4 0 517256080 281817088 12659 33554432000 4194304 4623224 140737019873504 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 12.31
Current children cumulated vsize (KiB) 275212

[startup+6.30066 s]
/proc/loadavg: 3.91 4.19 5.33 9/188 2529
/proc/meminfo: memFree=22171656/32951124 swapFree=67111524/67111528
[pid=2516] ppid=2514 vsize=283880 CPUtime=25.08 cores=0,2,4,6
/proc/2516/stat : 2516 (SArTagnan) R 2514 2516 32466 0 -1 4202496 51899 0 0 0 2500 8 0 0 25 0 4 0 517256078 290693120 16785 33554432000 4194304 4623224 140737019873504 18446744073709551615 4510472 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/2516/statm: 70970 16785 344 105 0 66474 0
[pid=2516/tid=2518] ppid=2514 vsize=283880 CPUtime=6.23 cores=0,2,4,6
/proc/2516/task/2518/stat : 2518 (SArTagnan) R 2514 2516 32466 0 -1 4202560 6083 0 0 0 623 0 0 0 25 0 4 0 517256080 290693120 16785 33554432000 4194304 4623224 140737019873504 18446744073709551615 4376711 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=2516/tid=2519] ppid=2514 vsize=283880 CPUtime=6.27 cores=0,2,4,6
/proc/2516/task/2519/stat : 2519 (SArTagnan) R 2514 2516 32466 0 -1 4202560 8147 0 0 0 625 2 0 0 25 0 4 0 517256080 290693120 16785 33554432000 4194304 4623224 140737019873504 18446744073709551615 4376862 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=2516/tid=2520] ppid=2514 vsize=283880 CPUtime=6.27 cores=0,2,4,6
/proc/2516/task/2520/stat : 2520 (SArTagnan) R 2514 2516 32466 0 -1 4202560 29594 0 0 0 623 4 0 0 25 0 4 0 517256080 290693120 16785 33554432000 4194304 4623224 140737019873504 18446744073709551615 4364232 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 25.08
Current children cumulated vsize (KiB) 283880

[startup+12.7005 s]
/proc/loadavg: 4.54 4.32 5.36 9/188 2529
/proc/meminfo: memFree=22088256/32951124 swapFree=67111524/67111528
[pid=2516] ppid=2514 vsize=288180 CPUtime=50.65 cores=0,2,4,6
/proc/2516/stat : 2516 (SArTagnan) R 2514 2516 32466 0 -1 4202496 105709 0 0 0 5046 19 0 0 25 0 4 0 517256078 295096320 23955 33554432000 4194304 4623224 140737019873504 18446744073709551615 4510169 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/2516/statm: 72045 23955 344 105 0 67549 0
[pid=2516/tid=2518] ppid=2514 vsize=288180 CPUtime=12.6 cores=0,2,4,6
/proc/2516/task/2518/stat : 2518 (SArTagnan) R 2514 2516 32466 0 -1 4202560 10385 0 0 0 1258 2 0 0 25 0 4 0 517256080 295096320 23955 33554432000 4194304 4623224 140737019873504 18446744073709551615 4376880 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=2516/tid=2519] ppid=2514 vsize=288180 CPUtime=12.67 cores=0,2,4,6
/proc/2516/task/2519/stat : 2519 (SArTagnan) R 2514 2516 32466 0 -1 4202560 9352 0 0 0 1264 3 0 0 25 0 4 0 517256080 295096320 23955 33554432000 4194304 4623224 140737019873504 18446744073709551615 4376652 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=2516/tid=2520] ppid=2514 vsize=288180 CPUtime=12.67 cores=0,2,4,6
/proc/2516/task/2520/stat : 2520 (SArTagnan) R 2514 2516 32466 0 -1 4202560 75362 0 0 0 1255 12 0 0 25 0 4 0 517256080 295096320 23955 33554432000 4194304 4623224 140737019873504 18446744073709551615 4364232 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 50.65
Current children cumulated vsize (KiB) 288180

[startup+25.5011 s]
/proc/loadavg: 5.07 4.44 5.39 9/188 2529
/proc/meminfo: memFree=21971680/32951124 swapFree=67111524/67111528
[pid=2516] ppid=2514 vsize=316664 CPUtime=101.79 cores=0,2,4,6
/proc/2516/stat : 2516 (SArTagnan) R 2514 2516 32466 0 -1 4202496 229647 0 0 0 10138 41 0 0 25 0 4 0 517256078 324263936 36420 33554432000 4194304 4623224 140737019873504 18446744073709551615 4507318 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/2516/statm: 79166 36420 344 105 0 74670 0
[pid=2516/tid=2518] ppid=2514 vsize=316664 CPUtime=25.33 cores=0,2,4,6
/proc/2516/task/2518/stat : 2518 (SArTagnan) R 2514 2516 32466 0 -1 4202560 16179 0 0 0 2528 5 0 0 25 0 4 0 517256080 324263936 36420 33554432000 4194304 4623224 140737019873504 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=2516/tid=2519] ppid=2514 vsize=316664 CPUtime=25.46 cores=0,2,4,6
/proc/2516/task/2519/stat : 2519 (SArTagnan) R 2514 2516 32466 0 -1 4202560 19044 0 0 0 2542 4 0 0 25 0 4 0 517256080 324263936 36420 33554432000 4194304 4623224 140737019873504 18446744073709551615 4376714 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=2516/tid=2520] ppid=2514 vsize=316664 CPUtime=25.47 cores=0,2,4,6
/proc/2516/task/2520/stat : 2520 (SArTagnan) R 2514 2516 32466 0 -1 4202560 183635 0 0 0 2518 29 0 0 25 0 4 0 517256080 324263936 36420 33554432000 4194304 4623224 140737019873504 18446744073709551615 4550465 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 101.79
Current children cumulated vsize (KiB) 316664

[startup+51.1004 s]
/proc/loadavg: 6.29 4.77 5.47 9/188 2530
/proc/meminfo: memFree=21772480/32951124 swapFree=67111524/67111528
[pid=2516] ppid=2514 vsize=341520 CPUtime=204.04 cores=0,2,4,6
/proc/2516/stat : 2516 (SArTagnan) R 2514 2516 32466 0 -1 4202496 304375 0 0 0 20349 55 0 0 25 0 4 0 517256078 349716480 49698 33554432000 4194304 4623224 140737019873504 18446744073709551615 4510127 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/2516/statm: 85380 49698 344 105 0 80884 0
[pid=2516/tid=2518] ppid=2514 vsize=341520 CPUtime=50.79 cores=0,2,4,6
/proc/2516/task/2518/stat : 2518 (SArTagnan) R 2514 2516 32466 0 -1 4202560 24360 0 0 0 5071 8 0 0 25 0 4 0 517256080 349716480 49698 33554432000 4194304 4623224 140737019873504 18446744073709551615 4376687 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=2516/tid=2519] ppid=2514 vsize=341520 CPUtime=51.06 cores=0,2,4,6
/proc/2516/task/2519/stat : 2519 (SArTagnan) R 2514 2516 32466 0 -1 4202560 27550 0 0 0 5099 7 0 0 25 0 4 0 517256080 349716480 49698 33554432000 4194304 4623224 140737019873504 18446744073709551615 4366400 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=2516/tid=2520] ppid=2514 vsize=341520 CPUtime=51.07 cores=0,2,4,6
/proc/2516/task/2520/stat : 2520 (SArTagnan) R 2514 2516 32466 0 -1 4202560 239260 0 0 0 5070 37 0 0 25 0 4 0 517256080 349716480 49698 33554432000 4194304 4623224 140737019873504 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 204.04
Current children cumulated vsize (KiB) 341520

[startup+102.307 s]
/proc/loadavg: 7.38 5.33 5.62 9/188 2531
/proc/meminfo: memFree=21463216/32951124 swapFree=67111524/67111528
[pid=2516] ppid=2514 vsize=428080 CPUtime=408.58 cores=0,2,4,6
/proc/2516/stat : 2516 (SArTagnan) R 2514 2516 32466 0 -1 4202496 624899 0 0 0 40750 108 0 0 25 0 4 0 517256078 438353920 74481 33554432000 4194304 4623224 140737019873504 18446744073709551615 4517554 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/2516/statm: 107020 74481 344 105 0 102524 0
[pid=2516/tid=2518] ppid=2514 vsize=428080 CPUtime=101.71 cores=0,2,4,6
/proc/2516/task/2518/stat : 2518 (SArTagnan) R 2514 2516 32466 0 -1 4202560 34982 0 0 0 10159 12 0 0 25 0 4 0 517256080 438353920 74481 33554432000 4194304 4623224 140737019873504 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=2516/tid=2519] ppid=2514 vsize=428080 CPUtime=102.27 cores=0,2,4,6
/proc/2516/task/2519/stat : 2519 (SArTagnan) R 2514 2516 32466 0 -1 4202560 31229 0 0 0 10219 8 0 0 25 0 4 0 517256080 438353920 74481 33554432000 4194304 4623224 140737019873504 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=2516/tid=2520] ppid=2514 vsize=428080 CPUtime=102.27 cores=0,2,4,6
/proc/2516/task/2520/stat : 2520 (SArTagnan) R 2514 2516 32466 0 -1 4202560 510594 0 0 0 10149 78 0 0 25 0 4 0 517256080 438353920 74481 33554432000 4194304 4623224 140737019873504 18446744073709551615 4550436 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 408.58
Current children cumulated vsize (KiB) 428080

[startup+162.301 s]
/proc/loadavg: 7.75 5.77 5.76 9/188 2533
/proc/meminfo: memFree=21147508/32951124 swapFree=67111524/67111528
[pid=2516] ppid=2514 vsize=667552 CPUtime=648.23 cores=0,2,4,6
/proc/2516/stat : 2516 (SArTagnan) R 2514 2516 32466 0 -1 4202496 1207914 0 0 0 64622 201 0 0 25 0 4 0 517256078 683573248 102628 33554432000 4194304 4623224 140737019873504 18446744073709551615 4415014 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/2516/statm: 166888 102628 357 105 0 162392 0
[pid=2516/tid=2518] ppid=2514 vsize=667552 CPUtime=161.38 cores=0,2,4,6
/proc/2516/task/2518/stat : 2518 (SArTagnan) R 2514 2516 32466 0 -1 4202560 44741 0 0 0 16124 14 0 0 25 0 4 0 517256080 683573248 102628 33554432000 4194304 4623224 140737019873504 18446744073709551615 4377587 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=2516/tid=2519] ppid=2514 vsize=667552 CPUtime=162.26 cores=0,2,4,6
/proc/2516/task/2519/stat : 2519 (SArTagnan) R 2514 2516 32466 0 -1 4202560 37481 0 0 0 16214 12 0 0 25 0 4 0 517256080 683573248 102628 33554432000 4194304 4623224 140737019873504 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=2516/tid=2520] ppid=2514 vsize=667552 CPUtime=162.27 cores=0,2,4,6
/proc/2516/task/2520/stat : 2520 (SArTagnan) R 2514 2516 32466 0 -1 4202560 1050014 0 0 0 16066 161 0 0 25 0 4 0 517256080 683573248 102628 33554432000 4194304 4623224 140737019873504 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 648.23
Current children cumulated vsize (KiB) 667552

[startup+222.301 s]
/proc/loadavg: 8.00 6.24 5.92 9/188 2535
/proc/meminfo: memFree=20838488/32951124 swapFree=67111524/67111528
[pid=2516] ppid=2514 vsize=748792 CPUtime=887.89 cores=0,2,4,6
/proc/2516/stat : 2516 (SArTagnan) R 2514 2516 32466 0 -1 4202496 1729201 0 0 0 88505 284 0 0 25 0 4 0 517256078 766763008 128852 33554432000 4194304 4623224 140737019873504 18446744073709551615 4414846 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/2516/statm: 187198 128852 371 105 0 182702 0
[pid=2516/tid=2518] ppid=2514 vsize=748792 CPUtime=221.06 cores=0,2,4,6
/proc/2516/task/2518/stat : 2518 (SArTagnan) R 2514 2516 32466 0 -1 4202560 48597 0 0 0 22089 17 0 0 25 0 4 0 517256080 766763008 128853 33554432000 4194304 4623224 140737019873504 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=2516/tid=2519] ppid=2514 vsize=748792 CPUtime=222.27 cores=0,2,4,6
/proc/2516/task/2519/stat : 2519 (SArTagnan) R 2514 2516 32466 0 -1 4202560 50995 0 0 0 22211 16 0 0 25 0 4 0 517256080 766763008 128853 33554432000 4194304 4623224 140737019873504 18446744073709551615 255376962593 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=2516/tid=2520] ppid=2514 vsize=748792 CPUtime=222.26 cores=0,2,4,6
/proc/2516/task/2520/stat : 2520 (SArTagnan) R 2514 2516 32466 0 -1 4202560 1519911 0 0 0 21992 234 0 0 25 0 4 0 517256080 766763008 128853 33554432000 4194304 4623224 140737019873504 18446744073709551615 4376711 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 887.89
Current children cumulated vsize (KiB) 748792

[startup+282.301 s]

################
# More data... #
################

[pid=2516] ppid=2514 vsize=1522536 CPUtime=2804.42 cores=0,2,4,6
/proc/2516/stat : 2516 (SArTagnan) R 2514 2516 32466 0 -1 4202496 5509921 0 0 0 279568 874 0 0 25 0 4 0 517256078 1559076864 281547 33554432000 4194304 4623224 140737019873504 18446744073709551615 4388305 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/2516/statm: 380634 281573 344 105 0 376138 0
[pid=2516/tid=2518] ppid=2514 vsize=1522536 CPUtime=698.43 cores=0,2,4,6
/proc/2516/task/2518/stat : 2518 (SArTagnan) R 2514 2516 32466 0 -1 4202560 110177 0 0 0 69797 46 0 0 25 0 4 0 517256080 1559076864 281579 33554432000 4194304 4623224 140737019873504 18446744073709551615 4376711 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=2516/tid=2519] ppid=2514 vsize=1522536 CPUtime=701.46 cores=0,2,4,6
/proc/2516/task/2519/stat : 2519 (SArTagnan) R 2514 2516 32466 0 -1 4202560 81688 0 0 0 70117 29 0 0 25 0 4 0 517256080 1559076864 281587 33554432000 4194304 4623224 140737019873504 18446744073709551615 4376711 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=2516/tid=2520] ppid=2514 vsize=1522536 CPUtime=702.25 cores=0,2,4,6
/proc/2516/task/2520/stat : 2520 (SArTagnan) R 2514 2516 32466 0 -1 4202560 4925402 0 0 0 69484 741 0 0 25 0 4 0 517256080 1559076864 281594 33554432000 4194304 4623224 140737019873504 18446744073709551615 4366247 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 2804.42
Current children cumulated vsize (KiB) 1522536

[startup+762.307 s]
/proc/loadavg: 8.16 7.87 6.91 9/188 2561
/proc/meminfo: memFree=19425236/32951124 swapFree=67111524/67111528
[pid=2516] ppid=2514 vsize=1522536 CPUtime=3044.11 cores=0,2,4,6
/proc/2516/stat : 2516 (SArTagnan) R 2514 2516 32466 0 -1 4202496 5990412 0 0 0 303463 948 0 0 25 0 4 0 517256078 1559076864 293771 33554432000 4194304 4623224 140737019873504 18446744073709551615 4510064 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/2516/statm: 380634 293771 344 105 0 376138 0
[pid=2516/tid=2518] ppid=2514 vsize=1522536 CPUtime=758.11 cores=0,2,4,6
/proc/2516/task/2518/stat : 2518 (SArTagnan) R 2514 2516 32466 0 -1 4202560 112475 0 0 0 75763 48 0 0 25 0 4 0 517256080 1559076864 293771 33554432000 4194304 4623224 140737019873504 18446744073709551615 4486238 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=2516/tid=2519] ppid=2514 vsize=1522536 CPUtime=761.47 cores=0,2,4,6
/proc/2516/task/2519/stat : 2519 (SArTagnan) R 2514 2516 32466 0 -1 4202560 84030 0 0 0 76115 32 0 0 25 0 4 0 517256080 1559076864 293771 33554432000 4194304 4623224 140737019873504 18446744073709551615 4377128 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=2516/tid=2520] ppid=2514 vsize=1522536 CPUtime=762.26 cores=0,2,4,6
/proc/2516/task/2520/stat : 2520 (SArTagnan) R 2514 2516 32466 0 -1 4202560 5394767 0 0 0 75417 809 0 0 25 0 4 0 517256080 1559076864 293771 33554432000 4194304 4623224 140737019873504 18446744073709551615 4366247 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 3044.11
Current children cumulated vsize (KiB) 1522536

[startup+822.3 s]
/proc/loadavg: 8.25 7.95 6.99 10/188 2563
/proc/meminfo: memFree=19337556/32951124 swapFree=67111524/67111528
[pid=2516] ppid=2514 vsize=1589412 CPUtime=3283.77 cores=0,2,4,6
/proc/2516/stat : 2516 (SArTagnan) R 2514 2516 32466 0 -1 4202496 6418653 0 0 0 327359 1018 0 0 25 0 4 0 517256078 1627557888 301643 33554432000 4194304 4623224 140737019873504 18446744073709551615 4510064 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/2516/statm: 397353 301643 344 105 0 392857 0
[pid=2516/tid=2518] ppid=2514 vsize=1589412 CPUtime=817.78 cores=0,2,4,6
/proc/2516/task/2518/stat : 2518 (SArTagnan) R 2514 2516 32466 0 -1 4202560 112677 0 0 0 81730 48 0 0 25 0 4 0 517256080 1627557888 301643 33554432000 4194304 4623224 140737019873504 18446744073709551615 4357641 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=2516/tid=2519] ppid=2514 vsize=1589412 CPUtime=821.47 cores=0,2,4,6
/proc/2516/task/2519/stat : 2519 (SArTagnan) R 2514 2516 32466 0 -1 4202560 84570 0 0 0 82115 32 0 0 25 0 4 0 517256080 1627557888 301643 33554432000 4194304 4623224 140737019873504 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=2516/tid=2520] ppid=2514 vsize=1589412 CPUtime=822.25 cores=0,2,4,6
/proc/2516/task/2520/stat : 2520 (SArTagnan) R 2514 2516 32466 0 -1 4202560 5818119 0 0 0 81348 877 0 0 25 0 4 0 517256080 1627557888 301643 33554432000 4194304 4623224 140737019873504 18446744073709551615 4577456 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 3283.77
Current children cumulated vsize (KiB) 1589412

[startup+882.3 s]
/proc/loadavg: 8.11 7.97 7.06 9/188 2564
/proc/meminfo: memFree=19239216/32951124 swapFree=67111524/67111528
[pid=2516] ppid=2514 vsize=1589412 CPUtime=3523.44 cores=0,2,4,6
/proc/2516/stat : 2516 (SArTagnan) R 2514 2516 32466 0 -1 4202496 6882478 0 0 0 351246 1098 0 0 25 0 4 0 517256078 1627557888 310668 33554432000 4194304 4623224 140737019873504 18446744073709551615 4510090 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/2516/statm: 397353 310668 344 105 0 392857 0
[pid=2516/tid=2518] ppid=2514 vsize=1589412 CPUtime=877.45 cores=0,2,4,6
/proc/2516/task/2518/stat : 2518 (SArTagnan) R 2514 2516 32466 0 -1 4202560 112913 0 0 0 87697 48 0 0 25 0 4 0 517256080 1627557888 310668 33554432000 4194304 4623224 140737019873504 18446744073709551615 4357901 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=2516/tid=2519] ppid=2514 vsize=1589412 CPUtime=881.47 cores=0,2,4,6
/proc/2516/task/2519/stat : 2519 (SArTagnan) R 2514 2516 32466 0 -1 4202560 85437 0 0 0 88113 34 0 0 25 0 4 0 517256080 1627557888 310668 33554432000 4194304 4623224 140737019873504 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=2516/tid=2520] ppid=2514 vsize=1589412 CPUtime=882.25 cores=0,2,4,6
/proc/2516/task/2520/stat : 2520 (SArTagnan) R 2514 2516 32466 0 -1 4202560 6276342 0 0 0 87271 954 0 0 25 0 4 0 517256080 1627557888 310668 33554432000 4194304 4623224 140737019873504 18446744073709551615 4364232 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 3523.44
Current children cumulated vsize (KiB) 1589412

[startup+942.301 s]
/proc/loadavg: 8.34 8.05 7.14 9/188 2566
/proc/meminfo: memFree=19027288/32951124 swapFree=67111524/67111528
[pid=2516] ppid=2514 vsize=1589412 CPUtime=3763.11 cores=0,2,4,6
/proc/2516/stat : 2516 (SArTagnan) R 2514 2516 32466 0 -1 4202496 7328212 0 0 0 375139 1172 0 0 25 0 4 0 517256078 1627557888 318954 33554432000 4194304 4623224 140737019873504 18446744073709551615 4510316 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/2516/statm: 397353 318954 344 105 0 392857 0
[pid=2516/tid=2518] ppid=2514 vsize=1589412 CPUtime=937.13 cores=0,2,4,6
/proc/2516/task/2518/stat : 2518 (SArTagnan) R 2514 2516 32466 0 -1 4202560 113232 0 0 0 93665 48 0 0 25 0 4 0 517256080 1627557888 318954 33554432000 4194304 4623224 140737019873504 18446744073709551615 4357901 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=2516/tid=2519] ppid=2514 vsize=1589412 CPUtime=941.47 cores=0,2,4,6
/proc/2516/task/2519/stat : 2519 (SArTagnan) R 2514 2516 32466 0 -1 4202560 86138 0 0 0 94113 34 0 0 25 0 4 0 517256080 1627557888 318954 33554432000 4194304 4623224 140737019873504 18446744073709551615 4377005 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=2516/tid=2520] ppid=2514 vsize=1589412 CPUtime=942.25 cores=0,2,4,6
/proc/2516/task/2520/stat : 2520 (SArTagnan) R 2514 2516 32466 0 -1 4202560 6716611 0 0 0 93199 1026 0 0 25 0 4 0 517256080 1627557888 318954 33554432000 4194304 4623224 140737019873504 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 3763.11
Current children cumulated vsize (KiB) 1589412

[startup+1002.3 s]
/proc/loadavg: 8.24 8.07 7.20 9/188 2567
/proc/meminfo: memFree=18902156/32951124 swapFree=67111524/67111528
[pid=2516] ppid=2514 vsize=1625744 CPUtime=4002.79 cores=0,2,4,6
/proc/2516/stat : 2516 (SArTagnan) R 2514 2516 32466 0 -1 4202496 7822064 0 0 0 399026 1253 0 0 25 0 4 0 517256078 1664761856 327321 33554432000 4194304 4623224 140737019873504 18446744073709551615 4510064 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/2516/statm: 406436 327321 344 105 0 401940 0
[pid=2516/tid=2518] ppid=2514 vsize=1625744 CPUtime=996.8 cores=0,2,4,6
/proc/2516/task/2518/stat : 2518 (SArTagnan) R 2514 2516 32466 0 -1 4202560 113471 0 0 0 99632 48 0 0 25 0 4 0 517256080 1664761856 327321 33554432000 4194304 4623224 140737019873504 18446744073709551615 4357576 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=2516/tid=2519] ppid=2514 vsize=1625744 CPUtime=1001.47 cores=0,2,4,6
/proc/2516/task/2519/stat : 2519 (SArTagnan) R 2514 2516 32466 0 -1 4202560 87323 0 0 0 100112 35 0 0 25 0 4 0 517256080 1664761856 327321 33554432000 4194304 4623224 140737019873504 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=2516/tid=2520] ppid=2514 vsize=1625744 CPUtime=1002.25 cores=0,2,4,6
/proc/2516/task/2520/stat : 2520 (SArTagnan) R 2514 2516 32466 0 -1 4202560 7186527 0 0 0 99123 1102 0 0 25 0 4 0 517256080 1664761856 327321 33554432000 4194304 4623224 140737019873504 18446744073709551615 4577512 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 4002.79
Current children cumulated vsize (KiB) 1625744

[startup+1062.3 s]
/proc/loadavg: 8.45 8.15 7.28 9/188 2569
/proc/meminfo: memFree=18788812/32951124 swapFree=67111524/67111528
[pid=2516] ppid=2514 vsize=1694912 CPUtime=4242.46 cores=0,2,4,6
/proc/2516/stat : 2516 (SArTagnan) R 2514 2516 32466 0 -1 4202496 8281574 0 0 0 422915 1331 0 0 25 0 4 0 517256078 1735589888 337529 33554432000 4194304 4623224 140737019873504 18446744073709551615 4510090 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/2516/statm: 423728 337529 344 105 0 419232 0
[pid=2516/tid=2518] ppid=2514 vsize=1694912 CPUtime=1056.48 cores=0,2,4,6
/proc/2516/task/2518/stat : 2518 (SArTagnan) R 2514 2516 32466 0 -1 4202560 113741 0 0 0 105599 49 0 0 25 0 4 0 517256080 1735589888 337529 33554432000 4194304 4623224 140737019873504 18446744073709551615 4357901 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=2516/tid=2519] ppid=2514 vsize=1694912 CPUtime=1061.47 cores=0,2,4,6
/proc/2516/task/2519/stat : 2519 (SArTagnan) R 2514 2516 32466 0 -1 4202560 88085 0 0 0 106111 36 0 0 25 0 4 0 517256080 1735589888 337529 33554432000 4194304 4623224 140737019873504 18446744073709551615 4376711 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=2516/tid=2520] ppid=2514 vsize=1694912 CPUtime=1062.26 cores=0,2,4,6
/proc/2516/task/2520/stat : 2520 (SArTagnan) R 2514 2516 32466 0 -1 4202560 7638735 0 0 0 105048 1178 0 0 25 0 4 0 517256080 1735589888 337529 33554432000 4194304 4623224 140737019873504 18446744073709551615 4376640 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 4242.46
Current children cumulated vsize (KiB) 1694912

[startup+1122.3 s]
/proc/loadavg: 8.25 8.15 7.33 9/188 2571
/proc/meminfo: memFree=18660460/32951124 swapFree=67111524/67111528
[pid=2516] ppid=2514 vsize=1912340 CPUtime=4482.12 cores=0,2,4,6
/proc/2516/stat : 2516 (SArTagnan) R 2514 2516 32466 0 -1 4202496 8886349 0 0 0 446785 1427 0 0 25 0 4 0 517256078 1958236160 361127 33554432000 4194304 4623224 140737019873504 18446744073709551615 4414885 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/2516/statm: 478085 361127 344 105 0 473589 0
[pid=2516/tid=2518] ppid=2514 vsize=1912340 CPUtime=1116.15 cores=0,2,4,6
/proc/2516/task/2518/stat : 2518 (SArTagnan) R 2514 2516 32466 0 -1 4202560 114147 0 0 0 111566 49 0 0 25 0 4 0 517256080 1958236160 361127 33554432000 4194304 4623224 140737019873504 18446744073709551615 4357641 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=2516/tid=2519] ppid=2514 vsize=1912340 CPUtime=1121.48 cores=0,2,4,6
/proc/2516/task/2519/stat : 2519 (SArTagnan) R 2514 2516 32466 0 -1 4202560 89426 0 0 0 112110 38 0 0 25 0 4 0 517256080 1958236160 361127 33554432000 4194304 4623224 140737019873504 18446744073709551615 4376687 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=2516/tid=2520] ppid=2514 vsize=1912340 CPUtime=1122.25 cores=0,2,4,6
/proc/2516/task/2520/stat : 2520 (SArTagnan) R 2514 2516 32466 0 -1 4202560 8115364 0 0 0 110969 1256 0 0 25 0 4 0 517256080 1958236160 361127 33554432000 4194304 4623224 140737019873504 18446744073709551615 4364232 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 4482.12
Current children cumulated vsize (KiB) 1912340

[startup+1182.3 s]
/proc/loadavg: 8.26 8.16 7.39 9/188 2572
/proc/meminfo: memFree=18595720/32951124 swapFree=67111524/67111528
[pid=2516] ppid=2514 vsize=1960344 CPUtime=4721.8 cores=0,2,4,6
/proc/2516/stat : 2516 (SArTagnan) R 2514 2516 32466 0 -1 4202496 9387216 0 0 0 470673 1507 0 0 25 0 4 0 517256078 2007392256 373634 33554432000 4194304 4623224 140737019873504 18446744073709551615 4510316 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/2516/statm: 490086 373635 344 105 0 485590 0
[pid=2516/tid=2518] ppid=2514 vsize=1960344 CPUtime=1175.83 cores=0,2,4,6
/proc/2516/task/2518/stat : 2518 (SArTagnan) R 2514 2516 32466 0 -1 4202560 120396 0 0 0 117533 50 0 0 25 0 4 0 517256080 2007392256 373635 33554432000 4194304 4623224 140737019873504 18446744073709551615 4357901 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=2516/tid=2519] ppid=2514 vsize=1960344 CPUtime=1181.48 cores=0,2,4,6
/proc/2516/task/2519/stat : 2519 (SArTagnan) R 2514 2516 32466 0 -1 4202560 90020 0 0 0 118109 39 0 0 25 0 4 0 517256080 2007392256 373635 33554432000 4194304 4623224 140737019873504 18446744073709551615 4376892 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=2516/tid=2520] ppid=2514 vsize=1960344 CPUtime=1182.24 cores=0,2,4,6
/proc/2516/task/2520/stat : 2520 (SArTagnan) R 2514 2516 32466 0 -1 4202560 8590548 0 0 0 116893 1331 0 0 25 0 4 0 517256080 2007392256 373636 33554432000 4194304 4623224 140737019873504 18446744073709551615 4366247 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 4721.8
Current children cumulated vsize (KiB) 1960344



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1201.9 s]
/proc/loadavg: 8.17 8.15 7.40 7/186 2574
/proc/meminfo: memFree=19797704/32951124 swapFree=67111524/67111528
[pid=2516] ppid=2514 vsize=1960344 CPUtime=4800.1 cores=0,2,4,6
/proc/2516/stat : 2516 (SArTagnan) R 2514 2516 32466 0 -1 4202496 9551291 0 0 0 478478 1532 0 0 25 0 4 0 517256078 2007392256 375771 33554432000 4194304 4623224 140737019873504 18446744073709551615 4510064 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/2516/statm: 490086 375771 344 105 0 485590 0
[pid=2516/tid=2518] ppid=2514 vsize=1960344 CPUtime=1195.33 cores=0,2,4,6
/proc/2516/task/2518/stat : 2518 (SArTagnan) R 2514 2516 32466 0 -1 4202560 120461 0 0 0 119483 50 0 0 25 0 4 0 517256080 2007392256 375771 33554432000 4194304 4623224 140737019873504 18446744073709551615 4357780 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=2516/tid=2519] ppid=2514 vsize=1960344 CPUtime=1201.09 cores=0,2,4,6
/proc/2516/task/2519/stat : 2519 (SArTagnan) R 2514 2516 32466 0 -1 4202560 90057 0 0 0 120070 39 0 0 25 0 4 0 517256080 2007392256 375771 33554432000 4194304 4623224 140737019873504 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=2516/tid=2520] ppid=2514 vsize=1960344 CPUtime=1201.85 cores=0,2,4,6
/proc/2516/task/2520/stat : 2520 (SArTagnan) R 2514 2516 32466 0 -1 4202560 8744252 0 0 0 118830 1355 0 0 25 0 4 0 517256080 2007392256 375771 33554432000 4194304 4623224 140737019873504 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 4800.1
Current children cumulated vsize (KiB) 1960344

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1201.9 s]
/proc/loadavg: 8.17 8.15 7.40 7/186 2574
/proc/meminfo: memFree=19797704/32951124 swapFree=67111524/67111528
[pid=2516] ppid=2514 vsize=1960344 CPUtime=4800.1 cores=0,2,4,6
/proc/2516/stat : 2516 (SArTagnan) R 2514 2516 32466 0 -1 4202496 9551291 0 0 0 478478 1532 0 0 25 0 4 0 517256078 2007392256 375771 33554432000 4194304 4623224 140737019873504 18446744073709551615 4510064 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/2516/statm: 490086 375771 344 105 0 485590 0
[pid=2516/tid=2518] ppid=2514 vsize=1960344 CPUtime=1195.33 cores=0,2,4,6
/proc/2516/task/2518/stat : 2518 (SArTagnan) R 2514 2516 32466 0 -1 4202560 120461 0 0 0 119483 50 0 0 25 0 4 0 517256080 2007392256 375771 33554432000 4194304 4623224 140737019873504 18446744073709551615 4357780 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=2516/tid=2519] ppid=2514 vsize=1960344 CPUtime=1201.09 cores=0,2,4,6
/proc/2516/task/2519/stat : 2519 (SArTagnan) R 2514 2516 32466 0 -1 4202560 90057 0 0 0 120070 39 0 0 25 0 4 0 517256080 2007392256 375771 33554432000 4194304 4623224 140737019873504 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=2516/tid=2520] ppid=2514 vsize=1960344 CPUtime=1201.85 cores=0,2,4,6
/proc/2516/task/2520/stat : 2520 (SArTagnan) R 2514 2516 32466 0 -1 4202560 8744252 0 0 0 118830 1355 0 0 25 0 4 0 517256080 2007392256 375771 33554432000 4194304 4623224 140737019873504 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 4800.1
Current children cumulated vsize (KiB) 1960344

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1201.98
CPU time (s): 4800.2
CPU user time (s): 4784.81
CPU system time (s): 15.3907
CPU usage (%): 399.359
Max. virtual memory (cumulated for all children) (KiB): 2342320

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4784.81
system time used= 15.3907
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 9551293
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 1664
involuntary context switches= 81320

runsolver used 1.85872 second user time and 4.70628 second system time

The end

Launcher Data 

Begin job on node135 at 2011-04-29 07:56:22
IDJOB=3258880
IDBENCH=71433
IDSOLVER=1656
FILE ID=node135/3258880-1304056582
RUNJOBID= node135-1304056582-2502
PBS_JOBID= 13170376
Free space on /tmp= 71120 MiB

SOLVER NAME= SArTagnan 2011-03-24
BENCH NAME= SAT09/CRAFTED/rbsat/random/forced/rbsat-v1150c84314gyes1.cnf
COMMAND LINE= SArTagnan BENCHNAME -threads=NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3258880-1304056582/watcher-3258880-1304056582 -o /tmp/evaluation-result-3258880-1304056582/solver-3258880-1304056582 -C 4800 -W 1300 -M 15500  SArTagnan HOME/instance-3258880-1304056582.cnf -threads=4

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= d6097a9814089eeede1d027388c17a02
RANDOM SEED=1507124635

node135.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.851
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.70
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.851
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.851
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.851
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 6640.14
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.851
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.78
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.851
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.851
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.851
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.76
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      22322336 kB
Buffers:       1831452 kB
Cached:        8135956 kB
SwapCached:          4 kB
Active:        2463084 kB
Inactive:      7573792 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      22322336 kB
SwapTotal:    67111528 kB
SwapFree:     67111524 kB
Dirty:            2428 kB
Writeback:           0 kB
AnonPages:       69244 kB
Mapped:          14500 kB
Slab:           528604 kB
PageTables:       4848 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS:   194376 kB
VmallocTotal: 34359738367 kB
VmallocUsed:     33868 kB
VmallocChunk: 34359703231 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 71120 MiB
End job on node135 at 2011-04-29 08:16:26