Trace number 3713105

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
wbo 1.71? 1799.49 1800.01

General information on the benchmark

Name/PARTIAL-SMALLINT-LIN/wcsp/jnh/
normalized-jnh307_wcsp.wbo
MD5SUM944c5e420229bce90a366c23629af03a
Bench CategoryPARTIAL-SMALLINT-LIN (both soft and hard constraints, small integers, linear constraints)
Best result obtained on this benchmarkMOPT
Best cost obtained on this benchmark540
Best CPU time to get the best result obtained on this benchmark0.087986
Max-Satisfiable
Max-(Un)Satisfiability was proved
Best value of the cost
Optimality of the best cost was proved
Number of variables200
Total number of constraints1000
Number of soft constraints900
Number of constraints which are clauses900
Number of constraints which are cardinality constraints (but not clauses)100
Number of constraints which are nor clauses,nor cardinality constraints0
Minimum length of a constraint2
Maximum length of a constraint11
Top cost 444855
Min constraint cost 1
Max constraint cost 1000
Sum of constraints costs 444854
Biggest number in a constraint 10
Number of bits of the biggest number in a constraint 4
Biggest sum of numbers in a constraint 21
Number of bits of the biggest sum of numbers5
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Solver Data 

0.00/0.00	c ==============================[ Solver Version ]===============================
0.00/0.00	c |                                                                             |
0.00/0.00	c |   wbo:                    1.71 beta - May, 2012                            |
0.00/0.00	c |                                                                             |
0.00/0.00	c Parsing wbo file format. File HOME/instance-3713105-1338222347.wbo.
0.00/0.00	c Instance file HOME/instance-3713105-1338222347.wbo
0.00/0.00	c File size is 47424 bytes.
0.00/0.00	c Highest Coefficient sum: 21
0.00/0.00	c ============================[ Problem Statistics ]=============================
0.00/0.00	c |                                                                             |
0.00/0.00	c |  Parsing time:          0.01         s                                      |
0.00/0.00	c |  Number Variables:      1100                                                |
0.00/0.00	c |  Number Clauses:        1100                                                |
0.00/0.00	c |  Number Cardinality:    0                                                   |
0.00/0.00	c |  Number PB Constraints: 0                                                   |
0.00/0.00	c |                                                                             |
0.00/0.00	c |  Problem Type:          Optimization                                        |
0.00/0.00	c |  Objective Function:    PB Constraint                                       |
0.00/0.00	c |                                                                             |
0.00/0.00	c ============================[ Search Statistics ]==============================
0.00/0.00	c | Time (s)  | ID |      Bound      |               Shared Clauses             |
0.00/0.00	c |           |    | value      type |  expCls         impCls        Lit/impCl  |
0.00/0.00	c ===============================================================================
0.00/0.01	c | 0.01      | 0  | 1            lb |  0                0                0.00  |
0.00/0.01	c | 0.01      | 0  | 6            lb |  0                0                0.00  |
0.00/0.01	c | 0.01      | 0  | 18           lb |  0                0                0.00  |
0.00/0.01	c | 0.01      | 0  | 36           lb |  0                0                0.00  |
0.00/0.01	c | 0.01      | 0  | 38           lb |  0                0                0.00  |
0.00/0.01	c | 0.02      | 0  | 44           lb |  0                0                0.00  |
0.00/0.02	c | 0.02      | 0  | 61           lb |  0                0                0.00  |
0.00/0.02	c | 0.02      | 0  | 63           lb |  0                0                0.00  |
0.00/0.02	c | 0.02      | 0  | 64           lb |  0                0                0.00  |
0.00/0.02	c | 0.03      | 0  | 67           lb |  0                0                0.00  |
0.00/0.02	c | 0.03      | 0  | 91           lb |  0                0                0.00  |
0.00/0.03	c | 0.03      | 0  | 102          lb |  0                0                0.00  |
0.00/0.03	c | 0.03      | 0  | 103          lb |  0                0                0.00  |
0.00/0.03	c | 0.04      | 0  | 115          lb |  0                0                0.00  |
0.00/0.04	c | 0.04      | 0  | 117          lb |  0                0                0.00  |
0.00/0.04	c | 0.04      | 0  | 123          lb |  0                0                0.00  |
0.00/0.04	c | 0.05      | 0  | 124          lb |  0                0                0.00  |
0.00/0.05	c | 0.05      | 0  | 126          lb |  0                0                0.00  |
0.00/0.05	c | 0.05      | 0  | 127          lb |  0                0                0.00  |
0.00/0.05	c | 0.06      | 0  | 135          lb |  0                0                0.00  |
0.05/0.06	c | 0.06      | 0  | 138          lb |  0                0                0.00  |
0.05/0.06	c | 0.06      | 0  | 139          lb |  0                0                0.00  |
0.05/0.06	c | 0.07      | 0  | 140          lb |  0                0                0.00  |
0.05/0.07	c | 0.07      | 0  | 141          lb |  0                0                0.00  |
0.05/0.07	c | 0.08      | 0  | 149          lb |  0                0                0.00  |
0.05/0.08	c | 0.08      | 0  | 150          lb |  0                0                0.00  |
0.05/0.08	c | 0.08      | 0  | 151          lb |  0                0                0.00  |
0.05/0.08	c | 0.09      | 0  | 189          lb |  0                0                0.00  |
0.05/0.09	c | 0.09      | 0  | 190          lb |  0                0                0.00  |
0.05/0.09	c | 0.10      | 0  | 192          lb |  0                0                0.00  |
0.09/0.10	c | 0.10      | 0  | 193          lb |  0                0                0.00  |
0.09/0.10	c | 0.11      | 0  | 194          lb |  0                0                0.00  |
0.09/0.11	c | 0.11      | 0  | 197          lb |  0                0                0.00  |
0.09/0.11	c | 0.12      | 0  | 198          lb |  0                0                0.00  |
0.09/0.12	c | 0.12      | 0  | 199          lb |  0                0                0.00  |
0.09/0.12	c | 0.12      | 0  | 200          lb |  0                0                0.00  |
0.09/0.13	c | 0.13      | 0  | 202          lb |  0                0                0.00  |
0.09/0.13	c | 0.13      | 0  | 218          lb |  0                0                0.00  |
0.09/0.14	c | 0.14      | 0  | 219          lb |  0                0                0.00  |
0.09/0.14	c | 0.14      | 0  | 220          lb |  0                0                0.00  |
0.09/0.15	c | 0.15      | 0  | 221          lb |  0                0                0.00  |
0.09/0.16	c | 0.16      | 0  | 222          lb |  0                0                0.00  |
0.09/0.17	c | 0.17      | 0  | 223          lb |  0                0                0.00  |
0.09/0.17	c | 0.18      | 0  | 224          lb |  0                0                0.00  |
0.09/0.18	c | 0.18      | 0  | 225          lb |  0                0                0.00  |
0.09/0.19	c | 0.19      | 0  | 227          lb |  0                0                0.00  |
0.19/0.20	c | 0.20      | 0  | 228          lb |  0                0                0.00  |
0.19/0.21	c | 0.21      | 0  | 229          lb |  0                0                0.00  |
0.19/0.22	c | 0.22      | 0  | 230          lb |  0                0                0.00  |
0.19/0.23	c | 0.23      | 0  | 231          lb |  0                0                0.00  |
0.19/0.24	c | 0.24      | 0  | 232          lb |  0                0                0.00  |
0.19/0.25	c | 0.25      | 0  | 233          lb |  0                0                0.00  |
0.19/0.25	c | 0.26      | 0  | 234          lb |  0                0                0.00  |
0.19/0.26	c | 0.27      | 0  | 235          lb |  0                0                0.00  |
0.19/0.27	c | 0.28      | 0  | 236          lb |  0                0                0.00  |
0.19/0.29	c | 0.29      | 0  | 237          lb |  0                0                0.00  |
0.29/0.30	c | 0.30      | 0  | 238          lb |  0                0                0.00  |
0.29/0.31	c | 0.32      | 0  | 239          lb |  0                0                0.00  |
0.29/0.33	c | 0.33      | 0  | 240          lb |  0                0                0.00  |
0.29/0.34	c | 0.35      | 0  | 241          lb |  0                0                0.00  |
0.29/0.36	c | 0.36      | 0  | 242          lb |  0                0                0.00  |
0.29/0.37	c | 0.37      | 0  | 243          lb |  0                0                0.00  |
0.29/0.38	c | 0.39      | 0  | 244          lb |  0                0                0.00  |
0.39/0.40	c | 0.40      | 0  | 245          lb |  0                0                0.00  |
0.39/0.42	c | 0.42      | 0  | 246          lb |  0                0                0.00  |
0.39/0.43	c | 0.43      | 0  | 247          lb |  0                0                0.00  |
0.39/0.45	c | 0.45      | 0  | 249          lb |  0                0                0.00  |
0.39/0.47	c | 0.47      | 0  | 250          lb |  0                0                0.00  |
0.39/0.48	c | 0.49      | 0  | 251          lb |  0                0                0.00  |
0.49/0.50	c | 0.50      | 0  | 252          lb |  0                0                0.00  |
0.49/0.51	c | 0.52      | 0  | 253          lb |  0                0                0.00  |
0.49/0.52	c | 0.53      | 0  | 254          lb |  0                0                0.00  |
0.49/0.55	c | 0.56      | 0  | 255          lb |  0                0                0.00  |
0.49/0.57	c | 0.57      | 0  | 256          lb |  0                0                0.00  |
0.49/0.58	c | 0.59      | 0  | 257          lb |  0                0                0.00  |
0.58/0.60	c | 0.61      | 0  | 258          lb |  0                0                0.00  |
0.58/0.64	c | 0.64      | 0  | 259          lb |  0                0                0.00  |
0.58/0.66	c | 0.66      | 0  | 260          lb |  0                0                0.00  |
0.58/0.69	c | 0.69      | 0  | 261          lb |  0                0                0.00  |
0.68/0.72	c | 0.72      | 0  | 262          lb |  0                0                0.00  |
0.68/0.74	c | 0.74      | 0  | 263          lb |  0                0                0.00  |
0.68/0.78	c | 0.78      | 0  | 264          lb |  0                0                0.00  |
0.78/0.80	c | 0.80      | 0  | 265          lb |  0                0                0.00  |
0.78/0.82	c | 0.82      | 0  | 266          lb |  0                0                0.00  |
0.78/0.84	c | 0.85      | 0  | 267          lb |  0                0                0.00  |
0.78/0.87	c | 0.88      | 0  | 268          lb |  0                0                0.00  |
0.88/0.90	c | 0.90      | 0  | 269          lb |  0                0                0.00  |
0.88/1.00	c | 0.94      | 0  | 270          lb |  0                0                0.00  |
0.88/1.00	c | 0.97      | 0  | 271          lb |  0                0                0.00  |
0.88/1.00	c | 0.99      | 0  | 272          lb |  0                0                0.00  |
0.98/1.02	c | 1.03      | 0  | 273          lb |  0                0                0.00  |
0.98/1.05	c | 1.06      | 0  | 274          lb |  0                0                0.00  |
0.98/1.08	c | 1.08      | 0  | 275          lb |  0                0                0.00  |
1.08/1.10	c | 1.11      | 0  | 276          lb |  0                0                0.00  |
1.08/1.13	c | 1.14      | 0  | 277          lb |  0                0                0.00  |
1.08/1.16	c | 1.17      | 0  | 278          lb |  0                0                0.00  |
1.08/1.19	c | 1.20      | 0  | 279          lb |  0                0                0.00  |
1.17/1.23	c | 1.23      | 0  | 280          lb |  0                0                0.00  |
1.17/1.28	c | 1.28      | 0  | 281          lb |  0                0                0.00  |
1.28/1.31	c | 1.31      | 0  | 282          lb |  0                0                0.00  |
1.28/1.34	c | 1.35      | 0  | 283          lb |  0                0                0.00  |
1.28/1.37	c | 1.38      | 0  | 284          lb |  0                0                0.00  |
1.38/1.41	c | 1.41      | 0  | 285          lb |  0                0                0.00  |
1.38/1.45	c | 1.46      | 0  | 286          lb |  0                0                0.00  |
1.38/1.49	c | 1.50      | 0  | 287          lb |  0                0                0.00  |
1.48/1.53	c | 1.54      | 0  | 288          lb |  0                0                0.00  |
1.48/1.57	c | 1.58      | 0  | 289          lb |  0                0                0.00  |
1.58/1.61	c | 1.62      | 0  | 290          lb |  0                0                0.00  |
1.58/1.66	c | 1.66      | 0  | 291          lb |  0                0                0.00  |
1.68/1.73	c | 1.73      | 0  | 292          lb |  0                0                0.00  |
1.68/1.77	c | 1.77      | 0  | 293          lb |  0                0                0.00  |
1.78/1.82	c | 1.82      | 0  | 294          lb |  0                0                0.00  |
1.78/1.88	c | 1.89      | 0  | 295          lb |  0                0                0.00  |
1.88/1.93	c | 1.93      | 0  | 296          lb |  0                0                0.00  |
1.88/1.97	c | 1.97      | 0  | 297          lb |  0                0                0.00  |
1.97/2.01	c | 2.01      | 0  | 298          lb |  0                0                0.00  |
1.97/2.06	c | 2.06      | 0  | 299          lb |  0                0                0.00  |
2.08/2.12	c | 2.12      | 0  | 300          lb |  0                0                0.00  |
2.08/2.16	c | 2.16      | 0  | 301          lb |  0                0                0.00  |
2.18/2.22	c | 2.22      | 0  | 302          lb |  0                0                0.00  |
2.18/2.29	c | 2.29      | 0  | 303          lb |  0                0                0.00  |
2.27/2.34	c | 2.35      | 0  | 304          lb |  0                0                0.00  |
2.38/2.40	c | 2.40      | 0  | 305          lb |  0                0                0.00  |
2.38/2.45	c | 2.46      | 0  | 306          lb |  0                0                0.00  |
2.48/2.50	c | 2.50      | 0  | 307          lb |  0                0                0.00  |
2.48/2.55	c | 2.56      | 0  | 308          lb |  0                0                0.00  |
2.58/2.64	c | 2.64      | 0  | 309          lb |  0                0                0.00  |
2.68/2.71	c | 2.72      | 0  | 310          lb |  0                0                0.00  |
2.68/2.78	c | 2.79      | 0  | 311          lb |  0                0                0.00  |
2.78/2.86	c | 2.87      | 0  | 312          lb |  0                0                0.00  |
2.87/2.92	c | 2.92      | 0  | 313          lb |  0                0                0.00  |
2.97/3.03	c | 3.03      | 0  | 314          lb |  0                0                0.00  |
2.97/3.08	c | 3.08      | 0  | 315          lb |  0                0                0.00  |
3.07/3.13	c | 3.13      | 0  | 316          lb |  0                0                0.00  |
3.07/3.19	c | 3.19      | 0  | 317          lb |  0                0                0.00  |
3.18/3.28	c | 3.28      | 0  | 318          lb |  0                0                0.00  |
3.28/3.37	c | 3.37      | 0  | 319          lb |  0                0                0.00  |
3.38/3.46	c | 3.46      | 0  | 320          lb |  0                0                0.00  |
3.48/3.52	c | 3.52      | 0  | 321          lb |  0                0                0.00  |
3.48/3.57	c | 3.58      | 0  | 322          lb |  0                0                0.00  |
3.58/3.63	c | 3.63      | 0  | 323          lb |  0                0                0.00  |
3.58/3.69	c | 3.69      | 0  | 324          lb |  0                0                0.00  |
3.67/3.74	c | 3.75      | 0  | 325          lb |  0                0                0.00  |
3.77/3.81	c | 3.81      | 0  | 326          lb |  0                0                0.00  |
3.77/3.87	c | 3.87      | 0  | 327          lb |  0                0                0.00  |
3.87/3.94	c | 3.94      | 0  | 328          lb |  0                0                0.00  |
3.97/4.01	c | 4.01      | 0  | 329          lb |  0                0                0.00  |
3.97/4.07	c | 4.08      | 0  | 330          lb |  0                0                0.00  |
4.07/4.15	c | 4.15      | 0  | 331          lb |  0                0                0.00  |
4.17/4.23	c | 4.23      | 0  | 332          lb |  0                0                0.00  |
4.28/4.33	c | 4.34      | 0  | 333          lb |  0                0                0.00  |
4.38/4.41	c | 4.41      | 0  | 334          lb |  0                0                0.00  |
4.38/4.48	c | 4.49      | 0  | 335          lb |  0                0                0.00  |
4.48/4.58	c | 4.58      | 0  | 336          lb |  0                0                0.00  |
4.58/4.66	c | 4.67      | 0  | 337          lb |  0                0                0.00  |
4.68/4.77	c | 4.77      | 0  | 338          lb |  0                0                0.00  |
4.78/4.85	c | 4.85      | 0  | 339          lb |  0                0                0.00  |
4.88/4.94	c | 4.94      | 0  | 340          lb |  0                0                0.00  |
4.98/5.01	c | 5.02      | 0  | 341          lb |  0                0                0.00  |
5.08/5.11	c | 5.11      | 0  | 342          lb |  0                0                0.00  |
5.18/5.21	c | 5.22      | 0  | 343          lb |  0                0                0.00  |
5.28/5.33	c | 5.33      | 0  | 344          lb |  0                0                0.00  |
5.38/5.42	c | 5.42      | 0  | 345          lb |  0                0                0.00  |
5.38/5.50	c | 5.50      | 0  | 346          lb |  0                0                0.00  |
5.48/5.59	c | 5.59      | 0  | 347          lb |  0                0                0.00  |
5.68/5.74	c | 5.74      | 0  | 348          lb |  0                0                0.00  |
5.78/5.85	c | 5.85      | 0  | 349          lb |  0                0                0.00  |
5.88/5.97	c | 5.97      | 0  | 350          lb |  0                0                0.00  |
5.98/6.08	c | 6.09      | 0  | 351          lb |  0                0                0.00  |
6.17/6.22	c | 6.22      | 0  | 352          lb |  0                0                0.00  |
6.27/6.35	c | 6.35      | 0  | 353          lb |  0                0                0.00  |
6.37/6.50	c | 6.50      | 0  | 354          lb |  0                0                0.00  |
6.58/6.63	c | 6.64      | 0  | 355          lb |  0                0                0.00  |
6.67/6.76	c | 6.76      | 0  | 356          lb |  0                0                0.00  |
6.78/6.89	c | 6.89      | 0  | 357          lb |  0                0                0.00  |
6.98/7.04	c | 7.05      | 0  | 358          lb |  0                0                0.00  |
7.08/7.17	c | 7.18      | 0  | 359          lb |  0                0                0.00  |
7.28/7.33	c | 7.33      | 0  | 360          lb |  0                0                0.00  |
7.48/7.52	c | 7.52      | 0  | 361          lb |  0                0                0.00  |
8.28/8.32	c | 8.33      | 0  | 362          lb |  0                0                0.00  |
11.17/11.28	c | 11.29     | 0  | 363          lb |  0                0                0.00  |
35.37/35.40	c | 35.40     | 0  | 364          lb |  0                0                0.00  |
1799.49/1800.00	c ===============================================================================
1799.49/1800.00	c Wall Clock Time: 1800.00 s
1799.49/1800.00	s UNKNOWN

Verifier Data 

ERROR: no interpretation found !

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.1 (svn: 989)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3713105-1338222347/watcher-3713105-1338222347 -o /tmp/evaluation-result-3713105-1338222347/solver-3713105-1338222347 -C 1800 -W 1900 -M 15500 wbo1.71 -file-format=wbo HOME/instance-3713105-1338222347.wbo 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1900 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 2.03 2.01 2.00 3/177 16311
/proc/meminfo: memFree=28710452/32873844 swapFree=7116/7116
[pid=16311] ppid=16309 vsize=4436 CPUtime=0 cores=1,3,5,7
/proc/16311/stat : 16311 (wbo1.71) R 16309 16311 12215 0 -1 4202496 592 0 0 0 0 0 0 0 20 0 1 0 288359760 4542464 534 33554432000 4194304 5964318 140735935829280 140735344705768 4297148 0 0 4096 16387 0 0 0 17 5 0 0 0 0 0
/proc/16311/statm: 1109 543 167 433 0 673 0

[startup+0.0581441 s]
/proc/loadavg: 2.03 2.01 2.00 3/177 16311
/proc/meminfo: memFree=28710452/32873844 swapFree=7116/7116
[pid=16311] ppid=16309 vsize=83844 CPUtime=0.05 cores=1,3,5,7
/proc/16311/stat : 16311 (wbo1.71) S 16309 16311 12215 0 -1 4202496 1367 0 0 0 5 0 0 0 20 0 2 0 288359760 85856256 1308 33554432000 4194304 5964318 140735935829280 140735935828800 4546589 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/16311/statm: 20961 1308 198 433 0 20525 0
Current children cumulated CPU time (s) 0.05
Current children cumulated vsize (KiB) 83844

[startup+0.100162 s]
/proc/loadavg: 2.03 2.01 2.00 3/177 16311
/proc/meminfo: memFree=28710452/32873844 swapFree=7116/7116
[pid=16311] ppid=16309 vsize=83844 CPUtime=0.09 cores=1,3,5,7
/proc/16311/stat : 16311 (wbo1.71) S 16309 16311 12215 0 -1 4202496 1636 0 0 0 9 0 0 0 20 0 2 0 288359760 85856256 1459 33554432000 4194304 5964318 140735935829280 140735935828800 4546589 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/16311/statm: 20961 1459 198 433 0 20525 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 83844

[startup+0.300119 s]
/proc/loadavg: 2.03 2.01 2.00 3/177 16311
/proc/meminfo: memFree=28710452/32873844 swapFree=7116/7116
[pid=16311] ppid=16309 vsize=83844 CPUtime=0.29 cores=1,3,5,7
/proc/16311/stat : 16311 (wbo1.71) S 16309 16311 12215 0 -1 4202496 2782 0 0 0 29 0 0 0 20 0 2 0 288359760 85856256 2115 33554432000 4194304 5964318 140735935829280 140735935828800 4546589 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/16311/statm: 20961 2115 198 433 0 20525 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 83844

[startup+0.700168 s]
/proc/loadavg: 2.03 2.01 2.00 3/177 16311
/proc/meminfo: memFree=28710452/32873844 swapFree=7116/7116
[pid=16311] ppid=16309 vsize=85132 CPUtime=0.68 cores=1,3,5,7
/proc/16311/stat : 16311 (wbo1.71) S 16309 16311 12215 0 -1 4202496 5035 0 0 0 68 0 0 0 20 0 2 0 288359760 87175168 3179 33554432000 4194304 5964318 140735935829280 140735935828800 4546589 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/16311/statm: 21283 3179 199 433 0 20847 0
Current children cumulated CPU time (s) 0.68
Current children cumulated vsize (KiB) 85132

[startup+1.50038 s]
/proc/loadavg: 2.03 2.01 2.00 3/179 16313
/proc/meminfo: memFree=28695548/32873844 swapFree=7116/7116
[pid=16311] ppid=16309 vsize=83844 CPUtime=1.48 cores=1,3,5,7
/proc/16311/stat : 16311 (wbo1.71) S 16309 16311 12215 0 -1 4202496 9460 0 0 0 147 1 0 0 20 0 2 0 288359760 85856256 5339 33554432000 4194304 5964318 140735935829280 140735935828800 4546589 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/16311/statm: 20961 5339 199 433 0 20525 0
[pid=16311/tid=16313] ppid=16309 vsize=83844 CPUtime=1.47 cores=1,3,5,7
/proc/16311/task/16313/stat : 16313 (wbo1.71) R 16309 16311 12215 0 -1 4202560 8682 0 0 0 145 2 0 0 20 0 2 0 288359761 85856256 5339 33554432000 4194304 5964318 140735935829280 139635318907200 5139070 0 0 4096 16387 0 0 0 -1 1 0 0 0 0 0
Current children cumulated CPU time (s) 1.48
Current children cumulated vsize (KiB) 83844

[startup+3.1004 s]
/proc/loadavg: 2.03 2.01 2.00 3/179 16313
/proc/meminfo: memFree=28687488/32873844 swapFree=7116/7116
[pid=16311] ppid=16309 vsize=83844 CPUtime=3.07 cores=1,3,5,7
/proc/16311/stat : 16311 (wbo1.71) S 16309 16311 12215 0 -1 4202496 15946 0 0 0 305 2 0 0 20 0 2 0 288359760 85856256 7217 33554432000 4194304 5964318 140735935829280 140735935828800 4546589 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/16311/statm: 20961 7217 199 433 0 20525 0
[pid=16311/tid=16313] ppid=16309 vsize=83844 CPUtime=3.07 cores=1,3,5,7
/proc/16311/task/16313/stat : 16313 (wbo1.71) R 16309 16311 12215 0 -1 4202560 15168 0 0 0 304 3 0 0 20 0 2 0 288359761 85856256 7217 33554432000 4194304 5964318 140735935829280 139635318917464 5122371 0 0 4096 16387 0 0 0 -1 1 0 0 0 0 0
Current children cumulated CPU time (s) 3.07
Current children cumulated vsize (KiB) 83844

[startup+6.30034 s]
/proc/loadavg: 2.03 2.01 2.00 3/179 16313
/proc/meminfo: memFree=28669880/32873844 swapFree=7116/7116
[pid=16311] ppid=16309 vsize=83844 CPUtime=6.27 cores=1,3,5,7
/proc/16311/stat : 16311 (wbo1.71) S 16309 16311 12215 0 -1 4202496 26587 0 0 0 623 4 0 0 20 0 2 0 288359760 85856256 11444 33554432000 4194304 5964318 140735935829280 140735935828800 4546589 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/16311/statm: 20961 11444 199 433 0 20525 0
[pid=16311/tid=16313] ppid=16309 vsize=83844 CPUtime=6.26 cores=1,3,5,7
/proc/16311/task/16313/stat : 16313 (wbo1.71) R 16309 16311 12215 0 -1 4202560 25809 0 0 0 622 4 0 0 20 0 2 0 288359761 85856256 11444 33554432000 4194304 5964318 140735935829280 139635318917464 4403485 0 0 4096 16387 0 0 0 -1 1 0 0 0 0 0
Current children cumulated CPU time (s) 6.27
Current children cumulated vsize (KiB) 83844

[startup+12.7003 s]
/proc/loadavg: 2.03 2.01 2.00 3/179 16313
/proc/meminfo: memFree=28657780/32873844 swapFree=7116/7116
[pid=16311] ppid=16309 vsize=83844 CPUtime=12.67 cores=1,3,5,7
/proc/16311/stat : 16311 (wbo1.71) S 16309 16311 12215 0 -1 4202496 30194 0 0 0 1262 5 0 0 20 0 2 0 288359760 85856256 12752 33554432000 4194304 5964318 140735935829280 140735935828800 4546589 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/16311/statm: 20961 12752 199 433 0 20525 0
[pid=16311/tid=16313] ppid=16309 vsize=83844 CPUtime=12.64 cores=1,3,5,7
/proc/16311/task/16313/stat : 16313 (wbo1.71) R 16309 16311 12215 0 -1 4202560 29416 0 0 0 1259 5 0 0 20 0 2 0 288359761 85856256 12752 33554432000 4194304 5964318 140735935829280 139635318917448 4403602 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 12.67
Current children cumulated vsize (KiB) 83844

[startup+25.5004 s]
/proc/loadavg: 2.02 2.01 2.00 3/179 16313
/proc/meminfo: memFree=28644752/32873844 swapFree=7116/7116
[pid=16311] ppid=16309 vsize=83844 CPUtime=25.46 cores=1,3,5,7
/proc/16311/stat : 16311 (wbo1.71) S 16309 16311 12215 0 -1 4202496 32429 0 0 0 2541 5 0 0 20 0 2 0 288359760 85856256 14987 33554432000 4194304 5964318 140735935829280 140735935828800 4546589 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/16311/statm: 20961 14987 199 433 0 20525 0
[pid=16311/tid=16313] ppid=16309 vsize=83844 CPUtime=25.4 cores=1,3,5,7
/proc/16311/task/16313/stat : 16313 (wbo1.71) R 16309 16311 12215 0 -1 4202560 31651 0 0 0 2535 5 0 0 20 0 2 0 288359761 85856256 14987 33554432000 4194304 5964318 140735935829280 139635318917112 4387852 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 25.46
Current children cumulated vsize (KiB) 83844

[startup+51.1003 s]
/proc/loadavg: 2.01 2.01 2.00 3/179 16313
/proc/meminfo: memFree=28604420/32873844 swapFree=7116/7116
[pid=16311] ppid=16309 vsize=149380 CPUtime=51.06 cores=1,3,5,7
/proc/16311/stat : 16311 (wbo1.71) S 16309 16311 12215 0 -1 4202496 40651 0 0 0 5097 9 0 0 20 0 2 0 288359760 152965120 23207 33554432000 4194304 5964318 140735935829280 140735935828800 4546589 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/16311/statm: 37345 23207 199 433 0 36909 0
[pid=16311/tid=16313] ppid=16309 vsize=149380 CPUtime=50.94 cores=1,3,5,7
/proc/16311/task/16313/stat : 16313 (wbo1.71) R 16309 16311 12215 0 -1 4202560 39873 0 0 0 5085 9 0 0 20 0 2 0 288359761 152965120 23207 33554432000 4194304 5964318 140735935829280 139635318917480 4403416 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 51.06
Current children cumulated vsize (KiB) 149380

[startup+102.307 s]
/proc/loadavg: 2.00 2.00 2.00 3/178 16313
/proc/meminfo: memFree=28587600/32873844 swapFree=7116/7116
[pid=16311] ppid=16309 vsize=149380 CPUtime=102.26 cores=1,3,5,7
/proc/16311/stat : 16311 (wbo1.71) S 16309 16311 12215 0 -1 4202496 40729 0 0 0 10217 9 0 0 20 0 2 0 288359760 152965120 23282 33554432000 4194304 5964318 140735935829280 140735935828800 4546589 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/16311/statm: 37345 23282 199 433 0 36909 0
[pid=16311/tid=16313] ppid=16309 vsize=149380 CPUtime=102.01 cores=1,3,5,7
/proc/16311/task/16313/stat : 16313 (wbo1.71) R 16309 16311 12215 0 -1 4202560 39951 0 0 0 10191 10 0 0 20 0 2 0 288359761 152965120 23282 33554432000 4194304 5964318 140735935829280 139635318917480 4400007 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 102.26
Current children cumulated vsize (KiB) 149380

[startup+162.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/179 16314
/proc/meminfo: memFree=28536112/32873844 swapFree=7116/7116
[pid=16311] ppid=16309 vsize=149380 CPUtime=162.21 cores=1,3,5,7
/proc/16311/stat : 16311 (wbo1.71) S 16309 16311 12215 0 -1 4202496 46906 0 0 0 16207 14 0 0 20 0 2 0 288359760 152965120 29949 33554432000 4194304 5964318 140735935829280 140735935828800 4546589 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/16311/statm: 37345 29950 199 433 0 36909 0
[pid=16311/tid=16313] ppid=16309 vsize=149380 CPUtime=161.81 cores=1,3,5,7
/proc/16311/task/16313/stat : 16313 (wbo1.71) R 16309 16311 12215 0 -1 4202560 46129 0 0 0 16165 16 0 0 20 0 2 0 288359761 152965120 29950 33554432000 4194304 5964318 140735935829280 139635318916920 4400442 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 162.21
Current children cumulated vsize (KiB) 149380

[startup+222.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/179 16314
/proc/meminfo: memFree=28499400/32873844 swapFree=7116/7116
[pid=16311] ppid=16309 vsize=214916 CPUtime=222.19 cores=1,3,5,7
/proc/16311/stat : 16311 (wbo1.71) S 16309 16311 12215 0 -1 4202496 52136 0 0 0 22201 18 0 0 20 0 2 0 288359760 220073984 35174 33554432000 4194304 5964318 140735935829280 140735935828800 4546589 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/16311/statm: 53729 35174 199 433 0 53293 0
[pid=16311/tid=16313] ppid=16309 vsize=214916 CPUtime=221.66 cores=1,3,5,7
/proc/16311/task/16313/stat : 16313 (wbo1.71) R 16309 16311 12215 0 -1 4202560 51358 0 0 0 22145 21 0 0 20 0 2 0 288359761 220073984 35174 33554432000 4194304 5964318 140735935829280 139635318916920 4403267 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 222.19
Current children cumulated vsize (KiB) 214916

[startup+282.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/180 16317
/proc/meminfo: memFree=28475540/32873844 swapFree=7116/7116
[pid=16311] ppid=16309 vsize=214916 CPUtime=282.18 cores=1,3,5,7
/proc/16311/stat : 16311 (wbo1.71) S 16309 16311 12215 0 -1 4202496 54422 0 0 0 28199 19 0 0 20 0 2 0 288359760 220073984 37457 33554432000 4194304 5964318 140735935829280 140735935828800 4546589 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/16311/statm: 53729 37457 199 433 0 53293 0
[pid=16311/tid=16313] ppid=16309 vsize=214916 CPUtime=281.5 cores=1,3,5,7
/proc/16311/task/16313/stat : 16313 (wbo1.71) R 16309 16311 12215 0 -1 4202560 53644 0 0 0 28127 23 0 0 20 0 2 0 288359761 220073984 37457 33554432000 4194304 5964318 140735935829280 139635318916920 4222416 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 282.18
Current children cumulated vsize (KiB) 214916

[startup+342.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/179 16317
/proc/meminfo: memFree=28429992/32873844 swapFree=7116/7116
[pid=16311] ppid=16309 vsize=214916 CPUtime=342.15 cores=1,3,5,7
/proc/16311/stat : 16311 (wbo1.71) S 16309 16311 12215 0 -1 4202496 58688 0 0 0 34192 23 0 0 20 0 2 0 288359760 220073984 42401 33554432000 4194304 5964318 140735935829280 140735935828800 4546589 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/16311/statm: 53729 42401 199 433 0 53293 0
[pid=16311/tid=16313] ppid=16309 vsize=214916 CPUtime=341.33 cores=1,3,5,7
/proc/16311/task/16313/stat : 16313 (wbo1.71) R 16309 16311 12215 0 -1 4202560 57910 0 0 0 34105 28 0 0 20 0 2 0 288359761 220073984 42401 33554432000 4194304 5964318 140735935829280 139635318916920 4399960 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 342.15
Current children cumulated vsize (KiB) 214916

[startup+402.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/179 16317
/proc/meminfo: memFree=28380232/32873844 swapFree=7116/7116
[pid=16311] ppid=16309 vsize=214916 CPUtime=402.13 cores=1,3,5,7
/proc/16311/stat : 16311 (wbo1.71) S 16309 16311 12215 0 -1 4202496 65736 0 0 0 40182 31 0 0 20 0 2 0 288359760 220073984 49761 33554432000 4194304 5964318 140735935829280 140735935828800 4546589 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/16311/statm: 53729 49761 199 433 0 53293 0
[pid=16311/tid=16313] ppid=16309 vsize=214916 CPUtime=401.16 cores=1,3,5,7
/proc/16311/task/16313/stat : 16313 (wbo1.71) R 16309 16311 12215 0 -1 4202560 64958 0 0 0 40080 36 0 0 20 0 2 0 288359761 220073984 49761 33554432000 4194304 5964318 140735935829280 139635318916920 4392611 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 402.13
Current children cumulated vsize (KiB) 214916

[startup+462.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/179 16318
/proc/meminfo: memFree=28351584/32873844 swapFree=7116/7116
[pid=16311] ppid=16309 vsize=280452 CPUtime=462.11 cores=1,3,5,7

################
# More data... #
################


[startup+1422.31 s]
/proc/loadavg: 2.00 2.00 2.00 3/179 16325
/proc/meminfo: memFree=28097688/32873844 swapFree=7116/7116
[pid=16311] ppid=16309 vsize=480708 CPUtime=1421.88 cores=1,3,5,7
/proc/16311/stat : 16311 (wbo1.71) S 16309 16311 12215 0 -1 4202496 115450 0 0 0 142105 83 0 0 20 0 2 0 288359760 492244992 102112 33554432000 4194304 5964318 140735935829280 140735935828800 4546589 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/16311/statm: 120177 102112 199 433 0 119741 0
[pid=16311/tid=16313] ppid=16309 vsize=480708 CPUtime=1418.46 cores=1,3,5,7
/proc/16311/task/16313/stat : 16313 (wbo1.71) R 16309 16311 12215 0 -1 4202560 114672 0 0 0 141742 104 0 0 20 0 2 0 288359761 492244992 102112 33554432000 4194304 5964318 140735935829280 139635318916984 4399758 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 1421.88
Current children cumulated vsize (KiB) 480708

[startup+1482.3 s]
/proc/loadavg: 2.06 2.01 2.00 3/180 16328
/proc/meminfo: memFree=28073368/32873844 swapFree=7116/7116
[pid=16311] ppid=16309 vsize=480708 CPUtime=1481.87 cores=1,3,5,7
/proc/16311/stat : 16311 (wbo1.71) S 16309 16311 12215 0 -1 4202496 116071 0 0 0 148103 84 0 0 20 0 2 0 288359760 492244992 102841 33554432000 4194304 5964318 140735935829280 140735935828800 4546589 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/16311/statm: 120177 102841 199 433 0 119741 0
[pid=16311/tid=16313] ppid=16309 vsize=480708 CPUtime=1478.3 cores=1,3,5,7
/proc/16311/task/16313/stat : 16313 (wbo1.71) R 16309 16311 12215 0 -1 4202560 115293 0 0 0 147725 105 0 0 20 0 2 0 288359761 492244992 102841 33554432000 4194304 5964318 140735935829280 139635318916984 4399910 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 1481.87
Current children cumulated vsize (KiB) 480708

[startup+1542.3 s]
/proc/loadavg: 2.05 2.02 2.00 3/179 16328
/proc/meminfo: memFree=28068220/32873844 swapFree=7116/7116
[pid=16311] ppid=16309 vsize=480708 CPUtime=1541.85 cores=1,3,5,7
/proc/16311/stat : 16311 (wbo1.71) S 16309 16311 12215 0 -1 4202496 116674 0 0 0 154101 84 0 0 20 0 2 0 288359760 492244992 103594 33554432000 4194304 5964318 140735935829280 140735935828800 4546589 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/16311/statm: 120177 103594 199 433 0 119741 0
[pid=16311/tid=16313] ppid=16309 vsize=480708 CPUtime=1538.14 cores=1,3,5,7
/proc/16311/task/16313/stat : 16313 (wbo1.71) R 16309 16311 12215 0 -1 4202560 115896 0 0 0 153707 107 0 0 20 0 2 0 288359761 492244992 103594 33554432000 4194304 5964318 140735935829280 139635318916984 4399991 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 1541.85
Current children cumulated vsize (KiB) 480708

[startup+1602.3 s]
/proc/loadavg: 2.02 2.02 2.00 3/179 16367
/proc/meminfo: memFree=28358892/32873844 swapFree=7116/7116
[pid=16311] ppid=16309 vsize=480708 CPUtime=1601.84 cores=1,3,5,7
/proc/16311/stat : 16311 (wbo1.71) S 16309 16311 12215 0 -1 4202496 118945 0 0 0 160097 87 0 0 20 0 2 0 288359760 492244992 105861 33554432000 4194304 5964318 140735935829280 140735935828800 4546589 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/16311/statm: 120177 105861 199 433 0 119741 0
[pid=16311/tid=16313] ppid=16309 vsize=480708 CPUtime=1597.98 cores=1,3,5,7
/proc/16311/task/16313/stat : 16313 (wbo1.71) R 16309 16311 12215 0 -1 4202560 118167 0 0 0 159687 111 0 0 20 0 2 0 288359761 492244992 105861 33554432000 4194304 5964318 140735935829280 139635318917112 4399824 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 1601.84
Current children cumulated vsize (KiB) 480708

[startup+1662.3 s]
/proc/loadavg: 2.00 2.01 2.00 3/179 16368
/proc/meminfo: memFree=28279068/32873844 swapFree=7116/7116
[pid=16311] ppid=16309 vsize=480708 CPUtime=1661.83 cores=1,3,5,7
/proc/16311/stat : 16311 (wbo1.71) S 16309 16311 12215 0 -1 4202496 122607 0 0 0 166091 92 0 0 20 0 2 0 288359760 492244992 109574 33554432000 4194304 5964318 140735935829280 140735935828800 4546589 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/16311/statm: 120177 109574 199 433 0 119741 0
[pid=16311/tid=16313] ppid=16309 vsize=480708 CPUtime=1657.83 cores=1,3,5,7
/proc/16311/task/16313/stat : 16313 (wbo1.71) R 16309 16311 12215 0 -1 4202560 121829 0 0 0 165666 117 0 0 20 0 2 0 288359761 492244992 109574 33554432000 4194304 5964318 140735935829280 139635318917112 4399824 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 1661.83
Current children cumulated vsize (KiB) 480708

[startup+1722.3 s]
/proc/loadavg: 2.00 2.01 2.00 3/179 16368
/proc/meminfo: memFree=28228464/32873844 swapFree=7116/7116
[pid=16311] ppid=16309 vsize=480708 CPUtime=1721.82 cores=1,3,5,7
/proc/16311/stat : 16311 (wbo1.71) S 16309 16311 12215 0 -1 4202496 126146 0 0 0 172085 97 0 0 20 0 2 0 288359760 492244992 113112 33554432000 4194304 5964318 140735935829280 140735935828800 4546589 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/16311/statm: 120177 113112 199 433 0 119741 0
[pid=16311/tid=16313] ppid=16309 vsize=480708 CPUtime=1717.68 cores=1,3,5,7
/proc/16311/task/16313/stat : 16313 (wbo1.71) R 16309 16311 12215 0 -1 4202560 125368 0 0 0 171645 123 0 0 20 0 2 0 288359761 492244992 113112 33554432000 4194304 5964318 140735935829280 139635318917112 4399824 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 1721.82
Current children cumulated vsize (KiB) 480708

[startup+1782.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/179 16368
/proc/meminfo: memFree=28185340/32873844 swapFree=7116/7116
[pid=16311] ppid=16309 vsize=546244 CPUtime=1781.81 cores=1,3,5,7
/proc/16311/stat : 16311 (wbo1.71) S 16309 16311 12215 0 -1 4202496 129444 0 0 0 178080 101 0 0 20 0 2 0 288359760 559353856 116785 33554432000 4194304 5964318 140735935829280 140735935828800 4546589 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/16311/statm: 136561 116785 199 433 0 136125 0
[pid=16311/tid=16313] ppid=16309 vsize=546244 CPUtime=1777.52 cores=1,3,5,7
/proc/16311/task/16313/stat : 16313 (wbo1.71) R 16309 16311 12215 0 -1 4202560 128666 0 0 0 177624 128 0 0 20 0 2 0 288359761 559353856 116785 33554432000 4194304 5964318 140735935829280 139635318917112 4399824 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 1781.81
Current children cumulated vsize (KiB) 546244

Solver just ended. Dumping a history of the last processes samples

[startup+1791.91 s]
/proc/loadavg: 2.00 2.00 2.00 3/179 16368
/proc/meminfo: memFree=28181356/32873844 swapFree=7116/7116
[pid=16311] ppid=16309 vsize=546244 CPUtime=1791.4 cores=1,3,5,7
/proc/16311/stat : 16311 (wbo1.71) S 16309 16311 12215 0 -1 4202496 130027 0 0 0 179039 101 0 0 20 0 2 0 288359760 559353856 117519 33554432000 4194304 5964318 140735935829280 140735935828800 4546589 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/16311/statm: 136561 117519 199 433 0 136125 0
[pid=16311/tid=16313] ppid=16309 vsize=546244 CPUtime=1787.09 cores=1,3,5,7
/proc/16311/task/16313/stat : 16313 (wbo1.71) R 16309 16311 12215 0 -1 4202560 129249 0 0 0 178581 128 0 0 20 0 2 0 288359761 559353856 117519 33554432000 4194304 5964318 140735935829280 139635318916920 4399827 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 1791.4
Current children cumulated vsize (KiB) 546244

[startup+1795.1 s]
/proc/loadavg: 2.00 2.00 2.00 3/179 16368
/proc/meminfo: memFree=28180612/32873844 swapFree=7116/7116
[pid=16311] ppid=16309 vsize=546244 CPUtime=1794.6 cores=1,3,5,7
/proc/16311/stat : 16311 (wbo1.71) S 16309 16311 12215 0 -1 4202496 130152 0 0 0 179359 101 0 0 20 0 2 0 288359760 559353856 117644 33554432000 4194304 5964318 140735935829280 140735935828800 4546589 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/16311/statm: 136561 117644 199 433 0 136125 0
[pid=16311/tid=16313] ppid=16309 vsize=546244 CPUtime=1790.28 cores=1,3,5,7
/proc/16311/task/16313/stat : 16313 (wbo1.71) R 16309 16311 12215 0 -1 4202560 129374 0 0 0 178900 128 0 0 20 0 2 0 288359761 559353856 117644 33554432000 4194304 5964318 140735935829280 139635318917160 4399995 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 1794.6
Current children cumulated vsize (KiB) 546244

[startup+1798.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/179 16368
/proc/meminfo: memFree=28179372/32873844 swapFree=7116/7116
[pid=16311] ppid=16309 vsize=546244 CPUtime=1797.79 cores=1,3,5,7
/proc/16311/stat : 16311 (wbo1.71) S 16309 16311 12215 0 -1 4202496 130411 0 0 0 179678 101 0 0 20 0 2 0 288359760 559353856 117903 33554432000 4194304 5964318 140735935829280 140735935828800 4546589 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/16311/statm: 136561 117903 199 433 0 136125 0
[pid=16311/tid=16313] ppid=16309 vsize=546244 CPUtime=1793.47 cores=1,3,5,7
/proc/16311/task/16313/stat : 16313 (wbo1.71) R 16309 16311 12215 0 -1 4202560 129633 0 0 0 179219 128 0 0 20 0 2 0 288359761 559353856 117903 33554432000 4194304 5964318 140735935829280 139635318916920 4220672 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 1797.79
Current children cumulated vsize (KiB) 546244

[startup+1799.1 s]
/proc/loadavg: 2.00 2.00 2.00 3/179 16368
/proc/meminfo: memFree=28179372/32873844 swapFree=7116/7116
[pid=16311] ppid=16309 vsize=546244 CPUtime=1798.59 cores=1,3,5,7
/proc/16311/stat : 16311 (wbo1.71) S 16309 16311 12215 0 -1 4202496 130412 0 0 0 179758 101 0 0 20 0 2 0 288359760 559353856 117904 33554432000 4194304 5964318 140735935829280 140735935828800 4546589 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/16311/statm: 136561 117904 199 433 0 136125 0
[pid=16311/tid=16313] ppid=16309 vsize=546244 CPUtime=1794.27 cores=1,3,5,7
/proc/16311/task/16313/stat : 16313 (wbo1.71) R 16309 16311 12215 0 -1 4202560 129634 0 0 0 179299 128 0 0 20 0 2 0 288359761 559353856 117904 33554432000 4194304 5964318 140735935829280 139635318916920 4399973 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 1798.59
Current children cumulated vsize (KiB) 546244

[startup+1799.5 s]
/proc/loadavg: 2.00 2.00 2.00 3/179 16368
/proc/meminfo: memFree=28179372/32873844 swapFree=7116/7116
[pid=16311] ppid=16309 vsize=546244 CPUtime=1799 cores=1,3,5,7
/proc/16311/stat : 16311 (wbo1.71) S 16309 16311 12215 0 -1 4202496 130412 0 0 0 179799 101 0 0 20 0 2 0 288359760 559353856 117904 33554432000 4194304 5964318 140735935829280 140735935828800 4546589 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/16311/statm: 136561 117904 199 433 0 136125 0
[pid=16311/tid=16313] ppid=16309 vsize=546244 CPUtime=1794.67 cores=1,3,5,7
/proc/16311/task/16313/stat : 16313 (wbo1.71) R 16309 16311 12215 0 -1 4202560 129634 0 0 0 179339 128 0 0 20 0 2 0 288359761 559353856 117904 33554432000 4194304 5964318 140735935829280 139635318916920 4399995 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 1799
Current children cumulated vsize (KiB) 546244

[startup+1799.9 s]
/proc/loadavg: 2.00 2.00 2.00 3/179 16368
/proc/meminfo: memFree=28179372/32873844 swapFree=7116/7116
[pid=16311] ppid=16309 vsize=546244 CPUtime=1799.39 cores=1,3,5,7
/proc/16311/stat : 16311 (wbo1.71) S 16309 16311 12215 0 -1 4202496 130412 0 0 0 179838 101 0 0 20 0 2 0 288359760 559353856 117904 33554432000 4194304 5964318 140735935829280 140735935828800 4546589 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/16311/statm: 136561 117904 199 433 0 136125 0
[pid=16311/tid=16313] ppid=16309 vsize=546244 CPUtime=1795.07 cores=1,3,5,7
/proc/16311/task/16313/stat : 16313 (wbo1.71) R 16309 16311 12215 0 -1 4202560 129634 0 0 0 179379 128 0 0 20 0 2 0 288359761 559353856 117904 33554432000 4194304 5964318 140735935829280 139635318916920 4400532 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 1799.39
Current children cumulated vsize (KiB) 546244

[startup+1800 s]
/proc/loadavg: 2.00 2.00 2.00 3/179 16368
/proc/meminfo: memFree=28179372/32873844 swapFree=7116/7116
[pid=16311] ppid=16309 vsize=546244 CPUtime=1799.49 cores=1,3,5,7
/proc/16311/stat : 16311 (wbo1.71) S 16309 16311 12215 0 -1 4202496 130471 0 0 0 179848 101 0 0 20 0 2 0 288359760 559353856 117963 33554432000 4194304 5964318 140735935829280 140735935828800 4546589 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/16311/statm: 136561 117963 199 433 0 136125 0
[pid=16311/tid=16313] ppid=16309 vsize=546244 CPUtime=1795.17 cores=1,3,5,7
/proc/16311/task/16313/stat : 16313 (wbo1.71) R 16309 16311 12215 0 -1 4202560 129693 0 0 0 179389 128 0 0 20 0 2 0 288359761 559353856 117963 33554432000 4194304 5964318 140735935829280 139635318916920 4399824 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 1799.49
Current children cumulated vsize (KiB) 546244

Child status: 255

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 16311 and gives
#  childrusage.ru_utime.tv_sec=1793
#  childrusage.ru_utime.tv_usec=901285
#  childrusage.ru_stime.tv_sec=1
#  childrusage.ru_stime.tv_usec=294803
# CPU time returned by wait4() is 1795.2
# while last known CPU time is 1799.49
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 1800.01
CPU time (s): 1799.49
CPU user time (s): 1798.48
CPU system time (s): 1.01
CPU usage (%): 99.9711
Max. virtual memory (cumulated for all children) (KiB): 546244

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1793.9
system time used= 1.2948
maximum resident set size= 471860
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 130473
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 211
involuntary context switches= 1938

runsolver used 2.75658 second user time and 7.47186 second system time

The end

Launcher Data 

Begin job on node138 at 2012-05-28 18:25:47
IDJOB=3713105
IDBENCH=79394
IDSOLVER=2293
FILE ID=node138/3713105-1338222347
RUNJOBID= node138-1338194596-12232
PBS_JOBID= 14624599
Free space on /tmp= 71488 MiB

SOLVER NAME= wbo 1.71
BENCH NAME= PB10/normalized-PB10/PARTIAL-SMALLINT-LIN/wcsp/jnh/normalized-jnh307_wcsp.wbo
COMMAND LINE= wbo1.71 -file-format=wbo BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3713105-1338222347/watcher-3713105-1338222347 -o /tmp/evaluation-result-3713105-1338222347/solver-3713105-1338222347 -C 1800 -W 1900 -M 15500  wbo1.71 -file-format=wbo HOME/instance-3713105-1338222347.wbo

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 944c5e420229bce90a366c23629af03a
RANDOM SEED=495343886

node138.alineos.net Linux 2.6.32-71.29.1.el6.x86_64 #1 SMP Mon Jun 27 19:49:27 BST 2011

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.347
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5334.69
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.347
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.347
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.347
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.347
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.347
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.347
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.92
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.347
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32873844 kB
MemFree:        28710708 kB
Buffers:          664528 kB
Cached:          2448804 kB
SwapCached:          208 kB
Active:          1318312 kB
Inactive:        1951724 kB
Active(anon):     138644 kB
Inactive(anon):    11368 kB
Active(file):    1179668 kB
Inactive(file):  1940356 kB
Unevictable:        7116 kB
Mlocked:            7116 kB
SwapTotal:      67108856 kB
SwapFree:       67108648 kB
Dirty:              5444 kB
Writeback:             0 kB
AnonPages:        101408 kB
Mapped:            15124 kB
Shmem:               200 kB
Slab:             753628 kB
SReclaimable:     195796 kB
SUnreclaim:       557832 kB
KernelStack:        1488 kB
PageTables:         4032 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83545776 kB
Committed_AS:     144256 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      346368 kB
VmallocChunk:   34341987984 kB
HardwareCorrupted:     0 kB
AnonHugePages:     10240 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:        7872 kB
DirectMap2M:    33538048 kB

Free space on /tmp at the end= 71484 MiB
End job on node138 at 2012-05-28 18:55:47