Trace number 3695227

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
pb2satCp2 2012-05-19? (TO) 1800.07 1800.12

General information on the benchmark

Name/OPT-SMALLINT-LIN/oliveras/j120opt/
normalized-j12053_6.std.opb
MD5SUMafeceb08ae53f25fa9e4759a0d0118c7
Bench CategoryOPT-SMALLINT-LIN (optimisation, small integers, linear constraints)
Best result obtained on this benchmarkSAT
Best value of the objective obtained on this benchmark108
Best CPU time to get the best result obtained on this benchmark1800.63
Has Objective FunctionYES
Satisfiable
(Un)Satisfiability was proved
Best value of the objective function
Optimality of the best value was proved
Number of variables72842
Total number of constraints256600
Number of constraints which are clauses255400
Number of constraints which are cardinality constraints (but not clauses)0
Number of constraints which are nor clauses,nor cardinality constraints1200
Minimum length of a constraint1
Maximum length of a constraint93
Number of terms in the objective function 300
Biggest coefficient in the objective function 300
Number of bits for the biggest coefficient in the objective function 9
Sum of the numbers in the objective function 45150
Number of bits of the sum of numbers in the objective function 16
Biggest number in a constraint 300
Number of bits of the biggest number in a constraint 9
Biggest sum of numbers in a constraint 45150
Number of bits of the biggest sum of numbers16
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Quality of the solution as a function of time


Download the above graph as a PDF file / as an EPS file

Solver Data

20.56/20.67	c model valid
20.56/20.67	c current solution ok
29.66/30.04	o 300
48.80/49.03	c model valid
48.80/49.03	c current solution ok
48.83/49.21	o 299
68.26/69.50	c model valid
68.26/69.50	c current solution ok
68.28/69.69	o 298
88.71/90.69	c model valid
88.71/90.69	c current solution ok
88.81/90.88	o 297
109.40/111.48	c model valid
109.40/111.48	c current solution ok
109.49/111.66	o 296
129.13/131.55	c model valid
129.13/131.55	c current solution ok
129.20/131.75	o 295
149.82/152.74	c model valid
149.82/152.74	c current solution ok
150.03/152.92	o 294
169.49/172.49	c model valid
169.49/172.49	c current solution ok
169.69/172.67	o 293
188.08/191.20	c model valid
188.08/191.20	c current solution ok
188.19/191.38	o 292
206.78/209.94	c model valid
206.78/209.94	c current solution ok
206.97/210.13	o 291
225.26/228.41	c model valid
225.26/228.41	c current solution ok
225.28/228.60	o 290
244.36/247.59	c model valid
244.36/247.59	c current solution ok
244.44/247.78	o 289
262.54/265.76	c model valid
262.54/265.76	c current solution ok
262.62/265.94	o 288
281.74/284.92	c model valid
281.74/284.92	c current solution ok
281.76/285.12	o 287
299.94/303.15	c model valid
299.94/303.15	c current solution ok
299.99/303.35	o 286
318.13/321.35	c model valid
318.13/321.35	c current solution ok
318.19/321.55	o 285
336.33/339.59	c model valid
336.33/339.59	c current solution ok
336.44/339.79	o 284
354.63/357.84	c model valid
354.63/357.84	c current solution ok
354.67/358.02	o 283
372.81/376.04	c model valid
372.81/376.04	c current solution ok
373.01/376.25	o 282
391.11/394.34	c model valid
391.11/394.34	c current solution ok
391.16/394.52	o 281
398.11/401.31	c model valid
398.11/401.31	c current solution ok
398.21/401.49	o 280
405.61/408.80	c model valid
405.61/408.80	c current solution ok
405.62/408.98	o 279
412.90/416.12	c model valid
412.90/416.12	c current solution ok
412.93/416.31	o 278
420.20/423.44	c model valid
420.20/423.44	c current solution ok
420.24/423.63	o 277
428.20/431.42	c model valid
428.20/431.42	c current solution ok
428.22/431.60	o 276
436.20/439.40	c model valid
436.20/439.40	c current solution ok
436.21/439.58	o 275
444.08/447.37	c model valid
444.08/447.37	c current solution ok
444.17/447.55	o 274
452.09/455.34	c model valid
452.09/455.34	c current solution ok
452.12/455.51	o 273
460.07/463.30	c model valid
460.07/463.30	c current solution ok
460.08/463.48	o 272
467.97/471.27	c model valid
467.97/471.28	c current solution ok
468.05/471.45	o 271
475.97/479.25	c model valid
475.97/479.25	c current solution ok
476.02/479.43	o 270
483.98/487.21	c model valid
483.98/487.21	c current solution ok
483.99/487.39	o 269
493.17/496.42	c model valid
493.17/496.42	c current solution ok
493.20/496.62	o 268
502.37/505.60	c model valid
502.37/505.60	c current solution ok
502.37/505.78	o 267
511.48/514.76	c model valid
511.48/514.76	c current solution ok
511.54/514.96	o 266
521.17/524.44	c model valid
521.17/524.44	c current solution ok
521.37/524.62	o 265
541.86/545.10	c model valid
541.86/545.10	c current solution ok
541.86/545.31	o 264
553.06/556.37	c model valid
553.06/556.37	c current solution ok
553.27/556.57	o 263
562.25/565.51	c model valid
562.25/565.51	c current solution ok
562.27/565.69	o 262
572.34/575.62	c model valid
572.34/575.62	c current solution ok
572.37/575.80	o 261
583.83/587.18	c model valid
583.83/587.18	c current solution ok
584.03/587.36	o 260
595.32/599.25	c model valid
595.32/599.25	c current solution ok
595.51/599.43	o 259
604.42/608.36	c model valid
604.42/608.36	c current solution ok
604.47/608.53	o 258
616.09/620.07	c model valid
616.09/620.07	c current solution ok
616.18/620.25	o 257
624.00/627.91	c model valid
624.00/627.91	c current solution ok
624.19/628.11	o 256
634.99/638.90	c model valid
634.99/638.90	c current solution ok
635.09/639.09	o 255
642.49/646.41	c model valid
642.49/646.41	c current solution ok
642.50/646.59	o 254
649.89/653.88	c model valid
649.89/653.88	c current solution ok
649.97/654.06	o 253
657.79/661.72	c model valid
657.79/661.72	c current solution ok
657.82/661.93	o 252
665.18/669.19	c model valid
665.18/669.19	c current solution ok
665.28/669.39	o 251
672.67/676.67	c model valid
672.67/676.67	c current solution ok
672.74/676.85	o 250
680.19/684.17	c model valid
680.19/684.17	c current solution ok
680.26/684.35	o 249
736.77/740.71	c model valid
736.77/740.71	c current solution ok
736.79/740.89	o 248
744.26/748.20	c model valid
744.26/748.20	c current solution ok
744.26/748.38	o 247
782.35/786.40	c model valid
782.35/786.40	c current solution ok
782.45/786.60	o 246
790.25/794.22	c model valid
790.25/794.22	c current solution ok
790.44/794.40	o 245
828.33/832.39	c model valid
828.33/832.39	c current solution ok
828.43/832.57	o 244
866.53/870.59	c model valid
866.53/870.59	c current solution ok
866.63/870.77	o 243
876.42/880.41	c model valid
876.42/880.41	c current solution ok
876.44/880.59	o 242
887.52/891.50	c model valid
887.52/891.50	c current solution ok
887.53/891.68	o 241
892.63/896.60	c model valid
892.63/896.60	c current solution ok
892.64/897.24	o 240
930.76/935.29	c model valid
930.76/935.29	c current solution ok
930.86/935.47	o 239
935.86/940.38	c model valid
935.86/940.38	c current solution ok
936.06/940.99	o 238
943.55/948.43	c model valid
943.55/948.43	c current solution ok
943.59/948.61	o 237
952.74/957.61	c model valid
952.74/957.61	c current solution ok
952.77/957.80	o 236
960.25/965.11	c model valid
960.25/965.11	c current solution ok
960.26/965.29	o 235
967.64/972.58	c model valid
967.64/972.58	c current solution ok
967.72/972.76	o 234
976.84/981.76	c model valid
976.84/981.76	c current solution ok
976.90/981.94	o 233
1014.93/1019.88	c model valid
1014.93/1019.88	c current solution ok
1015.02/1020.06	o 232
1053.23/1058.13	c model valid
1053.23/1058.13	c current solution ok
1053.26/1058.31	o 231
1091.40/1096.39	c model valid
1091.40/1096.39	c current solution ok
1091.51/1096.57	o 230
1102.51/1107.47	c model valid
1102.51/1107.47	c current solution ok
1102.71/1107.65	o 229
1113.50/1118.46	c model valid
1113.50/1118.46	c current solution ok
1113.70/1118.65	o 228
1124.50/1129.44	c model valid
1124.50/1129.44	c current solution ok
1124.69/1129.62	o 227
1131.98/1136.94	c model valid
1131.98/1136.94	c current solution ok
1132.03/1137.12	o 226
1141.19/1146.11	c model valid
1141.19/1146.11	c current solution ok
1141.20/1146.29	o 225
1150.29/1155.27	c model valid
1150.29/1155.27	c current solution ok
1150.37/1155.45	o 224
1159.49/1164.44	c model valid
1159.49/1164.44	c current solution ok
1159.53/1164.62	o 223
1168.68/1173.60	c model valid
1168.68/1173.60	c current solution ok
1168.70/1173.78	o 222
1177.77/1182.79	c model valid
1177.77/1182.79	c current solution ok
1177.88/1182.97	o 221
1186.97/1191.94	c model valid
1186.97/1191.94	c current solution ok
1187.01/1192.11	o 220
1196.57/1201.55	c model valid
1196.57/1201.55	c current solution ok
1196.63/1201.75	o 219
1205.77/1210.71	c model valid
1205.77/1210.71	c current solution ok
1205.79/1210.92	o 218
1244.76/1249.77	c model valid
1244.76/1249.77	c current solution ok
1244.84/1249.98	o 217
1283.63/1288.60	c model valid
1283.63/1288.60	c current solution ok
1283.64/1288.78	o 216
1324.84/1330.02	c model valid
1324.84/1330.02	c current solution ok
1324.86/1330.22	o 215
1364.01/1369.26	c model valid
1364.01/1369.26	c current solution ok
1364.22/1369.46	o 214
1403.20/1408.45	c model valid
1403.20/1408.45	c current solution ok
1403.26/1408.64	o 213
1417.06/1422.66	c model valid
1417.06/1422.66	c current solution ok
1417.13/1422.87	o 212
1430.85/1436.44	c model valid
1430.85/1436.44	c current solution ok
1431.05/1436.65	o 211
1437.65/1443.21	c model valid
1437.65/1443.21	c current solution ok
1437.66/1443.41	o 210
1444.63/1450.24	c model valid
1444.63/1450.24	c current solution ok
1444.68/1450.44	o 209
1451.34/1456.97	c model valid
1451.34/1456.97	c current solution ok
1451.41/1457.17	o 208
1464.93/1470.50	c model valid
1464.93/1470.50	c current solution ok
1465.13/1470.72	o 207
1471.64/1477.29	c model valid
1471.64/1477.29	c current solution ok
1471.72/1477.49	o 206
1481.92/1487.54	c model valid
1481.92/1487.54	c current solution ok
1481.97/1487.73	o 205
1488.91/1494.79	c model valid
1488.91/1494.79	c current solution ok
1489.12/1494.97	o 204
1503.10/1508.96	c model valid
1503.10/1508.96	c current solution ok
1503.30/1509.15	o 203
1510.10/1515.97	c model valid
1510.10/1515.97	c current solution ok
1510.17/1516.15	o 202
1523.69/1529.55	c model valid
1523.69/1529.55	c current solution ok
1523.75/1529.74	o 201
1530.39/1536.27	c model valid
1530.39/1536.27	c current solution ok
1530.47/1536.46	o 200
1544.67/1550.53	c model valid
1544.67/1550.53	c current solution ok
1544.72/1550.71	o 199
1558.98/1564.82	c model valid
1558.98/1564.82	c current solution ok
1559.01/1565.00	o 198
1565.68/1571.52	c model valid
1565.68/1571.52	c current solution ok
1565.70/1571.73	o 197
1579.19/1585.09	c model valid
1579.19/1585.09	c current solution ok
1579.28/1585.29	o 196
1592.76/1598.67	c model valid
1592.76/1598.67	c current solution ok
1592.83/1598.85	o 195
1599.56/1605.43	c model valid
1599.56/1605.43	c current solution ok
1599.60/1605.61	o 194
1613.55/1619.44	c model valid
1613.55/1619.44	c current solution ok
1613.60/1619.62	o 193
1627.05/1632.99	c model valid
1627.05/1632.99	c current solution ok
1627.15/1633.17	o 192
1633.85/1639.73	c model valid
1633.85/1639.73	c current solution ok
1633.90/1639.91	o 191
1651.46/1657.38	c model valid
1651.46/1657.38	c current solution ok
1651.54/1657.55	o 190
1669.94/1675.85	c model valid
1669.94/1675.85	c current solution ok
1670.00/1676.04	o 189
1684.24/1690.13	c model valid
1684.24/1690.13	c current solution ok
1684.27/1690.31	o 188
1698.44/1704.36	c model valid
1698.44/1704.36	c current solution ok
1698.51/1704.54	o 187
1712.73/1718.61	c model valid
1712.73/1718.61	c current solution ok
1712.75/1718.82	o 186
1719.98/1725.90	c model valid
1719.98/1725.90	c current solution ok
1719.98/1726.08	o 185
1738.07/1744.05	c model valid
1738.07/1744.05	c current solution ok
1738.13/1744.23	o 184
1756.26/1762.25	c model valid
1756.26/1762.25	c current solution ok
1756.30/1762.43	o 183
1774.45/1780.47	c model valid
1774.45/1780.47	c current solution ok
1774.53/1780.65	o 182
1793.85/1799.88	c model valid
1793.85/1799.88	c current solution ok
1793.94/1800.06	o 181
1794.13/1800.10	./satsolver.sh: line 5: 10065 Terminated              ./glucose_static -rnd-seed=$seed $1 > $2
1794.13/1800.10	c error: unexpected solver exit code
1794.13/1800.10	s UNKNOWN

Verifier Data

ERROR: no interpretation found !

Watcher Data

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.1 (svn: 989)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3695227-1338109234/watcher-3695227-1338109234 -o /tmp/evaluation-result-3695227-1338109234/solver-3695227-1338109234 -C 1800 -W 1900 -M 15500 HOME/runPb2satCp2.sh HOME/instance-3695227-1338109234.opb 1598238698 HOME HOME 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1900 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 2.26 2.05 2.02 3/178 9123
/proc/meminfo: memFree=30043672/32873648 swapFree=7368/7368
[pid=9123] ppid=9121 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/9123/stat : 9123 (runPb2satCp2.sh) S 9121 9123 3829 0 -1 4202496 357 0 0 0 0 0 0 0 20 0 1 0 277047553 9367552 275 33554432000 4194304 5064252 140735604791360 140735604790272 251052844622 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/9123/statm: 2287 275 233 213 0 72 0

[startup+0.029999 s]
/proc/loadavg: 2.26 2.05 2.02 3/178 9123
/proc/meminfo: memFree=30043672/32873648 swapFree=7368/7368
[pid=9123] ppid=9121 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/9123/stat : 9123 (runPb2satCp2.sh) S 9121 9123 3829 0 -1 4202496 357 0 0 0 0 0 0 0 20 0 1 0 277047553 9367552 275 33554432000 4194304 5064252 140735604791360 140735604790272 251052844622 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/9123/statm: 2287 275 233 213 0 72 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 9148

[startup+0.100263 s]
/proc/loadavg: 2.26 2.05 2.02 3/178 9123
/proc/meminfo: memFree=30043672/32873648 swapFree=7368/7368
[pid=9123] ppid=9121 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/9123/stat : 9123 (runPb2satCp2.sh) S 9121 9123 3829 0 -1 4202496 357 0 0 0 0 0 0 0 20 0 1 0 277047553 9367552 275 33554432000 4194304 5064252 140735604791360 140735604790272 251052844622 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/9123/statm: 2287 275 233 213 0 72 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 9148

[startup+0.300229 s]
/proc/loadavg: 2.26 2.05 2.02 3/178 9123
/proc/meminfo: memFree=30043672/32873648 swapFree=7368/7368
[pid=9123] ppid=9121 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/9123/stat : 9123 (runPb2satCp2.sh) S 9121 9123 3829 0 -1 4202496 357 0 0 0 0 0 0 0 20 0 1 0 277047553 9367552 275 33554432000 4194304 5064252 140735604791360 140735604790272 251052844622 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/9123/statm: 2287 275 233 213 0 72 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 9148

[startup+0.700242 s]
/proc/loadavg: 2.26 2.05 2.02 3/178 9123
/proc/meminfo: memFree=30043672/32873648 swapFree=7368/7368
[pid=9123] ppid=9121 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/9123/stat : 9123 (runPb2satCp2.sh) S 9121 9123 3829 0 -1 4202496 357 0 0 0 0 0 0 0 20 0 1 0 277047553 9367552 275 33554432000 4194304 5064252 140735604791360 140735604790272 251052844622 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/9123/statm: 2287 275 233 213 0 72 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 9148

[startup+1.5003 s]
/proc/loadavg: 2.26 2.05 2.02 3/181 9129
/proc/meminfo: memFree=30031136/32873648 swapFree=7368/7368
[pid=9123] ppid=9121 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/9123/stat : 9123 (runPb2satCp2.sh) S 9121 9123 3829 0 -1 4202496 357 0 0 0 0 0 0 0 20 0 1 0 277047553 9367552 275 33554432000 4194304 5064252 140735604791360 140735604790272 251052844622 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/9123/statm: 2287 275 233 213 0 72 0
[pid=9124] ppid=9123 vsize=115828 CPUtime=1.49 cores=0,2,4,6
/proc/9124/stat : 9124 (pb2sat) R 9123 9123 3829 0 -1 4202496 15647 0 0 0 146 3 0 0 20 0 1 0 277047553 118607872 24802 33554432000 4194304 5873084 140736212947056 140736212940360 4920028 0 0 4096 0 0 0 0 17 4 0 0 0 0 0
/proc/9124/statm: 28957 24802 157 410 0 28539 0
Current children cumulated CPU time (s) 1.49
Current children cumulated vsize (KiB) 124976

[startup+3.1002 s]
/proc/loadavg: 2.26 2.05 2.02 3/182 9134
/proc/meminfo: memFree=29866584/32873648 swapFree=7368/7368
[pid=9123] ppid=9121 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/9123/stat : 9123 (runPb2satCp2.sh) S 9121 9123 3829 0 -1 4202496 357 0 0 0 0 0 0 0 20 0 1 0 277047553 9367552 275 33554432000 4194304 5064252 140735604791360 140735604790272 251052844622 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/9123/statm: 2287 275 233 213 0 72 0
[pid=9124] ppid=9123 vsize=235464 CPUtime=2.76 cores=0,2,4,6
/proc/9124/stat : 9124 (pb2sat) S 9123 9123 3829 0 -1 4202496 30210 0 0 0 252 24 0 0 20 0 1 0 277047553 241115136 53180 33554432000 4194304 5873084 140736212947056 140736212943480 5124602 0 65536 4102 0 18446744071579302229 0 0 17 4 0 0 0 0 0
/proc/9124/statm: 58866 53180 164 410 0 58448 0
Current children cumulated CPU time (s) 2.76
Current children cumulated vsize (KiB) 244612

[startup+6.3004 s]
/proc/loadavg: 2.32 2.07 2.02 3/182 9145
/proc/meminfo: memFree=29045800/32873648 swapFree=7368/7368
[pid=9123] ppid=9121 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/9123/stat : 9123 (runPb2satCp2.sh) S 9121 9123 3829 0 -1 4202496 357 0 0 0 0 0 0 0 20 0 1 0 277047553 9367552 275 33554432000 4194304 5064252 140735604791360 140735604790272 251052844622 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/9123/statm: 2287 275 233 213 0 72 0
[pid=9124] ppid=9123 vsize=235464 CPUtime=2.76 cores=0,2,4,6
/proc/9124/stat : 9124 (pb2sat) S 9123 9123 3829 0 -1 4202496 30210 0 0 0 252 24 0 0 20 0 1 0 277047553 241115136 53180 33554432000 4194304 5873084 140736212947056 140736212943480 5124602 0 65536 4102 0 18446744071579302229 0 0 17 4 0 0 0 0 0
/proc/9124/statm: 58866 53180 164 410 0 58448 0
[pid=9136] ppid=9124 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/9136/stat : 9136 (satsolver.sh) S 9124 9123 3829 0 -1 4202496 596 0 0 0 0 0 0 0 20 0 1 0 277047830 9367552 267 33554432000 4194304 5064252 140734069767376 140734069766288 251052844622 0 65536 4100 65538 18446744071579302229 0 0 17 2 0 0 0 0 0
/proc/9136/statm: 2287 267 226 213 0 72 0
[pid=9137] ppid=9136 vsize=757140 CPUtime=3.52 cores=0,2,4,6
/proc/9137/stat : 9137 (glucose_static) R 9136 9123 3829 0 -1 4202496 98193 0 0 0 329 23 0 0 20 0 1 0 277047830 775311360 154635 33554432000 4194304 4896791 140733744763952 140733744761256 4224706 0 0 4096 0 0 0 0 17 2 0 0 0 0 0
/proc/9137/statm: 189285 154635 76 172 0 189111 0
Current children cumulated CPU time (s) 6.28
Current children cumulated vsize (KiB) 1010900

[startup+12.7004 s]
/proc/loadavg: 2.29 2.07 2.02 3/184 9166
/proc/meminfo: memFree=29029304/32873648 swapFree=7368/7368
[pid=9123] ppid=9121 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/9123/stat : 9123 (runPb2satCp2.sh) S 9121 9123 3829 0 -1 4202496 357 0 0 0 0 0 0 0 20 0 1 0 277047553 9367552 275 33554432000 4194304 5064252 140735604791360 140735604790272 251052844622 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/9123/statm: 2287 275 233 213 0 72 0
[pid=9124] ppid=9123 vsize=235464 CPUtime=2.76 cores=0,2,4,6
/proc/9124/stat : 9124 (pb2sat) S 9123 9123 3829 0 -1 4202496 30210 0 0 0 252 24 0 0 20 0 1 0 277047553 241115136 53180 33554432000 4194304 5873084 140736212947056 140736212943480 5124602 0 65536 4102 0 18446744071579302229 0 0 17 4 0 0 0 0 0
/proc/9124/statm: 58866 53180 164 410 0 58448 0
[pid=9136] ppid=9124 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/9136/stat : 9136 (satsolver.sh) S 9124 9123 3829 0 -1 4202496 596 0 0 0 0 0 0 0 20 0 1 0 277047830 9367552 267 33554432000 4194304 5064252 140734069767376 140734069766288 251052844622 0 65536 4100 65538 18446744071579302229 0 0 17 2 0 0 0 0 0
/proc/9136/statm: 2287 267 226 213 0 72 0
[pid=9137] ppid=9136 vsize=757536 CPUtime=9.92 cores=0,2,4,6
/proc/9137/stat : 9137 (glucose_static) R 9136 9123 3829 0 -1 4202496 98287 0 0 0 968 24 0 0 20 0 1 0 277047830 775716864 154729 33554432000 4194304 4896791 140733744763952 140733744761272 4224921 0 0 4096 0 0 0 0 17 2 0 0 0 0 0
/proc/9137/statm: 189384 154729 76 172 0 189210 0
Current children cumulated CPU time (s) 12.68
Current children cumulated vsize (KiB) 1011296

[startup+25.5003 s]
/proc/loadavg: 2.22 2.06 2.02 2/181 9206
/proc/meminfo: memFree=29612280/32873648 swapFree=7368/7368
[pid=9123] ppid=9121 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/9123/stat : 9123 (runPb2satCp2.sh) S 9121 9123 3829 0 -1 4202496 357 0 0 0 0 0 0 0 20 0 1 0 277047553 9367552 275 33554432000 4194304 5064252 140735604791360 140735604790272 251052844622 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/9123/statm: 2287 275 233 213 0 72 0
[pid=9124] ppid=9123 vsize=295472 CPUtime=25.32 cores=0,2,4,6
/proc/9124/stat : 9124 (pb2sat) R 9123 9123 3829 0 -1 4202496 37046 101617 0 0 380 417 1704 31 20 0 1 0 277047553 302563328 68190 33554432000 4194304 5873084 140736212947056 140736212942488 5127520 0 0 4096 0 0 0 0 17 4 0 0 14 0 0
/proc/9124/statm: 73868 68190 172 410 0 73450 0
Current children cumulated CPU time (s) 25.32
Current children cumulated vsize (KiB) 304620

[startup+51.1004 s]
/proc/loadavg: 2.08 2.04 2.01 2/183 9301
/proc/meminfo: memFree=29540640/32873648 swapFree=7368/7368
[pid=9123] ppid=9121 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/9123/stat : 9123 (runPb2satCp2.sh) S 9121 9123 3829 0 -1 4202496 357 0 0 0 0 0 0 0 20 0 1 0 277047553 9367552 275 33554432000 4194304 5064252 140735604791360 140735604790272 251052844622 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/9123/statm: 2287 275 233 213 0 72 0
[pid=9124] ppid=9123 vsize=263748 CPUtime=49.06 cores=0,2,4,6
/proc/9124/stat : 9124 (pb2sat) S 9123 9123 3829 0 -1 4202496 44895 206754 0 0 513 781 3510 102 20 0 1 0 277047553 270077952 60062 33554432000 4194304 5873084 140736212947056 140736212940872 5124602 0 65536 4102 0 18446744071579302229 0 0 17 4 0 0 16 0 0
/proc/9124/statm: 65937 60062 173 410 0 65519 0
[pid=9299] ppid=9124 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/9299/stat : 9299 (satsolver.sh) S 9124 9123 3829 0 -1 4202496 597 0 0 0 0 0 0 0 20 0 1 0 277052479 9367552 267 33554432000 4194304 5064252 140735578662176 140735578661088 251052844622 0 65536 4100 65538 18446744071579302229 0 0 17 2 0 0 0 0 0
/proc/9299/statm: 2287 267 226 213 0 72 0
[pid=9300] ppid=9299 vsize=346692 CPUtime=0.79 cores=0,2,4,6
/proc/9300/stat : 9300 (glucose_static) R 9299 9123 3829 0 -1 4202496 58283 0 0 0 69 10 0 0 20 0 1 0 277052480 355012608 80354 33554432000 4194304 4896791 140736933177424 140736932126312 4401607 0 0 4096 0 0 0 0 17 4 0 0 102 0 0
/proc/9300/statm: 86673 80355 58 172 0 86499 0
Current children cumulated CPU time (s) 49.85
Current children cumulated vsize (KiB) 628736

[startup+102.307 s]
/proc/loadavg: 1.95 2.01 2.00 3/183 9459
/proc/meminfo: memFree=28904916/32873648 swapFree=7368/7368
[pid=9123] ppid=9121 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/9123/stat : 9123 (runPb2satCp2.sh) S 9121 9123 3829 0 -1 4202496 357 0 0 0 0 0 0 0 20 0 1 0 277047553 9367552 275 33554432000 4194304 5064252 140735604791360 140735604790272 251052844622 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/9123/statm: 2287 275 233 213 0 72 0
[pid=9124] ppid=9123 vsize=263744 CPUtime=89.04 cores=0,2,4,6
/proc/9124/stat : 9124 (pb2sat) S 9123 9123 3829 0 -1 4202496 59296 422693 0 0 623 789 7288 204 20 0 1 0 277047553 270073856 60049 33554432000 4194304 5873084 140736212947056 140736212940872 5124602 0 65536 4102 0 18446744071579302229 0 0 17 4 0 0 80 0 0
/proc/9124/statm: 65936 60049 173 410 0 65518 0
[pid=9422] ppid=9124 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/9422/stat : 9422 (satsolver.sh) S 9124 9123 3829 0 -1 4202496 597 0 0 0 0 0 0 0 20 0 1 0 277056646 9367552 267 33554432000 4194304 5064252 140734144239904 140734144238816 251052844622 0 65536 4100 65538 18446744071579302229 0 0 17 2 0 0 0 0 0
/proc/9422/statm: 2287 267 226 213 0 72 0
[pid=9423] ppid=9422 vsize=764248 CPUtime=11.26 cores=0,2,4,6
/proc/9423/stat : 9423 (glucose_static) R 9422 9123 3829 0 -1 4202496 101127 0 0 0 1099 27 0 0 20 0 1 0 277056646 782589952 159652 33554432000 4194304 4896791 140735408470336 140735408467544 4224706 0 0 4096 0 0 0 0 17 0 0 0 10 0 0
/proc/9423/statm: 191062 159652 76 172 0 190888 0
Current children cumulated CPU time (s) 100.3
Current children cumulated vsize (KiB) 1046288

[startup+162.3 s]
/proc/loadavg: 2.27 2.09 2.02 3/181 9708
/proc/meminfo: memFree=29102900/32873648 swapFree=7368/7368
[pid=9123] ppid=9121 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/9123/stat : 9123 (runPb2satCp2.sh) S 9121 9123 3829 0 -1 4202496 357 0 0 0 0 0 0 0 20 0 1 0 277047553 9367552 275 33554432000 4194304 5064252 140735604791360 140735604790272 251052844622 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/9123/statm: 2287 275 233 213 0 72 0
[pid=9124] ppid=9123 vsize=263736 CPUtime=150.11 cores=0,2,4,6
/proc/9124/stat : 9124 (pb2sat) S 9123 9123 3829 0 -1 4202496 80844 744392 0 0 787 802 13051 371 20 0 1 0 277047553 270065664 60031 33554432000 4194304 5873084 140736212947056 140736212940872 5124602 0 65536 4102 0 18446744071579302229 0 0 17 4 0 0 130 0 0
/proc/9124/statm: 65934 60031 173 410 0 65516 0
[pid=9650] ppid=9124 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/9650/stat : 9650 (satsolver.sh) S 9124 9123 3829 0 -1 4202496 596 0 0 0 0 0 0 0 20 0 1 0 277062851 9367552 266 33554432000 4194304 5064252 140734692219616 140734692218528 251052844622 0 65536 4100 65538 18446744071579302229 0 0 17 2 0 0 0 0 0
/proc/9650/statm: 2287 266 226 213 0 72 0
[pid=9652] ppid=9650 vsize=764056 CPUtime=9.27 cores=0,2,4,6
/proc/9652/stat : 9652 (glucose_static) R 9650 9123 3829 0 -1 4202496 102547 0 0 0 902 25 0 0 20 0 1 0 277062851 782393344 158659 33554432000 4194304 4896791 140734719282816 140734719280120 4224732 0 0 4096 0 0 0 0 17 2 0 0 2 0 0
/proc/9652/statm: 191014 158659 76 172 0 190840 0
Current children cumulated CPU time (s) 159.38
Current children cumulated vsize (KiB) 1046088

[startup+222.3 s]
/proc/loadavg: 2.23 2.11 2.03 3/183 9719
/proc/meminfo: memFree=27685528/32873648 swapFree=7368/7368
[pid=9123] ppid=9121 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/9123/stat : 9123 (runPb2satCp2.sh) S 9121 9123 3829 0 -1 4202496 357 0 0 0 0 0 0 0 20 0 1 0 277047553 9367552 275 33554432000 4194304 5064252 140735604791360 140735604790272 251052844622 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/9123/statm: 2287 275 233 213 0 72 0
[pid=9124] ppid=9123 vsize=263728 CPUtime=207.05 cores=0,2,4,6
/proc/9124/stat : 9124 (pb2sat) S 9123 9123 3829 0 -1 4202496 102330 1062584 0 0 951 814 18412 528 20 0 1 0 277047553 270057472 60013 33554432000 4194304 5873084 140736212947056 140736212940872 5124602 0 65536 4102 0 18446744071579302229 0 0 17 6 0 0 150 0 0
/proc/9124/statm: 65932 60013 173 410 0 65514 0
[pid=9718] ppid=9124 vsize=9148 CPUtime=0 cores=0,2,4,6

################
# More data... #
################

[pid=10003] ppid=10002 vsize=764076 CPUtime=5.8 cores=0,2,4,6
/proc/10003/stat : 10003 (glucose_static) R 10002 9123 3829 0 -1 4202496 104272 0 0 0 555 25 0 0 20 0 1 0 277201202 782413824 157073 33554432000 4194304 4896791 140734033922592 140734033919896 4224706 0 0 4096 0 0 0 0 17 0 0 0 0 0 0
/proc/10003/statm: 191019 157073 77 172 0 190845 0
Current children cumulated CPU time (s) 1536.47
Current children cumulated vsize (KiB) 1041876

[startup+1602.3 s]
/proc/loadavg: 2.04 2.10 2.08 3/184 10020
/proc/meminfo: memFree=27644052/32873648 swapFree=7368/7368
[pid=9123] ppid=9121 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/9123/stat : 9123 (runPb2satCp2.sh) S 9121 9123 3829 0 -1 4202496 357 0 0 0 0 0 0 0 20 0 1 0 277047553 9367552 275 33554432000 4194304 5064252 140735604791360 140735604790272 251052844622 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/9123/statm: 2287 275 233 213 0 72 0
[pid=9124] ppid=9123 vsize=259504 CPUtime=1593.05 cores=0,2,4,6
/proc/9124/stat : 9124 (pb2sat) S 9123 9123 3829 0 -1 4202496 765384 11212803 0 0 6223 1206 146387 5489 20 0 1 0 277047553 265732096 59032 33554432000 4194304 5873084 140736212947056 140736212940872 5124602 0 65536 4102 0 18446744071579302229 0 0 17 0 0 0 224 0 0
/proc/9124/statm: 64876 59032 173 410 0 64458 0
[pid=10019] ppid=9124 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/10019/stat : 10019 (satsolver.sh) S 9124 9123 3829 0 -1 4202496 596 0 0 0 0 0 0 0 20 0 1 0 277207441 9367552 266 33554432000 4194304 5064252 140736388304112 140736388303024 251052844622 0 65536 4100 65538 18446744071579302229 0 0 17 6 0 0 0 0 0
/proc/10019/statm: 2287 266 226 213 0 72 0
[pid=10020] ppid=10019 vsize=763720 CPUtime=3.41 cores=0,2,4,6
/proc/10020/stat : 10020 (glucose_static) R 10019 9123 3829 0 -1 4202496 100058 0 0 0 317 24 0 0 20 0 1 0 277207442 782049280 156939 33554432000 4194304 4896791 140733822077040 140733822074344 4223862 0 0 4096 0 0 0 0 17 2 0 0 0 0 0
/proc/10020/statm: 190930 156939 76 172 0 190756 0
Current children cumulated CPU time (s) 1596.46
Current children cumulated vsize (KiB) 1041520

############
# WARNING:
# current cumulated CPU time (1627.35 s) is less than in the last sample (1633.24 s)
# The time of a child was probably not reported to its father.
# (see the two samples below)
# Adding the difference (5.89001 s) to the 'lost time'.

[startup+1639.1 s]
/proc/loadavg: 2.14 2.12 2.09 3/183 10029
/proc/meminfo: memFree=27620024/32873648 swapFree=7368/7368
[pid=9123] ppid=9121 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/9123/stat : 9123 (runPb2satCp2.sh) S 9121 9123 3829 0 -1 4202496 357 0 0 0 0 0 0 0 20 0 1 0 277047553 9367552 275 33554432000 4194304 5064252 140735604791360 140735604790272 251052844622 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/9123/statm: 2287 275 233 213 0 72 0
[pid=9124] ppid=9123 vsize=259504 CPUtime=1627.35 cores=0,2,4,6
/proc/9124/stat : 9124 (pb2sat) S 9123 9123 3829 0 -1 4202496 784465 11530797 0 0 6388 1218 149486 5643 20 0 1 0 277047553 265732096 59022 33554432000 4194304 5873084 140736212947056 140736212940872 5124602 0 65536 4102 0 18446744071579302229 0 0 17 0 0 0 224 0 0
/proc/9124/statm: 64876 59022 173 410 0 64458 0
[pid=10028] ppid=9124 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/10028/stat : 10028 (satsolver.sh) S 9124 9123 3829 0 -1 4202496 597 0 0 0 0 0 0 0 20 0 1 0 277210873 9367552 267 33554432000 4194304 5064252 140733960186336 140733960185248 251052844622 0 65536 4100 65538 18446744071579302229 0 0 17 6 0 0 0 0 0
/proc/10028/statm: 2287 267 226 213 0 72 0
[pid=10029] ppid=10028 vsize=767876 CPUtime=5.89 cores=0,2,4,6
/proc/10029/stat : 10029 (glucose_static) R 10028 9123 3829 0 -1 4202496 107791 0 0 0 561 28 0 0 20 0 1 0 277210873 786305024 159931 33554432000 4194304 4896791 140736478648000 140736478643896 4496319 0 0 4096 0 0 0 0 17 2 0 0 0 0 0
/proc/10029/statm: 191969 159931 79 172 0 191795 0
Current children cumulated CPU time (s) 1633.24
Current children cumulated vsize (KiB) 1045676

[startup+1639.2 s]
/proc/loadavg: 2.14 2.12 2.09 3/183 10029
/proc/meminfo: memFree=27620024/32873648 swapFree=7368/7368
[pid=9123] ppid=9121 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/9123/stat : 9123 (runPb2satCp2.sh) S 9121 9123 3829 0 -1 4202496 357 0 0 0 0 0 0 0 20 0 1 0 277047553 9367552 275 33554432000 4194304 5064252 140735604791360 140735604790272 251052844622 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/9123/statm: 2287 275 233 213 0 72 0
[pid=9124] ppid=9123 vsize=259504 CPUtime=1627.35 cores=0,2,4,6
/proc/9124/stat : 9124 (pb2sat) S 9123 9123 3829 0 -1 4202496 784465 11530797 0 0 6388 1218 149486 5643 20 0 1 0 277047553 265732096 59022 33554432000 4194304 5873084 140736212947056 140736212940872 5124602 0 65536 4102 0 18446744071579302229 0 0 17 0 0 0 224 0 0
/proc/9124/statm: 64876 59022 173 410 0 64458 0
Current children cumulated CPU time (s) 1627.35
Current children cumulated vsize (KiB) 268652
#
############


[startup+1662.3 s]
/proc/loadavg: 2.10 2.11 2.09 3/183 10035
/proc/meminfo: memFree=27638048/32873648 swapFree=7368/7368
[pid=9123] ppid=9121 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/9123/stat : 9123 (runPb2satCp2.sh) S 9121 9123 3829 0 -1 4202496 357 0 0 0 0 0 0 0 20 0 1 0 277047553 9367552 275 33554432000 4194304 5064252 140735604791360 140735604790272 251052844622 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/9123/statm: 2287 275 233 213 0 72 0
[pid=9124] ppid=9123 vsize=259440 CPUtime=1651.73 cores=0,2,4,6
/proc/9124/stat : 9124 (pb2sat) S 9123 9123 3829 0 -1 4202496 797168 11745867 0 0 6492 1226 151707 5748 20 0 1 0 277047553 265666560 58999 33554432000 4194304 5873084 140736212947056 140736212940872 5124602 0 65536 4102 0 18446744071579302229 0 0 17 4 0 0 224 0 0
/proc/9124/statm: 64860 58999 173 410 0 64442 0
[pid=10034] ppid=9124 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/10034/stat : 10034 (satsolver.sh) S 9124 9123 3829 0 -1 4202496 598 0 0 0 0 0 0 0 20 0 1 0 277213311 9367552 267 33554432000 4194304 5064252 140736161912112 140736161911024 251052844622 0 65536 4100 65538 18446744071579302229 0 0 17 2 0 0 0 0 0
/proc/10034/statm: 2287 267 226 213 0 72 0
[pid=10035] ppid=10034 vsize=763440 CPUtime=4.71 cores=0,2,4,6
/proc/10035/stat : 10035 (glucose_static) R 10034 9123 3829 0 -1 4202496 100344 0 0 0 446 25 0 0 20 0 1 0 277213312 781762560 157304 33554432000 4194304 4896791 140735446865040 140735446862344 4224983 0 0 4096 0 0 0 0 17 0 0 0 0 0 0
/proc/10035/statm: 190860 157304 76 172 0 190686 0
Current children cumulated CPU time (s) 1656.44
Current children cumulated vsize (KiB) 1041176

[startup+1722.3 s]
/proc/loadavg: 2.07 2.10 2.09 3/183 10047
/proc/meminfo: memFree=27635296/32873648 swapFree=7368/7368
[pid=9123] ppid=9121 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/9123/stat : 9123 (runPb2satCp2.sh) S 9121 9123 3829 0 -1 4202496 357 0 0 0 0 0 0 0 20 0 1 0 277047553 9367552 275 33554432000 4194304 5064252 140735604791360 140735604790272 251052844622 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/9123/statm: 2287 275 233 213 0 72 0
[pid=9124] ppid=9123 vsize=259440 CPUtime=1712.97 cores=0,2,4,6
/proc/9124/stat : 9124 (pb2sat) S 9123 9123 3829 0 -1 4202496 822499 12176778 0 0 6700 1240 157401 5956 20 0 1 0 277047553 265666560 58985 33554432000 4194304 5873084 140736212947056 140736212940872 5124602 0 65536 4102 0 18446744071579302229 0 0 17 2 0 0 224 0 0
/proc/9124/statm: 64860 58985 173 410 0 64442 0
[pid=10046] ppid=9124 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/10046/stat : 10046 (satsolver.sh) S 9124 9123 3829 0 -1 4202496 597 0 0 0 0 0 0 0 20 0 1 0 277219437 9367552 267 33554432000 4194304 5064252 140737185130976 140737185129888 251052844622 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/10046/statm: 2287 267 226 213 0 72 0
[pid=10047] ppid=10046 vsize=763324 CPUtime=3.44 cores=0,2,4,6
/proc/10047/stat : 10047 (glucose_static) R 10046 9123 3829 0 -1 4202496 101868 0 0 0 319 25 0 0 20 0 1 0 277219438 781643776 157502 33554432000 4194304 4896791 140735488346560 140735488343864 4224706 0 0 4096 0 0 0 0 17 4 0 0 0 0 0
/proc/10047/statm: 190831 157502 76 172 0 190657 0
Current children cumulated CPU time (s) 1716.41
Current children cumulated vsize (KiB) 1041060

[startup+1782.3 s]
/proc/loadavg: 2.14 2.12 2.09 3/184 10062
/proc/meminfo: memFree=27815376/32873648 swapFree=7368/7368
[pid=9123] ppid=9121 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/9123/stat : 9123 (runPb2satCp2.sh) S 9121 9123 3829 0 -1 4202496 357 0 0 0 0 0 0 0 20 0 1 0 277047553 9367552 275 33554432000 4194304 5064252 140735604791360 140735604790272 251052844622 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/9123/statm: 2287 275 233 213 0 72 0
[pid=9124] ppid=9123 vsize=259440 CPUtime=1774.73 cores=0,2,4,6
/proc/9124/stat : 9124 (pb2sat) S 9123 9123 3829 0 -1 4202496 847775 12591876 0 0 6917 1256 163142 6158 20 0 1 0 277047553 265666560 58971 33554432000 4194304 5873084 140736212947056 140736212940872 5124602 0 65536 4102 0 18446744071579302229 0 0 17 0 0 0 224 0 0
/proc/9124/statm: 64860 58971 173 410 0 64442 0
[pid=10061] ppid=9124 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/10061/stat : 10061 (satsolver.sh) S 9124 9123 3829 0 -1 4202496 597 0 0 0 0 0 0 0 20 0 1 0 277225621 9367552 267 33554432000 4194304 5064252 140735256676736 140735256675648 251052844622 0 65536 4100 65538 18446744071579302229 0 0 17 6 0 0 0 0 0
/proc/10061/statm: 2287 267 226 213 0 72 0
[pid=10062] ppid=10061 vsize=771700 CPUtime=1.61 cores=0,2,4,6
/proc/10062/stat : 10062 (glucose_static) R 10061 9123 3829 0 -1 4202496 97933 0 0 0 136 25 0 0 20 0 1 0 277225621 790220800 157947 33554432000 4194304 4896791 140733642213216 140733641162104 4221070 0 0 4096 0 0 0 0 17 2 0 0 0 0 0
/proc/10062/statm: 192925 157947 73 172 0 192751 0
Current children cumulated CPU time (s) 1776.34
Current children cumulated vsize (KiB) 1049436



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1800.1 s]
/proc/loadavg: 2.10 2.11 2.09 3/183 10065
/proc/meminfo: memFree=28295728/32873648 swapFree=7368/7368
[pid=9123] ppid=9121 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/9123/stat : 9123 (runPb2satCp2.sh) S 9121 9123 3829 0 -1 4202496 357 0 0 0 0 0 0 0 20 0 1 0 277047553 9367552 275 33554432000 4194304 5064252 140735604791360 140735604790272 251052844622 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/9123/statm: 2287 275 233 213 0 72 0
[pid=9124] ppid=9123 vsize=259440 CPUtime=1794.13 cores=0,2,4,6
/proc/9124/stat : 9124 (pb2sat) S 9123 9123 3829 0 -1 4202496 854081 12697462 0 0 6968 1260 164973 6212 20 0 1 0 277047553 265666560 58968 33554432000 4194304 5873084 140736212947056 140736212940872 5124602 0 65536 4102 0 18446744071579302229 0 0 17 4 0 0 224 0 0
/proc/9124/statm: 64860 58968 173 410 0 64442 0
[pid=10064] ppid=9124 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/10064/stat : 10064 (satsolver.sh) S 9124 9123 3829 0 -1 4202496 595 0 0 0 0 0 0 0 20 0 1 0 277227562 9367552 266 33554432000 4194304 5064252 140734412762272 140734412761184 251052844622 0 65536 4100 65538 18446744071579302229 0 0 17 2 0 0 0 0 0
/proc/10064/statm: 2287 266 226 213 0 72 0
[pid=10065] ppid=10064 vsize=10468 CPUtime=0 cores=0,2,4,6
/proc/10065/stat : 10065 (glucose_static) R 10064 9123 3829 0 -1 4202496 1527 0 0 0 0 0 0 0 20 0 1 0 277227562 10719232 1368 33554432000 4194304 4896791 140736971363136 140736970312184 4401607 0 0 4096 0 0 0 0 17 4 0 0 0 0 0
/proc/10065/statm: 2617 1369 58 172 0 2443 0
Current children cumulated CPU time (s) 1794.13
Current children cumulated vsize (KiB) 288204

Sending SIGTERM to process tree (bottom up)

Solver just ended. Dumping a history of the last processes samples

[startup+1800.1 s]
/proc/loadavg: 2.10 2.11 2.09 3/183 10065
/proc/meminfo: memFree=28295728/32873648 swapFree=7368/7368
[pid=9123] ppid=9121 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/9123/stat : 9123 (runPb2satCp2.sh) S 9121 9123 3829 0 -1 4202496 357 0 0 0 0 0 0 0 20 0 1 0 277047553 9367552 275 33554432000 4194304 5064252 140735604791360 140735604790272 251052844622 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/9123/statm: 2287 275 233 213 0 72 0
[pid=9124] ppid=9123 vsize=259440 CPUtime=1794.13 cores=0,2,4,6
/proc/9124/stat : 9124 (pb2sat) S 9123 9123 3829 0 -1 4202496 854081 12697462 0 0 6968 1260 164973 6212 20 0 1 0 277047553 265666560 58968 33554432000 4194304 5873084 140736212947056 140736212940872 5124602 0 65536 4102 0 18446744071579302229 0 0 17 4 0 0 224 0 0
/proc/9124/statm: 64860 58968 173 410 0 64442 0
[pid=10064] ppid=9124 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/10064/stat : 10064 (satsolver.sh) S 9124 9123 3829 0 -1 4202496 595 0 0 0 0 0 0 0 20 0 1 0 277227562 9367552 266 33554432000 4194304 5064252 140734412762272 140734412761184 251052844622 0 65536 4100 65538 18446744071579302229 0 0 17 2 0 0 0 0 0
/proc/10064/statm: 2287 266 226 213 0 72 0
[pid=10065] ppid=10064 vsize=10468 CPUtime=0 cores=0,2,4,6
/proc/10065/stat : 10065 (glucose_static) R 10064 9123 3829 0 -1 4202496 1527 0 0 0 0 0 0 0 20 0 1 0 277227562 10719232 1368 33554432000 4194304 4896791 140736971363136 140736970312184 4401607 0 0 4096 0 0 0 0 17 4 0 0 0 0 0
/proc/10065/statm: 2617 1369 58 172 0 2443 0
Current children cumulated CPU time (s) 1794.13
Current children cumulated vsize (KiB) 288204

Child status: 0

# WARNING:
# The CPU time of some children was not reported to their father
# (probably because of a missing or aborted wait()).
# This 'lost CPU time' is added to the watched process CPU time.
#  lost CPU time (s): 5.89001
#  lost CPU user time (s): 5.60999
#  lost CPU system time (s): 0.279999

Real time (s): 1800.12
CPU time (s): 1800.07
CPU user time (s): 1725.04
CPU system time (s): 75.0286
CPU usage (%): 99.9975
Max. virtual memory (cumulated for all children) (KiB): 1085852

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1719.43
system time used= 74.7486
maximum resident set size= 651840
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 13554076
page faults= 0
swaps= 0
block input operations= 0
block output operations= 32168696
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 1334
involuntary context switches= 4094

runsolver used 5.16921 second user time and 18.9371 second system time

The end

Launcher Data

Begin job on node149 at 2012-05-27 11:00:35
IDJOB=3695227
IDBENCH=77109
IDSOLVER=2273
FILE ID=node149/3695227-1338109234
RUNJOBID= node149-1338101830-7492
PBS_JOBID= 14624439
Free space on /tmp= 71596 MiB

SOLVER NAME= pb2satCp2 2012-05-19
BENCH NAME= PB10/normalized-PB10/OPT-SMALLINT-LIN/oliveras/j120opt/normalized-j12053_6.std.opb
COMMAND LINE= DIR/runPb2satCp2.sh BENCHNAME RANDOMSEED TMPDIR DIR
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3695227-1338109234/watcher-3695227-1338109234 -o /tmp/evaluation-result-3695227-1338109234/solver-3695227-1338109234 -C 1800 -W 1900 -M 15500  HOME/runPb2satCp2.sh HOME/instance-3695227-1338109234.opb 1598238698 HOME HOME

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= afeceb08ae53f25fa9e4759a0d0118c7
RANDOM SEED=1598238698

node149.alineos.net Linux 2.6.32-71.29.1.el6.x86_64 #1 SMP Mon Jun 27 19:49:27 BST 2011

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.145
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.29
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.145
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.145
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5438.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.145
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.145
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.145
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5438.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.145
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.145
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32873648 kB
MemFree:        30044820 kB
Buffers:          288132 kB
Cached:          1649136 kB
SwapCached:         2244 kB
Active:           906088 kB
Inactive:        1115768 kB
Active(anon):      76512 kB
Inactive(anon):     9052 kB
Active(file):     829576 kB
Inactive(file):  1106716 kB
Unevictable:        7368 kB
Mlocked:            7368 kB
SwapTotal:      67108856 kB
SwapFree:       67104796 kB
Dirty:             68332 kB
Writeback:             0 kB
AnonPages:         88932 kB
Mapped:            15100 kB
Shmem:                96 kB
Slab:             668572 kB
SReclaimable:     111940 kB
SUnreclaim:       556632 kB
KernelStack:        1480 kB
PageTables:         4216 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83545680 kB
Committed_AS:     215040 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      346400 kB
VmallocChunk:   34341988052 kB
HardwareCorrupted:     0 kB
AnonHugePages:     53248 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:        7680 kB
DirectMap2M:    33538048 kB

Free space on /tmp at the end= 71304 MiB
End job on node149 at 2012-05-27 11:30:35