Trace number 3754922

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
npSolver 1.0 (fixed)? (TO) 1800.05 1800.41

General information on the benchmark

Name/PARTIAL-BIGINT-LIN/wcsp/warehouse/
normalized-cap64_wcsp.wbo
MD5SUMeea9483bb210b3ae31db150f2467fbf7
Bench CategoryPARTIAL-BIGINT-LIN (both soft and hard constraints, big integers, linear constraints)
Best result obtained on this benchmarkMSAT
Best cost obtained on this benchmark10336274
Best CPU time to get the best result obtained on this benchmark1800.01
Max-Satisfiable
Max-(Un)Satisfiability was proved
Best value of the cost
Optimality of the best cost was proved
Number of variables832
Total number of constraints1680
Number of soft constraints1614
Number of constraints which are clauses1614
Number of constraints which are cardinality constraints (but not clauses)66
Number of constraints which are nor clauses,nor cardinality constraints0
Minimum length of a constraint1
Maximum length of a constraint16
Top cost 58368026
Min constraint cost 1
Max constraint cost 58368026
Sum of constraints costs 47051030826
Biggest number in a constraint 1
Number of bits of the biggest number in a constraint 1
Biggest sum of numbers in a constraint 17
Number of bits of the biggest sum of numbers5
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Quality of the solution as a function of time


Download the above graph as a PDF file / as an EPS file

Solver Data 

0.00/0.02	c run usual solver
0.00/0.08	o 19207135
0.00/0.08	c current bound: 9603567
0.00/0.08	c fallback to adder encoding
41.56/41.64	c current bound: 14405351
41.56/41.64	c fallback to adder encoding
932.06/932.41	o 14405013
932.06/932.41	c current bound: 12004290
932.06/932.41	c fallback to adder encoding
1433.69/1434.12	o 12000203
1433.69/1434.12	c current bound: 10801885
1433.69/1434.12	c fallback to adder encoding
1800.05/1800.41	c error: unexpected solver exit code
1800.05/1800.41	s UNKNOWN

Verifier Data 

ERROR: no interpretation found !

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.1 (svn: 989)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3754922-1339198500/watcher-3754922-1339198500 -o /tmp/evaluation-result-3754922-1339198500/solver-3754922-1339198500 -C 1800 -W 1900 -M 15500 HOME/npSolver-wbo.sh HOME/instance-3754922-1339198500.wbo 131024355 HOME HOME 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1900 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 2.00 2.00 2.00 3/179 3901
/proc/meminfo: memFree=29216696/32873844 swapFree=8656/8656
[pid=3901] ppid=3899 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/3901/stat : 3901 (npSolver-wbo.sh) S 3899 3901 31464 0 -1 4202496 357 0 0 0 0 0 0 0 20 0 1 0 385978564 9367552 275 33554432000 4194304 5064252 140733250518896 140733250517808 249649849934 0 65536 4100 65538 18446744071579302229 0 0 17 4 0 0 0 0 0
/proc/3901/statm: 2287 275 233 213 0 72 0

[startup+0.0789141 s]
/proc/loadavg: 2.00 2.00 2.00 3/179 3901
/proc/meminfo: memFree=29216696/32873844 swapFree=8656/8656
[pid=3901] ppid=3899 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/3901/stat : 3901 (npSolver-wbo.sh) S 3899 3901 31464 0 -1 4202496 357 0 0 0 0 0 0 0 20 0 1 0 385978564 9367552 275 33554432000 4194304 5064252 140733250518896 140733250517808 249649849934 0 65536 4100 65538 18446744071579302229 0 0 17 4 0 0 0 0 0
/proc/3901/statm: 2287 275 233 213 0 72 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 9148

[startup+0.100309 s]
/proc/loadavg: 2.00 2.00 2.00 3/179 3901
/proc/meminfo: memFree=29216696/32873844 swapFree=8656/8656
[pid=3901] ppid=3899 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/3901/stat : 3901 (npSolver-wbo.sh) S 3899 3901 31464 0 -1 4202496 357 0 0 0 0 0 0 0 20 0 1 0 385978564 9367552 275 33554432000 4194304 5064252 140733250518896 140733250517808 249649849934 0 65536 4100 65538 18446744071579302229 0 0 17 4 0 0 0 0 0
/proc/3901/statm: 2287 275 233 213 0 72 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 9148

[startup+0.30017 s]
/proc/loadavg: 2.00 2.00 2.00 3/179 3901
/proc/meminfo: memFree=29216696/32873844 swapFree=8656/8656
[pid=3901] ppid=3899 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/3901/stat : 3901 (npSolver-wbo.sh) S 3899 3901 31464 0 -1 4202496 357 0 0 0 0 0 0 0 20 0 1 0 385978564 9367552 275 33554432000 4194304 5064252 140733250518896 140733250517808 249649849934 0 65536 4100 65538 18446744071579302229 0 0 17 4 0 0 0 0 0
/proc/3901/statm: 2287 275 233 213 0 72 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 9148

[startup+0.70031 s]
/proc/loadavg: 2.00 2.00 2.00 3/179 3901
/proc/meminfo: memFree=29216696/32873844 swapFree=8656/8656
[pid=3901] ppid=3899 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/3901/stat : 3901 (npSolver-wbo.sh) S 3899 3901 31464 0 -1 4202496 357 0 0 0 0 0 0 0 20 0 1 0 385978564 9367552 275 33554432000 4194304 5064252 140733250518896 140733250517808 249649849934 0 65536 4100 65538 18446744071579302229 0 0 17 4 0 0 0 0 0
/proc/3901/statm: 2287 275 233 213 0 72 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 9148

[startup+1.50034 s]
/proc/loadavg: 2.00 2.00 2.00 3/183 3915
/proc/meminfo: memFree=29133232/32873844 swapFree=8656/8656
[pid=3901] ppid=3899 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/3901/stat : 3901 (npSolver-wbo.sh) S 3899 3901 31464 0 -1 4202496 357 0 0 0 0 0 0 0 20 0 1 0 385978564 9367552 275 33554432000 4194304 5064252 140733250518896 140733250517808 249649849934 0 65536 4100 65538 18446744071579302229 0 0 17 4 0 0 0 0 0
/proc/3901/statm: 2287 275 233 213 0 72 0
[pid=3902] ppid=3901 vsize=37380 CPUtime=0.28 cores=0,2,4,6
/proc/3902/stat : 3902 (npSolver-wbo) S 3901 3901 31464 0 -1 4202496 4775 6461 0 0 21 4 2 1 20 0 1 0 385978564 38277120 8170 33554432000 4194304 6006132 140736133904976 140736133896384 5187998 0 65536 4102 0 18446744071579302229 0 0 17 2 0 0 0 0 0
/proc/3902/statm: 9345 8170 178 443 0 8898 0
[pid=3914] ppid=3902 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/3914/stat : 3914 (satsolver.sh) S 3902 3901 31464 0 -1 4202496 598 0 0 0 0 0 0 0 20 0 1 0 385978594 9367552 267 33554432000 4194304 5064252 140734741842112 140734741841024 249649849934 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/3914/statm: 2287 267 226 213 0 72 0
[pid=3915] ppid=3914 vsize=43240 CPUtime=1.19 cores=0,2,4,6
/proc/3915/stat : 3915 (glucose) R 3914 3901 31464 0 -1 4202496 9686 0 0 0 118 1 0 0 20 0 1 0 385978594 44277760 9760 33554432000 4194304 5208918 140734331469232 140734331467064 4229483 0 0 4096 0 0 0 0 17 4 0 0 0 0 0
/proc/3915/statm: 10810 9760 105 248 0 10559 0
Current children cumulated CPU time (s) 1.47
Current children cumulated vsize (KiB) 98916

[startup+3.10034 s]
/proc/loadavg: 2.00 2.00 2.00 3/183 3915
/proc/meminfo: memFree=29131480/32873844 swapFree=8656/8656
[pid=3901] ppid=3899 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/3901/stat : 3901 (npSolver-wbo.sh) S 3899 3901 31464 0 -1 4202496 357 0 0 0 0 0 0 0 20 0 1 0 385978564 9367552 275 33554432000 4194304 5064252 140733250518896 140733250517808 249649849934 0 65536 4100 65538 18446744071579302229 0 0 17 4 0 0 0 0 0
/proc/3901/statm: 2287 275 233 213 0 72 0
[pid=3902] ppid=3901 vsize=37380 CPUtime=0.28 cores=0,2,4,6
/proc/3902/stat : 3902 (npSolver-wbo) S 3901 3901 31464 0 -1 4202496 4775 6461 0 0 21 4 2 1 20 0 1 0 385978564 38277120 8170 33554432000 4194304 6006132 140736133904976 140736133896384 5187998 0 65536 4102 0 18446744071579302229 0 0 17 2 0 0 0 0 0
/proc/3902/statm: 9345 8170 178 443 0 8898 0
[pid=3914] ppid=3902 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/3914/stat : 3914 (satsolver.sh) S 3902 3901 31464 0 -1 4202496 598 0 0 0 0 0 0 0 20 0 1 0 385978594 9367552 267 33554432000 4194304 5064252 140734741842112 140734741841024 249649849934 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/3914/statm: 2287 267 226 213 0 72 0
[pid=3915] ppid=3914 vsize=50936 CPUtime=2.79 cores=0,2,4,6
/proc/3915/stat : 3915 (glucose) R 3914 3901 31464 0 -1 4202496 10271 0 0 0 277 2 0 0 20 0 1 0 385978594 52158464 10338 33554432000 4194304 5208918 140734331469232 140734331465544 4232672 0 0 4096 0 0 0 0 17 4 0 0 0 0 0
/proc/3915/statm: 12734 10338 105 248 0 12483 0
Current children cumulated CPU time (s) 3.07
Current children cumulated vsize (KiB) 106612

[startup+6.30035 s]
/proc/loadavg: 2.00 2.00 2.00 3/183 3915
/proc/meminfo: memFree=29129248/32873844 swapFree=8656/8656
[pid=3901] ppid=3899 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/3901/stat : 3901 (npSolver-wbo.sh) S 3899 3901 31464 0 -1 4202496 357 0 0 0 0 0 0 0 20 0 1 0 385978564 9367552 275 33554432000 4194304 5064252 140733250518896 140733250517808 249649849934 0 65536 4100 65538 18446744071579302229 0 0 17 4 0 0 0 0 0
/proc/3901/statm: 2287 275 233 213 0 72 0
[pid=3902] ppid=3901 vsize=37380 CPUtime=0.28 cores=0,2,4,6
/proc/3902/stat : 3902 (npSolver-wbo) S 3901 3901 31464 0 -1 4202496 4775 6461 0 0 21 4 2 1 20 0 1 0 385978564 38277120 8170 33554432000 4194304 6006132 140736133904976 140736133896384 5187998 0 65536 4102 0 18446744071579302229 0 0 17 2 0 0 0 0 0
/proc/3902/statm: 9345 8170 178 443 0 8898 0
[pid=3914] ppid=3902 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/3914/stat : 3914 (satsolver.sh) S 3902 3901 31464 0 -1 4202496 598 0 0 0 0 0 0 0 20 0 1 0 385978594 9367552 267 33554432000 4194304 5064252 140734741842112 140734741841024 249649849934 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/3914/statm: 2287 267 226 213 0 72 0
[pid=3915] ppid=3914 vsize=63996 CPUtime=5.99 cores=0,2,4,6
/proc/3915/stat : 3915 (glucose) R 3914 3901 31464 0 -1 4202496 12134 0 0 0 597 2 0 0 20 0 1 0 385978594 65531904 13574 33554432000 4194304 5208918 140734331469232 140734331467064 4229776 0 0 4096 0 0 0 0 17 4 0 0 0 0 0
/proc/3915/statm: 15999 13574 105 248 0 15748 0
Current children cumulated CPU time (s) 6.27
Current children cumulated vsize (KiB) 119672

[startup+12.7004 s]
/proc/loadavg: 2.00 2.00 2.00 3/183 3915
/proc/meminfo: memFree=29098300/32873844 swapFree=8656/8656
[pid=3901] ppid=3899 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/3901/stat : 3901 (npSolver-wbo.sh) S 3899 3901 31464 0 -1 4202496 357 0 0 0 0 0 0 0 20 0 1 0 385978564 9367552 275 33554432000 4194304 5064252 140733250518896 140733250517808 249649849934 0 65536 4100 65538 18446744071579302229 0 0 17 4 0 0 0 0 0
/proc/3901/statm: 2287 275 233 213 0 72 0
[pid=3902] ppid=3901 vsize=37380 CPUtime=0.28 cores=0,2,4,6
/proc/3902/stat : 3902 (npSolver-wbo) S 3901 3901 31464 0 -1 4202496 4775 6461 0 0 21 4 2 1 20 0 1 0 385978564 38277120 8170 33554432000 4194304 6006132 140736133904976 140736133896384 5187998 0 65536 4102 0 18446744071579302229 0 0 17 2 0 0 0 0 0
/proc/3902/statm: 9345 8170 178 443 0 8898 0
[pid=3914] ppid=3902 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/3914/stat : 3914 (satsolver.sh) S 3902 3901 31464 0 -1 4202496 598 0 0 0 0 0 0 0 20 0 1 0 385978594 9367552 267 33554432000 4194304 5064252 140734741842112 140734741841024 249649849934 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/3914/statm: 2287 267 226 213 0 72 0
[pid=3915] ppid=3914 vsize=75492 CPUtime=12.39 cores=0,2,4,6
/proc/3915/stat : 3915 (glucose) R 3914 3901 31464 0 -1 4202496 12505 0 0 0 1236 3 0 0 20 0 1 0 385978594 77303808 17993 33554432000 4194304 5208918 140734331469232 140734331465544 4229311 0 0 4096 0 0 0 0 17 4 0 0 0 0 0
/proc/3915/statm: 18873 17993 105 248 0 18622 0
Current children cumulated CPU time (s) 12.67
Current children cumulated vsize (KiB) 131168

[startup+25.5004 s]
/proc/loadavg: 2.00 2.00 2.00 3/183 3915
/proc/meminfo: memFree=29095508/32873844 swapFree=8656/8656
[pid=3901] ppid=3899 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/3901/stat : 3901 (npSolver-wbo.sh) S 3899 3901 31464 0 -1 4202496 357 0 0 0 0 0 0 0 20 0 1 0 385978564 9367552 275 33554432000 4194304 5064252 140733250518896 140733250517808 249649849934 0 65536 4100 65538 18446744071579302229 0 0 17 4 0 0 0 0 0
/proc/3901/statm: 2287 275 233 213 0 72 0
[pid=3902] ppid=3901 vsize=37380 CPUtime=0.28 cores=0,2,4,6
/proc/3902/stat : 3902 (npSolver-wbo) S 3901 3901 31464 0 -1 4202496 4775 6461 0 0 21 4 2 1 20 0 1 0 385978564 38277120 8170 33554432000 4194304 6006132 140736133904976 140736133896384 5187998 0 65536 4102 0 18446744071579302229 0 0 17 2 0 0 0 0 0
/proc/3902/statm: 9345 8170 178 443 0 8898 0
[pid=3914] ppid=3902 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/3914/stat : 3914 (satsolver.sh) S 3902 3901 31464 0 -1 4202496 598 0 0 0 0 0 0 0 20 0 1 0 385978594 9367552 267 33554432000 4194304 5064252 140734741842112 140734741841024 249649849934 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/3914/statm: 2287 267 226 213 0 72 0
[pid=3915] ppid=3914 vsize=94344 CPUtime=25.18 cores=0,2,4,6
/proc/3915/stat : 3915 (glucose) R 3914 3901 31464 0 -1 4202496 12859 0 0 0 2515 3 0 0 20 0 1 0 385978594 96608256 21769 33554432000 4194304 5208918 140734331469232 140734331464920 4224559 0 0 4096 0 0 0 0 17 4 0 0 0 0 0
/proc/3915/statm: 23586 21769 105 248 0 23335 0
Current children cumulated CPU time (s) 25.46
Current children cumulated vsize (KiB) 150020

[startup+51.1004 s]
/proc/loadavg: 2.00 2.00 2.00 3/183 3922
/proc/meminfo: memFree=29102192/32873844 swapFree=8656/8656
[pid=3901] ppid=3899 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/3901/stat : 3901 (npSolver-wbo.sh) S 3899 3901 31464 0 -1 4202496 357 0 0 0 0 0 0 0 20 0 1 0 385978564 9367552 275 33554432000 4194304 5064252 140733250518896 140733250517808 249649849934 0 65536 4100 65538 18446744071579302229 0 0 17 4 0 0 0 0 0
/proc/3901/statm: 2287 275 233 213 0 72 0
[pid=3902] ppid=3901 vsize=37384 CPUtime=41.83 cores=0,2,4,6
/proc/3902/stat : 3902 (npSolver-wbo) S 3901 3901 31464 0 -1 4202496 7318 22823 0 0 40 6 4130 7 20 0 1 0 385978564 38281216 8532 33554432000 4194304 6006132 140736133904976 140736133896384 5187998 0 65536 4102 0 18446744071579302229 0 0 17 2 0 0 0 0 0
/proc/3902/statm: 9346 8532 178 443 0 8899 0
[pid=3921] ppid=3902 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/3921/stat : 3921 (satsolver.sh) S 3902 3901 31464 0 -1 4202496 598 0 0 0 0 0 0 0 20 0 1 0 385982750 9367552 267 33554432000 4194304 5064252 140737392018032 140737392016944 249649849934 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/3921/statm: 2287 267 226 213 0 72 0
[pid=3922] ppid=3921 vsize=75020 CPUtime=9.23 cores=0,2,4,6
/proc/3922/stat : 3922 (glucose) R 3921 3901 31464 0 -1 4202496 11741 0 0 0 920 3 0 0 20 0 1 0 385982750 76820480 17219 33554432000 4194304 5208918 140733914559072 140733914555384 4211901 0 0 4096 0 0 0 0 17 4 0 0 0 0 0
/proc/3922/statm: 18755 17219 105 248 0 18504 0
Current children cumulated CPU time (s) 51.06
Current children cumulated vsize (KiB) 130700

[startup+102.307 s]
/proc/loadavg: 2.00 2.00 2.00 3/183 3922
/proc/meminfo: memFree=29080040/32873844 swapFree=8656/8656
[pid=3901] ppid=3899 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/3901/stat : 3901 (npSolver-wbo.sh) S 3899 3901 31464 0 -1 4202496 357 0 0 0 0 0 0 0 20 0 1 0 385978564 9367552 275 33554432000 4194304 5064252 140733250518896 140733250517808 249649849934 0 65536 4100 65538 18446744071579302229 0 0 17 4 0 0 0 0 0
/proc/3901/statm: 2287 275 233 213 0 72 0
[pid=3902] ppid=3901 vsize=37384 CPUtime=41.83 cores=0,2,4,6
/proc/3902/stat : 3902 (npSolver-wbo) S 3901 3901 31464 0 -1 4202496 7318 22823 0 0 40 6 4130 7 20 0 1 0 385978564 38281216 8532 33554432000 4194304 6006132 140736133904976 140736133896384 5187998 0 65536 4102 0 18446744071579302229 0 0 17 2 0 0 0 0 0
/proc/3902/statm: 9346 8532 178 443 0 8899 0
[pid=3921] ppid=3902 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/3921/stat : 3921 (satsolver.sh) S 3902 3901 31464 0 -1 4202496 598 0 0 0 0 0 0 0 20 0 1 0 385982750 9367552 267 33554432000 4194304 5064252 140737392018032 140737392016944 249649849934 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/3921/statm: 2287 267 226 213 0 72 0
[pid=3922] ppid=3921 vsize=93876 CPUtime=60.42 cores=0,2,4,6
/proc/3922/stat : 3922 (glucose) R 3921 3901 31464 0 -1 4202496 14115 0 0 0 6037 5 0 0 20 0 1 0 385982750 96129024 22274 33554432000 4194304 5208918 140733914559072 140733914555448 4211635 0 0 4096 0 0 0 0 17 4 0 0 0 0 0
/proc/3922/statm: 23469 22274 105 248 0 23218 0
Current children cumulated CPU time (s) 102.25
Current children cumulated vsize (KiB) 149556

[startup+162.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/183 3923
/proc/meminfo: memFree=29074856/32873844 swapFree=8656/8656
[pid=3901] ppid=3899 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/3901/stat : 3901 (npSolver-wbo.sh) S 3899 3901 31464 0 -1 4202496 357 0 0 0 0 0 0 0 20 0 1 0 385978564 9367552 275 33554432000 4194304 5064252 140733250518896 140733250517808 249649849934 0 65536 4100 65538 18446744071579302229 0 0 17 4 0 0 0 0 0
/proc/3901/statm: 2287 275 233 213 0 72 0
[pid=3902] ppid=3901 vsize=37384 CPUtime=41.83 cores=0,2,4,6
/proc/3902/stat : 3902 (npSolver-wbo) S 3901 3901 31464 0 -1 4202496 7318 22823 0 0 40 6 4130 7 20 0 1 0 385978564 38281216 8532 33554432000 4194304 6006132 140736133904976 140736133896384 5187998 0 65536 4102 0 18446744071579302229 0 0 17 2 0 0 0 0 0
/proc/3902/statm: 9346 8532 178 443 0 8899 0
[pid=3921] ppid=3902 vsize=9148 CPUtime=0 cores=0,2,4,6

################
# More data... #
################

/proc/3991/stat : 3991 (glucose) R 3990 3901 31464 0 -1 4202496 24188 0 0 0 42937 21 0 0 20 0 1 0 386071827 160968704 36480 33554432000 4194304 5208918 140735106124832 140735106122824 4211871 0 0 4096 0 0 0 0 17 4 0 0 0 0 0
/proc/3991/statm: 39299 36480 105 248 0 39048 0
Current children cumulated CPU time (s) 1362.02
Current children cumulated vsize (KiB) 212872

[startup+1422.31 s]
/proc/loadavg: 2.05 2.01 2.00 3/183 3993
/proc/meminfo: memFree=30917504/32873844 swapFree=8656/8656
[pid=3901] ppid=3899 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/3901/stat : 3901 (npSolver-wbo.sh) S 3899 3901 31464 0 -1 4202496 357 0 0 0 0 0 0 0 20 0 1 0 385978564 9367552 275 33554432000 4194304 5064252 140733250518896 140733250517808 249649849934 0 65536 4100 65538 18446744071579302229 0 0 17 4 0 0 0 0 0
/proc/3901/statm: 2287 275 233 213 0 72 0
[pid=3902] ppid=3901 vsize=37380 CPUtime=932.44 cores=0,2,4,6
/proc/3902/stat : 3902 (npSolver-wbo) S 3901 3901 31464 0 -1 4202496 9898 57600 0 0 59 8 93126 51 20 0 1 0 385978564 38277120 8532 33554432000 4194304 6006132 140736133904976 140736133896384 5187998 0 65536 4102 0 18446744071579302229 0 0 17 2 0 0 0 0 0
/proc/3902/statm: 9345 8532 178 443 0 8898 0
[pid=3990] ppid=3902 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/3990/stat : 3990 (satsolver.sh) S 3902 3901 31464 0 -1 4202496 597 0 0 0 0 0 0 0 20 0 1 0 386071827 9367552 266 33554432000 4194304 5064252 140735688822368 140735688821280 249649849934 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/3990/statm: 2287 266 226 213 0 72 0
[pid=3991] ppid=3990 vsize=188016 CPUtime=489.58 cores=0,2,4,6
/proc/3991/stat : 3991 (glucose) R 3990 3901 31464 0 -1 4202496 25859 0 0 0 48934 24 0 0 20 0 1 0 386071827 192528384 40131 33554432000 4194304 5208918 140735106124832 140735106121208 4211834 0 0 4096 0 0 0 0 17 4 0 0 0 0 0
/proc/3991/statm: 47004 40131 105 248 0 46753 0
Current children cumulated CPU time (s) 1422.02
Current children cumulated vsize (KiB) 243692

[startup+1482.3 s]
/proc/loadavg: 2.02 2.01 2.00 3/183 4000
/proc/meminfo: memFree=31012392/32873844 swapFree=8656/8656
[pid=3901] ppid=3899 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/3901/stat : 3901 (npSolver-wbo.sh) S 3899 3901 31464 0 -1 4202496 357 0 0 0 0 0 0 0 20 0 1 0 385978564 9367552 275 33554432000 4194304 5064252 140733250518896 140733250517808 249649849934 0 65536 4100 65538 18446744071579302229 0 0 17 4 0 0 0 0 0
/proc/3901/statm: 2287 275 233 213 0 72 0
[pid=3902] ppid=3901 vsize=37380 CPUtime=1434.07 cores=0,2,4,6
/proc/3902/stat : 3902 (npSolver-wbo) S 3901 3901 31464 0 -1 4202496 12478 87100 0 0 79 11 143235 82 20 0 1 0 385978564 38277120 8532 33554432000 4194304 6006132 140736133904976 140736133896384 5187998 0 65536 4102 0 18446744071579302229 0 0 17 2 0 0 0 0 0
/proc/3902/statm: 9345 8532 178 443 0 8898 0
[pid=3999] ppid=3902 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/3999/stat : 3999 (satsolver.sh) S 3902 3901 31464 0 -1 4202496 599 0 0 0 0 0 0 0 20 0 1 0 386121999 9367552 267 33554432000 4194304 5064252 140734020252288 140734020251200 249649849934 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/3999/statm: 2287 267 226 213 0 72 0
[pid=4000] ppid=3999 vsize=94036 CPUtime=47.93 cores=0,2,4,6
/proc/4000/stat : 4000 (glucose) R 3999 3901 31464 0 -1 4202496 13638 0 0 0 4789 4 0 0 20 0 1 0 386121999 96292864 22785 33554432000 4194304 5208918 140735971907648 140735971903960 4229347 0 0 4096 0 0 0 0 17 4 0 0 0 0 0
/proc/4000/statm: 23509 22785 105 248 0 23258 0
Current children cumulated CPU time (s) 1482
Current children cumulated vsize (KiB) 149712

[startup+1542.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/184 4003
/proc/meminfo: memFree=30957696/32873844 swapFree=8656/8656
[pid=3901] ppid=3899 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/3901/stat : 3901 (npSolver-wbo.sh) S 3899 3901 31464 0 -1 4202496 357 0 0 0 0 0 0 0 20 0 1 0 385978564 9367552 275 33554432000 4194304 5064252 140733250518896 140733250517808 249649849934 0 65536 4100 65538 18446744071579302229 0 0 17 4 0 0 0 0 0
/proc/3901/statm: 2287 275 233 213 0 72 0
[pid=3902] ppid=3901 vsize=37380 CPUtime=1434.07 cores=0,2,4,6
/proc/3902/stat : 3902 (npSolver-wbo) S 3901 3901 31464 0 -1 4202496 12478 87100 0 0 79 11 143235 82 20 0 1 0 385978564 38277120 8532 33554432000 4194304 6006132 140736133904976 140736133896384 5187998 0 65536 4102 0 18446744071579302229 0 0 17 2 0 0 0 0 0
/proc/3902/statm: 9345 8532 178 443 0 8898 0
[pid=3999] ppid=3902 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/3999/stat : 3999 (satsolver.sh) S 3902 3901 31464 0 -1 4202496 599 0 0 0 0 0 0 0 20 0 1 0 386121999 9367552 267 33554432000 4194304 5064252 140734020252288 140734020251200 249649849934 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/3999/statm: 2287 267 226 213 0 72 0
[pid=4000] ppid=3999 vsize=143356 CPUtime=107.92 cores=0,2,4,6
/proc/4000/stat : 4000 (glucose) R 3999 3901 31464 0 -1 4202496 15198 0 0 0 10786 6 0 0 20 0 1 0 386121999 146796544 32405 33554432000 4194304 5208918 140735971907648 140735971904024 4229328 0 0 4096 0 0 0 0 17 4 0 0 0 0 0
/proc/4000/statm: 35839 32405 105 248 0 35588 0
Current children cumulated CPU time (s) 1541.99
Current children cumulated vsize (KiB) 199032

[startup+1602.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/184 4026
/proc/meminfo: memFree=30933548/32873844 swapFree=8656/8656
[pid=3901] ppid=3899 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/3901/stat : 3901 (npSolver-wbo.sh) S 3899 3901 31464 0 -1 4202496 357 0 0 0 0 0 0 0 20 0 1 0 385978564 9367552 275 33554432000 4194304 5064252 140733250518896 140733250517808 249649849934 0 65536 4100 65538 18446744071579302229 0 0 17 4 0 0 0 0 0
/proc/3901/statm: 2287 275 233 213 0 72 0
[pid=3902] ppid=3901 vsize=37380 CPUtime=1434.07 cores=0,2,4,6
/proc/3902/stat : 3902 (npSolver-wbo) S 3901 3901 31464 0 -1 4202496 12478 87100 0 0 79 11 143235 82 20 0 1 0 385978564 38277120 8532 33554432000 4194304 6006132 140736133904976 140736133896384 5187998 0 65536 4102 0 18446744071579302229 0 0 17 2 0 0 0 0 0
/proc/3902/statm: 9345 8532 178 443 0 8898 0
[pid=3999] ppid=3902 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/3999/stat : 3999 (satsolver.sh) S 3902 3901 31464 0 -1 4202496 599 0 0 0 0 0 0 0 20 0 1 0 386121999 9367552 267 33554432000 4194304 5064252 140734020252288 140734020251200 249649849934 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/3999/statm: 2287 267 226 213 0 72 0
[pid=4000] ppid=3999 vsize=143356 CPUtime=167.9 cores=0,2,4,6
/proc/4000/stat : 4000 (glucose) R 3999 3901 31464 0 -1 4202496 16345 0 0 0 16782 8 0 0 20 0 1 0 386121999 146796544 33941 33554432000 4194304 5208918 140735971907648 140735971904024 4229155 0 0 4096 0 0 0 0 17 4 0 0 0 0 0
/proc/4000/statm: 35839 33941 105 248 0 35588 0
Current children cumulated CPU time (s) 1601.97
Current children cumulated vsize (KiB) 199032

[startup+1662.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/183 4027
/proc/meminfo: memFree=30988992/32873844 swapFree=8660/8660
[pid=3901] ppid=3899 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/3901/stat : 3901 (npSolver-wbo.sh) S 3899 3901 31464 0 -1 4202496 357 0 0 0 0 0 0 0 20 0 1 0 385978564 9367552 275 33554432000 4194304 5064252 140733250518896 140733250517808 249649849934 0 65536 4100 65538 18446744071579302229 0 0 17 4 0 0 0 0 0
/proc/3901/statm: 2287 275 233 213 0 72 0
[pid=3902] ppid=3901 vsize=37380 CPUtime=1434.07 cores=0,2,4,6
/proc/3902/stat : 3902 (npSolver-wbo) S 3901 3901 31464 0 -1 4202496 12478 87100 0 0 79 11 143235 82 20 0 1 0 385978564 38277120 8532 33554432000 4194304 6006132 140736133904976 140736133896384 5187998 0 65536 4102 0 18446744071579302229 0 0 17 2 0 0 0 0 0
/proc/3902/statm: 9345 8532 178 443 0 8898 0
[pid=3999] ppid=3902 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/3999/stat : 3999 (satsolver.sh) S 3902 3901 31464 0 -1 4202496 599 0 0 0 0 0 0 0 20 0 1 0 386121999 9367552 267 33554432000 4194304 5064252 140734020252288 140734020251200 249649849934 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/3999/statm: 2287 267 226 213 0 72 0
[pid=4000] ppid=3999 vsize=107224 CPUtime=227.9 cores=0,2,4,6
/proc/4000/stat : 4000 (glucose) R 3999 3901 31464 0 -1 4202496 18321 0 0 0 22778 12 0 0 20 0 1 0 386121999 109797376 25929 33554432000 4194304 5208918 140735971907648 140735971905736 4211623 0 0 4096 0 0 0 0 17 4 0 0 0 0 0
/proc/4000/statm: 26806 25929 105 248 0 26555 0
Current children cumulated CPU time (s) 1661.97
Current children cumulated vsize (KiB) 162900

[startup+1722.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/183 4027
/proc/meminfo: memFree=30911376/32873844 swapFree=8656/8656
[pid=3901] ppid=3899 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/3901/stat : 3901 (npSolver-wbo.sh) S 3899 3901 31464 0 -1 4202496 357 0 0 0 0 0 0 0 20 0 1 0 385978564 9367552 275 33554432000 4194304 5064252 140733250518896 140733250517808 249649849934 0 65536 4100 65538 18446744071579302229 0 0 17 4 0 0 0 0 0
/proc/3901/statm: 2287 275 233 213 0 72 0
[pid=3902] ppid=3901 vsize=37380 CPUtime=1434.07 cores=0,2,4,6
/proc/3902/stat : 3902 (npSolver-wbo) S 3901 3901 31464 0 -1 4202496 12478 87100 0 0 79 11 143235 82 20 0 1 0 385978564 38277120 8532 33554432000 4194304 6006132 140736133904976 140736133896384 5187998 0 65536 4102 0 18446744071579302229 0 0 17 2 0 0 0 0 0
/proc/3902/statm: 9345 8532 178 443 0 8898 0
[pid=3999] ppid=3902 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/3999/stat : 3999 (satsolver.sh) S 3902 3901 31464 0 -1 4202496 599 0 0 0 0 0 0 0 20 0 1 0 386121999 9367552 267 33554432000 4194304 5064252 140734020252288 140734020251200 249649849934 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/3999/statm: 2287 267 226 213 0 72 0
[pid=4000] ppid=3999 vsize=187364 CPUtime=287.89 cores=0,2,4,6
/proc/4000/stat : 4000 (glucose) R 3999 3901 31464 0 -1 4202496 20473 0 0 0 28775 14 0 0 20 0 1 0 386121999 191860736 40896 33554432000 4194304 5208918 140735971907648 140735971905800 4229720 0 0 4096 0 0 0 0 17 4 0 0 0 0 0
/proc/4000/statm: 46841 40896 105 248 0 46590 0
Current children cumulated CPU time (s) 1721.96
Current children cumulated vsize (KiB) 243040

[startup+1782.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/183 4027
/proc/meminfo: memFree=30908784/32873844 swapFree=8656/8656
[pid=3901] ppid=3899 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/3901/stat : 3901 (npSolver-wbo.sh) S 3899 3901 31464 0 -1 4202496 357 0 0 0 0 0 0 0 20 0 1 0 385978564 9367552 275 33554432000 4194304 5064252 140733250518896 140733250517808 249649849934 0 65536 4100 65538 18446744071579302229 0 0 17 4 0 0 0 0 0
/proc/3901/statm: 2287 275 233 213 0 72 0
[pid=3902] ppid=3901 vsize=37380 CPUtime=1434.07 cores=0,2,4,6
/proc/3902/stat : 3902 (npSolver-wbo) S 3901 3901 31464 0 -1 4202496 12478 87100 0 0 79 11 143235 82 20 0 1 0 385978564 38277120 8532 33554432000 4194304 6006132 140736133904976 140736133896384 5187998 0 65536 4102 0 18446744071579302229 0 0 17 2 0 0 0 0 0
/proc/3902/statm: 9345 8532 178 443 0 8898 0
[pid=3999] ppid=3902 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/3999/stat : 3999 (satsolver.sh) S 3902 3901 31464 0 -1 4202496 599 0 0 0 0 0 0 0 20 0 1 0 386121999 9367552 267 33554432000 4194304 5064252 140734020252288 140734020251200 249649849934 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/3999/statm: 2287 267 226 213 0 72 0
[pid=4000] ppid=3999 vsize=156544 CPUtime=347.88 cores=0,2,4,6
/proc/4000/stat : 4000 (glucose) R 3999 3901 31464 0 -1 4202496 21837 0 0 0 34771 17 0 0 20 0 1 0 386121999 160301056 37760 33554432000 4194304 5208918 140735971907648 140735971903336 4211665 0 0 4096 0 0 0 0 17 4 0 0 0 0 0
/proc/4000/statm: 39136 37760 105 248 0 38885 0
Current children cumulated CPU time (s) 1781.95
Current children cumulated vsize (KiB) 212220



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1800.4 s]
/proc/loadavg: 2.00 2.00 2.00 3/183 4027
/proc/meminfo: memFree=30937516/32873844 swapFree=8656/8656
[pid=3901] ppid=3899 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/3901/stat : 3901 (npSolver-wbo.sh) S 3899 3901 31464 0 -1 4202496 357 0 0 0 0 0 0 0 20 0 1 0 385978564 9367552 275 33554432000 4194304 5064252 140733250518896 140733250517808 249649849934 0 65536 4100 65538 18446744071579302229 0 0 17 4 0 0 0 0 0
/proc/3901/statm: 2287 275 233 213 0 72 0
[pid=3902] ppid=3901 vsize=37380 CPUtime=1434.07 cores=0,2,4,6
/proc/3902/stat : 3902 (npSolver-wbo) S 3901 3901 31464 0 -1 4202496 12478 87100 0 0 79 11 143235 82 20 0 1 0 385978564 38277120 8532 33554432000 4194304 6006132 140736133904976 140736133896384 5187998 0 65536 4102 0 18446744071579302229 0 0 17 2 0 0 0 0 0
/proc/3902/statm: 9345 8532 178 443 0 8898 0
[pid=3999] ppid=3902 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/3999/stat : 3999 (satsolver.sh) S 3902 3901 31464 0 -1 4202496 599 0 0 0 0 0 0 0 20 0 1 0 386121999 9367552 267 33554432000 4194304 5064252 140734020252288 140734020251200 249649849934 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/3999/statm: 2287 267 226 213 0 72 0
[pid=4000] ppid=3999 vsize=187364 CPUtime=365.98 cores=0,2,4,6
/proc/4000/stat : 4000 (glucose) R 3999 3901 31464 0 -1 4202496 22425 0 0 0 36580 18 0 0 20 0 1 0 386121999 191860736 41411 33554432000 4194304 5208918 140735971907648 140735971903416 4228997 0 0 4096 0 0 0 0 17 4 0 0 0 0 0
/proc/4000/statm: 46841 41411 105 248 0 46590 0
Current children cumulated CPU time (s) 1800.05
Current children cumulated vsize (KiB) 243040

Sending SIGTERM to process tree (bottom up)

Solver just ended. Dumping a history of the last processes samples

Child status: 0

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 3901 and gives
#  childrusage.ru_utime.tv_sec=1433
#  childrusage.ru_utime.tv_usec=153127
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=940856
# CPU time returned by wait4() is 1434.09
# while last known CPU time is 1800.05
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 1800.41
CPU time (s): 1800.05
CPU user time (s): 1798.94
CPU system time (s): 1.11
CPU usage (%): 99.9798
Max. virtual memory (cumulated for all children) (KiB): 342500

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1433.15
system time used= 0.940856
maximum resident set size= 228060
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 100556
page faults= 0
swaps= 0
block input operations= 0
block output operations= 105280
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 538
involuntary context switches= 1549

runsolver used 3.47247 second user time and 12.3771 second system time

The end

Launcher Data 

Begin job on node102 at 2012-06-09 01:35:00
IDJOB=3754922
IDBENCH=79499
IDSOLVER=2339
FILE ID=node102/3754922-1339198500
RUNJOBID= node102-1339183373-383
PBS_JOBID= 14643844
Free space on /tmp= 70592 MiB

SOLVER NAME= npSolver 1.0
BENCH NAME= PB10/normalized-PB10/PARTIAL-BIGINT-LIN/wcsp/warehouse/normalized-cap64_wcsp.wbo
COMMAND LINE= DIR/npSolver-wbo.sh BENCHNAME RANDOMSEED TMPDIR DIR
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3754922-1339198500/watcher-3754922-1339198500 -o /tmp/evaluation-result-3754922-1339198500/solver-3754922-1339198500 -C 1800 -W 1900 -M 15500  HOME/npSolver-wbo.sh HOME/instance-3754922-1339198500.wbo 131024355 HOME HOME

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= eea9483bb210b3ae31db150f2467fbf7
RANDOM SEED=131024355

node102.alineos.net Linux 2.6.32-71.29.1.el6.x86_64 #1 SMP Mon Jun 27 19:49:27 BST 2011

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.178
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5334.35
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.178
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.90
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.178
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.178
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.178
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.178
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5438.54
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.178
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.178
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32873844 kB
MemFree:        29217432 kB
Buffers:          297636 kB
Cached:           715976 kB
SwapCached:         2672 kB
Active:          2737380 kB
Inactive:          42100 kB
Active(anon):    1762344 kB
Inactive(anon):     6024 kB
Active(file):     975036 kB
Inactive(file):    36076 kB
Unevictable:        8656 kB
Mlocked:            8656 kB
SwapTotal:      67108856 kB
SwapFree:       67099988 kB
Dirty:              8548 kB
Writeback:             0 kB
AnonPages:       1706756 kB
Mapped:            10004 kB
Shmem:                 0 kB
Slab:             732316 kB
SReclaimable:     173444 kB
SUnreclaim:       558872 kB
KernelStack:        1520 kB
PageTables:         7556 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83545776 kB
Committed_AS:    2051276 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      346368 kB
VmallocChunk:   34341987984 kB
HardwareCorrupted:     0 kB
AnonHugePages:    845824 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:        7872 kB
DirectMap2M:    33538048 kB

Free space on /tmp at the end= 71036 MiB
End job on node102 at 2012-06-09 02:05:01