Difference between revisions of "Example Build of an ARC/Condor Cluster"
(→Worker nodes) |
(→Worker nodes) |
||
| Line 42: | Line 42: | ||
|+Head node hardware | |+Head node hardware | ||
|-style="background:#7C8AAF;color:white" | |-style="background:#7C8AAF;color:white" | ||
| − | ! | + | !Node names |
| + | !OS | ||
| + | !RAM | ||
| + | !Disk Space | ||
!CPU type | !CPU type | ||
!CPUs Per Node | !CPUs Per Node | ||
| Line 52: | Line 55: | ||
!HepSpec per slot | !HepSpec per slot | ||
!Total hepspec | !Total hepspec | ||
| − | |||
| − | |||
| − | |||
| Line 60: | Line 60: | ||
|r21-n01-4 | |r21-n01-4 | ||
|E5620 | |E5620 | ||
| + | |SL6.4 | ||
| + | |24 GB | ||
| + | |1.5 TB | ||
|2 | |2 | ||
|5 | |5 | ||
| Line 68: | Line 71: | ||
|12.05 | |12.05 | ||
|482 | |482 | ||
| − | |||
| − | |||
| − | |||
|} | |} | ||
Revision as of 10:59, 29 August 2014
Introduction
A multi-core job is one which needs to use more than one processor on a node. Until recently, multi-core jobs have not been used on the grid infrastructure. This has all changed because Atlas and other large users have now asked sites to enable multi-core on their clusters.
Unfortunately, it is not just a simple task of setting some parameter on the head node and sitting back while jobs arrive. Different grid system have varying levels of support for multi-core, ranging from non-existent to virtually full support.
This report discusses the multi-core configuration at Liverpool. We decided to build a test cluster using one of the most capable batch systems currently available, called HTCondor (or condor for short). We also decided to fron the system with an ARC/Condor CE.
Infrastructure/Fabric
The multicore test cluster consists of an SL6 headnode to run the ARC CE and the Condor batch system. The headnode has a dedicated set of 11 workernodes of various types, providing a total of 96 single threads of execution.
Head Node
The headnode is a virtual system running on KVM.
| Host Name | OS | CPUs | RAM | Disk Space
|
|---|---|---|---|---|
| hepgrid2.ph.liv.ac.uk | SL6.4 | 8 | 2 gig | 35 gig |
Worker nodes
The physical workernodes are described below.
| Node names | OS | RAM | Disk Space | CPU type | CPUs Per Node | Slots used per cpu | Slots used per node | Total nodes | Total CPUs | Total slots | HepSpec per slot | Total hepspec
|
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| r21-n01-4 | E5620 | SL6.4 | 24 GB | 1.5 TB | 2 | 5 | 10 | 4 | 8 | 40 | 12.05 | 482 |
