UCT High Performance Computing Facility
Home       About us       Documentation       Support and Capabilities       Policies       Apply for account

HAL test cluster - Mon Sep 24 07:50:01 SAST 2018


CLUSTER LOAD Hold mouse over bars and indicators for more info. Lamp status
Partitions   
ucthimem

100

36

101

30

102

30
Partitions   
uctlomem

406

0

407

0

409

0

410

0

411

0

412

0

413

0

414

0

415

0

416

0
Partitions   
GPUQ

srvcntgpu005

32

srvcntgpu006

0

srvcntgpu007

0

srvcntgpu008

0
Disk space:
 / = 7% of 96G
/home = 60% of 504G
/scratch = 85% of 24T
Users logged in:

Head Node load: 0.03     Head Node RAM free: 93%
Currently computing: 7412 hours     Jobs running: 17     Jobs queued: 1
Efficiency: 99%    System overview    Queue accounting    Graphs

JOBS RUNNING
#  JOBID PARTITION              NAME     USER  ACCOUNT      STATE       TIME  CPUS  NODES     NODELIST(REASON)      QOS PRIORITY     CPU TIME
-----------------------------------------------------------------------------------------------------------------------------------------------
1   4302  ucthimem           WRD_0025 mnyber00    maths    RUNNING 2-16:11:15     6      1         srvcnthpc100    maths    10742     16-01:07:30
2   4303  ucthimem           WRD_0026 mnyber00    maths    RUNNING 2-16:11:15     6      1         srvcnthpc100    maths    10742     16-01:07:30
3   4304  ucthimem           WRD_0027 mnyber00    maths    RUNNING 2-16:11:15     6      1         srvcnthpc100    maths    10742     16-01:07:30
4   4305  ucthimem           WRD_0028 mnyber00    maths    RUNNING 2-16:11:15     6      1         srvcnthpc100    maths    10742     16-01:07:30
5   4306  ucthimem           WRD_0029 mnyber00    maths    RUNNING 2-16:11:15     6      1         srvcnthpc100    maths    10742     16-01:07:36
6   4307  ucthimem           WRD_0030 mnyber00    maths    RUNNING 2-16:11:15     6      1         srvcnthpc100    maths    10742     16-01:07:36
7   4308  ucthimem           WRD_0031 mnyber00    maths    RUNNING 2-11:33:26     6      1         srvcnthpc101    maths    10851     14-21:20:42
8   4309  ucthimem           WRD_0032 mnyber00    maths    RUNNING 2-09:56:29     6      1         srvcnthpc102    maths    10890     14-11:39:00
9   4310  ucthimem           WRD_0033 mnyber00    maths    RUNNING 2-09:37:43     6      1         srvcnthpc101    maths    10896     14-09:46:24
10  4311  ucthimem           WRD_0034 mnyber00    maths    RUNNING 2-08:37:31     6      1         srvcnthpc102    maths    10920     14-03:45:12
11  4312  ucthimem           WRD_0035 mnyber00    maths    RUNNING 2-04:53:19     6      1         srvcnthpc102    maths    11009     13-05:20:00
12  4313  ucthimem           WRD_0036 mnyber00    maths    RUNNING 2-03:11:34     6      1         srvcnthpc101    maths    11051     12-19:09:30
13  4314  ucthimem           WRD_0037 mnyber00    maths    RUNNING 2-00:42:52     6      1         srvcnthpc102    maths    11109     12-04:17:18
14  4315  ucthimem           WRD_0038 mnyber00    maths    RUNNING 1-23:20:32     6      1         srvcnthpc101    maths    11142     11-20:03:24
15  4316  ucthimem           WRD_0039 mnyber00    maths    RUNNING   22:14:34     6      1         srvcnthpc102    maths    11740     5-13:27:36
16  4317  ucthimem           WRD_0040 mnyber00    maths    RUNNING   22:12:47     6      1         srvcnthpc101    maths    11740     5-13:16:54
17  4329      GPUQ       rEQ_pn3_10RU  mkuttel  compsci    RUNNING 2-22:07:15    32      1         srvcntgpu005   normal    10078     93-11:53:04
18  4330      GPUQ        r1_pn3_10RU  mkuttel  compsci    PENDING       0:00    32      1         (Dependency)   normal    10078     

CLUSTER STATUS
PARTITION AVAIL  TIMELIMIT  NODES  STATE NODELIST
 ucthimem*    up 208-08:00:      3   drng srvcnthpc[100-102]
 uctlomem     up 208-08:00:     10   idle srvcnthpc[406-407,409-416]
 GPUQ         up 20-20:00:0      1   drng srvcntgpu005
 GPUQ         up 20-20:00:0      2  drain srvcntgpu[006-007]
 GPUQ         up 20-20:00:0      1   idle srvcntgpu008

PartitionName=ucthimem
    AllowGroups=ALL AllowAccounts=ALL AllowQos=ALL
    AllocNodes=ALL Default=YES QoS=N/A
    DefaultTime=NONE DisableRootJobs=NO ExclusiveUser=NO GraceTime=0 Hidden=NO
    MaxNodes=UNLIMITED MaxTime=208-08:00:00 MinNodes=1 LLN=NO MaxCPUsPerNode=UNLIMITED
    Nodes=srvcnthpc[100-102]
    PriorityJobFactor=20 PriorityTier=20 RootOnly=NO ReqResv=NO OverSubscribe=FORCE:1
    OverTimeLimit=NONE PreemptMode=REQUEUE
    State=UP TotalCPUs=120 TotalNodes=3 SelectTypeParameters=NONE
    DefMemPerCPU=2000 MaxMemPerCPU=4000
 
 PartitionName=uctlomem
    AllowGroups=ALL AllowAccounts=ALL AllowQos=ALL
    AllocNodes=ALL Default=NO QoS=N/A
    DefaultTime=NONE DisableRootJobs=NO ExclusiveUser=NO GraceTime=0 Hidden=NO
    MaxNodes=UNLIMITED MaxTime=208-08:00:00 MinNodes=1 LLN=NO MaxCPUsPerNode=UNLIMITED
    Nodes=srvcnthpc[406-407,409-416]
    PriorityJobFactor=10 PriorityTier=10 RootOnly=NO ReqResv=NO OverSubscribe=FORCE:4
    OverTimeLimit=NONE PreemptMode=REQUEUE
    State=UP TotalCPUs=80 TotalNodes=10 SelectTypeParameters=NONE
    DefMemPerCPU=2000 MaxMemPerCPU=4000
 
 PartitionName=GPUQ
    AllowGroups=ALL AllowAccounts=ALL AllowQos=ALL
    AllocNodes=ALL Default=NO QoS=N/A
    DefaultTime=NONE DisableRootJobs=NO ExclusiveUser=NO GraceTime=0 Hidden=NO
    MaxNodes=UNLIMITED MaxTime=20-20:00:00 MinNodes=1 LLN=NO MaxCPUsPerNode=UNLIMITED
    Nodes=srvcntgpu[005-008]
    PriorityJobFactor=20 PriorityTier=20 RootOnly=NO ReqResv=NO OverSubscribe=FORCE:1
    OverTimeLimit=NONE PreemptMode=REQUEUE
    State=UP TotalCPUs=128 TotalNodes=4 SelectTypeParameters=NONE
    DefMemPerCPU=4000 MaxMemPerCPU=4000
 

WORKER NODE STATUS
NodeName=srvcnthpc100 Arch=x86_64 CoresPerSocket=20
   CPUAlloc=36 CPUErr=0 CPUTot=40 CPULoad=36.03
   AvailableFeatures=(null)
   ActiveFeatures=(null)
   Gres=chip:Gold:40
   NodeAddr=srvcnthpc100 NodeHostName=srvcnthpc100 Version=17.02
   OS=Linux RealMemory=384000 AllocMem=4392 FreeMem=380230 Sockets=2 Boards=1
   State=MIXED+DRAIN ThreadsPerCore=1 TmpDisk=0 Weight=1 Owner=N/A MCS_label=N/A
   Partitions=ucthimem 
   BootTime=2018-09-21T15:34:03 SlurmdStartTime=2018-09-21T15:38:16
   CfgTRES=cpu=40,mem=375G
   AllocTRES=cpu=36,mem=4392M
   CapWatts=n/a
   CurrentWatts=0 LowestJoules=0 ConsumedJoules=0
   ExtSensorsJoules=n/s ExtSensorsWatts=0 ExtSensorsTemp=n/s
   Reason=patch [alewis@2018-09-23T13:47:41]
      4302 ucthimem WRD_0025 mnyber00 R 2-16:11:17 srvcnthpc100
      4303 ucthimem WRD_0026 mnyber00 R 2-16:11:17 srvcnthpc100
      4304 ucthimem WRD_0027 mnyber00 R 2-16:11:17 srvcnthpc100
      4305 ucthimem WRD_0028 mnyber00 R 2-16:11:17 srvcnthpc100
      4306 ucthimem WRD_0029 mnyber00 R 2-16:11:17 srvcnthpc100
      4307 ucthimem WRD_0030 mnyber00 R 2-16:11:17 srvcnthpc100

NodeName=srvcnthpc101 Arch=x86_64 CoresPerSocket=20
   CPUAlloc=30 CPUErr=0 CPUTot=40 CPULoad=30.01
   AvailableFeatures=(null)
   ActiveFeatures=(null)
   Gres=chip:Gold:40
   NodeAddr=srvcnthpc101 NodeHostName=srvcnthpc101 Version=17.02
   OS=Linux RealMemory=384000 AllocMem=3660 FreeMem=371876 Sockets=2 Boards=1
   State=MIXED+DRAIN ThreadsPerCore=1 TmpDisk=0 Weight=1 Owner=N/A MCS_label=N/A
   Partitions=ucthimem 
   BootTime=2018-09-04T14:10:08 SlurmdStartTime=2018-09-04T14:13:26
   CfgTRES=cpu=40,mem=375G
   AllocTRES=cpu=30,mem=3660M
   CapWatts=n/a
   CurrentWatts=0 LowestJoules=0 ConsumedJoules=0
   ExtSensorsJoules=n/s ExtSensorsWatts=0 ExtSensorsTemp=n/s
   Reason=patch [alewis@2018-09-23T13:47:44]
      4317 ucthimem WRD_0040 mnyber00 R 22:12:49 srvcnthpc101
      4315 ucthimem WRD_0038 mnyber00 R 1-23:20:34 srvcnthpc101
      4313 ucthimem WRD_0036 mnyber00 R 2-03:11:36 srvcnthpc101
      4310 ucthimem WRD_0033 mnyber00 R 2-09:37:45 srvcnthpc101
      4308 ucthimem WRD_0031 mnyber00 R 2-11:33:28 srvcnthpc101

NodeName=srvcnthpc102 Arch=x86_64 CoresPerSocket=20
   CPUAlloc=30 CPUErr=0 CPUTot=40 CPULoad=30.01
   AvailableFeatures=(null)
   ActiveFeatures=(null)
   Gres=chip:Gold:40
   NodeAddr=srvcnthpc102 NodeHostName=srvcnthpc102 Version=17.02
   OS=Linux RealMemory=384000 AllocMem=3660 FreeMem=376206 Sockets=2 Boards=1
   State=MIXED+DRAIN ThreadsPerCore=1 TmpDisk=0 Weight=1 Owner=N/A MCS_label=N/A
   Partitions=ucthimem 
   BootTime=2018-08-31T14:04:54 SlurmdStartTime=2018-09-17T11:06:10
   CfgTRES=cpu=40,mem=375G
   AllocTRES=cpu=30,mem=3660M
   CapWatts=n/a
   CurrentWatts=0 LowestJoules=0 ConsumedJoules=0
   ExtSensorsJoules=n/s ExtSensorsWatts=0 ExtSensorsTemp=n/s
   Reason=patch [alewis@2018-09-23T13:47:47]
      4316 ucthimem WRD_0039 mnyber00 R 22:14:36 srvcnthpc102
      4314 ucthimem WRD_0037 mnyber00 R 2-00:42:54 srvcnthpc102
      4312 ucthimem WRD_0035 mnyber00 R 2-04:53:21 srvcnthpc102
      4311 ucthimem WRD_0034 mnyber00 R 2-08:37:33 srvcnthpc102
      4309 ucthimem WRD_0032 mnyber00 R 2-09:56:31 srvcnthpc102

NodeName=srvcnthpc406 Arch=x86_64 CoresPerSocket=4
   CPUAlloc=0 CPUErr=0 CPUTot=8 CPULoad=0.01
   AvailableFeatures=(null)
   ActiveFeatures=(null)
   Gres=chip:G6:8
   NodeAddr=srvcnthpc406 NodeHostName=srvcnthpc406 Version=17.02
   OS=Linux RealMemory=32000 AllocMem=0 FreeMem=46747 Sockets=2 Boards=1
   State=IDLE ThreadsPerCore=1 TmpDisk=0 Weight=1 Owner=N/A MCS_label=N/A
   Partitions=uctlomem 
   BootTime=2018-09-16T12:51:16 SlurmdStartTime=2018-09-16T18:29:27
   CfgTRES=cpu=8,mem=32000M
   AllocTRES=
   CapWatts=n/a
   CurrentWatts=0 LowestJoules=0 ConsumedJoules=0
   ExtSensorsJoules=n/s ExtSensorsWatts=0 ExtSensorsTemp=n/s

NodeName=srvcnthpc407 Arch=x86_64 CoresPerSocket=4
   CPUAlloc=0 CPUErr=0 CPUTot=8 CPULoad=0.01
   AvailableFeatures=(null)
   ActiveFeatures=(null)
   Gres=chip:G6:8
   NodeAddr=srvcnthpc407 NodeHostName=srvcnthpc407 Version=17.02
   OS=Linux RealMemory=48000 AllocMem=0 FreeMem=46772 Sockets=2 Boards=1
   State=IDLE ThreadsPerCore=1 TmpDisk=0 Weight=1 Owner=N/A MCS_label=N/A
   Partitions=uctlomem 
   BootTime=2018-09-16T12:50:44 SlurmdStartTime=2018-09-16T18:30:25
   CfgTRES=cpu=8,mem=48000M
   AllocTRES=
   CapWatts=n/a
   CurrentWatts=0 LowestJoules=0 ConsumedJoules=0
   ExtSensorsJoules=n/s ExtSensorsWatts=0 ExtSensorsTemp=n/s

NodeName=srvcnthpc409 Arch=x86_64 CoresPerSocket=4
   CPUAlloc=0 CPUErr=0 CPUTot=8 CPULoad=0.01
   AvailableFeatures=(null)
   ActiveFeatures=(null)
   Gres=chip:G1:8
   NodeAddr=srvcnthpc409 NodeHostName=srvcnthpc409 Version=17.02
   OS=Linux RealMemory=32000 AllocMem=0 FreeMem=30404 Sockets=2 Boards=1
   State=IDLE ThreadsPerCore=1 TmpDisk=0 Weight=1 Owner=N/A MCS_label=N/A
   Partitions=uctlomem 
   BootTime=2018-09-16T08:34:24 SlurmdStartTime=2018-09-16T18:30:51
   CfgTRES=cpu=8,mem=32000M
   AllocTRES=
   CapWatts=n/a
   CurrentWatts=0 LowestJoules=0 ConsumedJoules=0
   ExtSensorsJoules=n/s ExtSensorsWatts=0 ExtSensorsTemp=n/s

NodeName=srvcnthpc410 Arch=x86_64 CoresPerSocket=4
   CPUAlloc=0 CPUErr=0 CPUTot=8 CPULoad=0.02
   AvailableFeatures=(null)
   ActiveFeatures=(null)
   Gres=chip:G1:8
   NodeAddr=srvcnthpc410 NodeHostName=srvcnthpc410 Version=17.02
   OS=Linux RealMemory=32000 AllocMem=0 FreeMem=30878 Sockets=2 Boards=1
   State=IDLE ThreadsPerCore=1 TmpDisk=0 Weight=1 Owner=N/A MCS_label=N/A
   Partitions=uctlomem 
   BootTime=2018-09-16T12:50:14 SlurmdStartTime=2018-09-16T18:31:46
   CfgTRES=cpu=8,mem=32000M
   AllocTRES=
   CapWatts=n/a
   CurrentWatts=0 LowestJoules=0 ConsumedJoules=0
   ExtSensorsJoules=n/s ExtSensorsWatts=0 ExtSensorsTemp=n/s

NodeName=srvcnthpc411 Arch=x86_64 CoresPerSocket=4
   CPUAlloc=0 CPUErr=0 CPUTot=8 CPULoad=0.02
   AvailableFeatures=(null)
   ActiveFeatures=(null)
   Gres=chip:G1:8
   NodeAddr=srvcnthpc411 NodeHostName=srvcnthpc411 Version=17.02
   OS=Linux RealMemory=32000 AllocMem=0 FreeMem=30901 Sockets=2 Boards=1
   State=IDLE ThreadsPerCore=1 TmpDisk=0 Weight=1 Owner=N/A MCS_label=N/A
   Partitions=uctlomem 
   BootTime=2018-09-16T12:49:44 SlurmdStartTime=2018-09-16T18:32:07
   CfgTRES=cpu=8,mem=32000M
   AllocTRES=
   CapWatts=n/a
   CurrentWatts=0 LowestJoules=0 ConsumedJoules=0
   ExtSensorsJoules=n/s ExtSensorsWatts=0 ExtSensorsTemp=n/s

NodeName=srvcnthpc412 Arch=x86_64 CoresPerSocket=4
   CPUAlloc=0 CPUErr=0 CPUTot=8 CPULoad=0.01
   AvailableFeatures=(null)
   ActiveFeatures=(null)
   Gres=chip:G1:8
   NodeAddr=srvcnthpc412 NodeHostName=srvcnthpc412 Version=17.02
   OS=Linux RealMemory=32000 AllocMem=0 FreeMem=30900 Sockets=2 Boards=1
   State=IDLE ThreadsPerCore=1 TmpDisk=0 Weight=1 Owner=N/A MCS_label=N/A
   Partitions=uctlomem 
   BootTime=2018-09-16T12:50:13 SlurmdStartTime=2018-09-16T18:32:26
   CfgTRES=cpu=8,mem=32000M
   AllocTRES=
   CapWatts=n/a
   CurrentWatts=0 LowestJoules=0 ConsumedJoules=0
   ExtSensorsJoules=n/s ExtSensorsWatts=0 ExtSensorsTemp=n/s

NodeName=srvcnthpc413 Arch=x86_64 CoresPerSocket=4
   CPUAlloc=0 CPUErr=0 CPUTot=8 CPULoad=0.01
   AvailableFeatures=(null)
   ActiveFeatures=(null)
   Gres=chip:G1:8
   NodeAddr=srvcnthpc413 NodeHostName=srvcnthpc413 Version=17.02
   OS=Linux RealMemory=32000 AllocMem=0 FreeMem=30868 Sockets=2 Boards=1
   State=IDLE ThreadsPerCore=1 TmpDisk=0 Weight=1 Owner=N/A MCS_label=N/A
   Partitions=uctlomem 
   BootTime=2018-09-16T12:49:15 SlurmdStartTime=2018-09-16T18:39:28
   CfgTRES=cpu=8,mem=32000M
   AllocTRES=
   CapWatts=n/a
   CurrentWatts=0 LowestJoules=0 ConsumedJoules=0
   ExtSensorsJoules=n/s ExtSensorsWatts=0 ExtSensorsTemp=n/s

NodeName=srvcnthpc414 Arch=x86_64 CoresPerSocket=4
   CPUAlloc=0 CPUErr=0 CPUTot=8 CPULoad=0.01
   AvailableFeatures=(null)
   ActiveFeatures=(null)
   Gres=chip:G1:8
   NodeAddr=srvcnthpc414 NodeHostName=srvcnthpc414 Version=17.02
   OS=Linux RealMemory=32000 AllocMem=0 FreeMem=30881 Sockets=2 Boards=1
   State=IDLE ThreadsPerCore=1 TmpDisk=0 Weight=1 Owner=N/A MCS_label=N/A
   Partitions=uctlomem 
   BootTime=2018-09-16T12:49:59 SlurmdStartTime=2018-09-16T18:32:47
   CfgTRES=cpu=8,mem=32000M
   AllocTRES=
   CapWatts=n/a
   CurrentWatts=0 LowestJoules=0 ConsumedJoules=0
   ExtSensorsJoules=n/s ExtSensorsWatts=0 ExtSensorsTemp=n/s

NodeName=srvcnthpc415 Arch=x86_64 CoresPerSocket=4
   CPUAlloc=0 CPUErr=0 CPUTot=8 CPULoad=0.01
   AvailableFeatures=(null)
   ActiveFeatures=(null)
   Gres=chip:G6:8
   NodeAddr=srvcnthpc415 NodeHostName=srvcnthpc415 Version=17.02
   OS=Linux RealMemory=31000 AllocMem=0 FreeMem=30750 Sockets=2 Boards=1
   State=IDLE ThreadsPerCore=1 TmpDisk=0 Weight=1 Owner=N/A MCS_label=N/A
   Partitions=uctlomem 
   BootTime=2018-09-16T12:50:44 SlurmdStartTime=2018-09-16T18:37:29
   CfgTRES=cpu=8,mem=31000M
   AllocTRES=
   CapWatts=n/a
   CurrentWatts=0 LowestJoules=0 ConsumedJoules=0
   ExtSensorsJoules=n/s ExtSensorsWatts=0 ExtSensorsTemp=n/s

NodeName=srvcnthpc416 Arch=x86_64 CoresPerSocket=4
   CPUAlloc=0 CPUErr=0 CPUTot=8 CPULoad=0.02
   AvailableFeatures=(null)
   ActiveFeatures=(null)
   Gres=chip:G6:8
   NodeAddr=srvcnthpc416 NodeHostName=srvcnthpc416 Version=17.02
   OS=Linux RealMemory=31000 AllocMem=0 FreeMem=30808 Sockets=2 Boards=1
   State=IDLE ThreadsPerCore=1 TmpDisk=0 Weight=1 Owner=N/A MCS_label=N/A
   Partitions=uctlomem 
   BootTime=2018-09-16T12:49:41 SlurmdStartTime=2018-09-16T18:35:46
   CfgTRES=cpu=8,mem=31000M
   AllocTRES=
   CapWatts=n/a
   CurrentWatts=0 LowestJoules=0 ConsumedJoules=0
   ExtSensorsJoules=n/s ExtSensorsWatts=0 ExtSensorsTemp=n/s

NodeName=srvcntgpu005 Arch=x86_64 CoresPerSocket=16
   CPUAlloc=32 CPUErr=0 CPUTot=32 CPULoad=30.98
   AvailableFeatures=(null)
   ActiveFeatures=(null)
   Gres=gpu:tesla:4
   NodeAddr=srvcntgpu005 NodeHostName=srvcntgpu005 Version=17.02
   OS=Linux RealMemory=128000 AllocMem=64000 FreeMem=121881 Sockets=2 Boards=1
   State=ALLOCATED+DRAIN ThreadsPerCore=1 TmpDisk=0 Weight=1 Owner=N/A MCS_label=N/A
   Partitions=GPUQ 
   BootTime=2018-09-05T11:21:32 SlurmdStartTime=2018-09-05T11:26:00
   CfgTRES=cpu=32,mem=125G
   AllocTRES=cpu=32,mem=62.50G
   CapWatts=n/a
   CurrentWatts=0 LowestJoules=0 ConsumedJoules=0
   ExtSensorsJoules=n/s ExtSensorsWatts=0 ExtSensorsTemp=n/s
   Reason=patch [alewis@2018-09-23T13:48:07]
      4329 GPUQ rEQ_pn3_ mkuttel R 2-22:07:18 srvcntgpu005

NodeName=srvcntgpu006 Arch=x86_64 CoresPerSocket=16
   CPUAlloc=0 CPUErr=0 CPUTot=32 CPULoad=0.03
   AvailableFeatures=(null)
   ActiveFeatures=(null)
   Gres=gpu:tesla:4
   NodeAddr=srvcntgpu006 NodeHostName=srvcntgpu006 Version=17.02
   OS=Linux RealMemory=128000 AllocMem=0 FreeMem=123472 Sockets=2 Boards=1
   State=IDLE+DRAIN ThreadsPerCore=1 TmpDisk=0 Weight=1 Owner=N/A MCS_label=N/A
   Partitions=GPUQ 
   BootTime=2018-09-06T11:01:43 SlurmdStartTime=2018-09-06T11:32:56
   CfgTRES=cpu=32,mem=125G
   AllocTRES=
   CapWatts=n/a
   CurrentWatts=0 LowestJoules=0 ConsumedJoules=0
   ExtSensorsJoules=n/s ExtSensorsWatts=0 ExtSensorsTemp=n/s
   Reason=patch [alewis@2018-09-23T13:48:10]

NodeName=srvcntgpu007 Arch=x86_64 CoresPerSocket=16
   CPUAlloc=0 CPUErr=0 CPUTot=32 CPULoad=0.02
   AvailableFeatures=(null)
   ActiveFeatures=(null)
   Gres=gpu:tesla:4
   NodeAddr=srvcntgpu007 NodeHostName=srvcntgpu007 Version=17.02
   OS=Linux RealMemory=128000 AllocMem=0 FreeMem=121919 Sockets=2 Boards=1
   State=IDLE+DRAIN ThreadsPerCore=1 TmpDisk=0 Weight=1 Owner=N/A MCS_label=N/A
   Partitions=GPUQ 
   BootTime=2018-09-10T10:50:22 SlurmdStartTime=2018-09-10T11:18:56
   CfgTRES=cpu=32,mem=125G
   AllocTRES=
   CapWatts=n/a
   CurrentWatts=0 LowestJoules=0 ConsumedJoules=0
   ExtSensorsJoules=n/s ExtSensorsWatts=0 ExtSensorsTemp=n/s
   Reason=patch [alewis@2018-09-23T13:48:13]

NodeName=srvcntgpu008 Arch=x86_64 CoresPerSocket=16
   CPUAlloc=0 CPUErr=0 CPUTot=32 CPULoad=0.01
   AvailableFeatures=(null)
   ActiveFeatures=(null)
   Gres=gpu:tesla:4
   NodeAddr=srvcntgpu008 NodeHostName=srvcntgpu008 Version=17.02
   OS=Linux RealMemory=128000 AllocMem=0 FreeMem=123650 Sockets=2 Boards=1
   State=IDLE ThreadsPerCore=1 TmpDisk=0 Weight=1 Owner=N/A MCS_label=N/A
   Partitions=GPUQ 
   BootTime=2018-09-04T11:02:46 SlurmdStartTime=2018-09-04T13:56:24
   CfgTRES=cpu=32,mem=125G
   AllocTRES=
   CapWatts=n/a
   CurrentWatts=0 LowestJoules=0 ConsumedJoules=0
   ExtSensorsJoules=n/s ExtSensorsWatts=0 ExtSensorsTemp=n/s