Fri Dec 8 08:47:13 2017 +-----------------------------------------------------------------------------+ | NVIDIA-SMI 384.90 Driver Version: 384.90 | |-------------------------------+----------------------+----------------------+ | GPU Name Persistence-M| Bus-Id Disp.A | Volatile Uncorr. ECC | | Fan Temp Perf Pwr:Usage/Cap| Memory-Usage | GPU-Util Compute M. | |===============================+======================+======================| | 0 GeForce GTX 108... On | 00000000:04:00.0 Off | N/A | | 23% 28C P8 8W / 250W | 10MiB / 11172MiB | 0% Default | +-------------------------------+----------------------+----------------------+ | 1 GeForce GTX 108... On | 00000000:05:00.0 Off | N/A | | 23% 26C P8 8W / 250W | 10MiB / 11172MiB | 0% Default | +-------------------------------+----------------------+----------------------+ | 2 GeForce GTX 108... On | 00000000:08:00.0 Off | N/A | | 36% 61C P2 123W / 250W | 2131MiB / 11172MiB | 57% Default | +-------------------------------+----------------------+----------------------+ | 3 GeForce GTX 108... On | 00000000:09:00.0 Off | N/A | | 39% 65C P2 126W / 250W | 2247MiB / 11172MiB | 57% Default | +-------------------------------+----------------------+----------------------+ | 4 Quadro GP100 On | 00000000:84:00.0 Off | Off | | 38% 55C P0 98W / 235W | 2209MiB / 16273MiB | 61% Default | +-------------------------------+----------------------+----------------------+ | 5 Tesla V100-PCIE... On | 00000000:85:00.0 Off | 0 | | N/A 38C P0 35W / 250W | 436MiB / 16152MiB | 0% Default | +-------------------------------+----------------------+----------------------+ | 6 GeForce GTX 108... On | 00000000:88:00.0 Off | N/A | | 29% 51C P2 129W / 250W | 2211MiB / 11172MiB | 56% Default | +-------------------------------+----------------------+----------------------+ | 7 Quadro GP100 On | 00000000:89:00.0 Off | Off | | 37% 54C P0 100W / 235W | 2227MiB / 16273MiB | 62% Default | +-------------------------------+----------------------+----------------------+ +-----------------------------------------------------------------------------+ | Processes: GPU Memory | | GPU PID Type Process name Usage | |=============================================================================| | 2 6588 C HDAtomNNP-Trainer 2121MiB | | 3 6592 C HDAtomNNP-Trainer 2237MiB | | 4 6596 C HDAtomNNP-Trainer 2199MiB | | 5 1901 C /usr/bin/python 426MiB | | 6 6594 C HDAtomNNP-Trainer 2201MiB | | 7 6591 C HDAtomNNP-Trainer 2217MiB | +-----------------------------------------------------------------------------+ JAC_PRODUCTION_NVE - 23,558 atoms PME 4fs - SHORT RUN ----------------------------------------- [0] 1 x GPU: Note: The following floating-point exceptions are signalling: IEEE_UNDERFLOW_FLAG IEEE_DENORMAL | ns/day = 927.94 seconds/ns = 93.11 Fri Dec 8 08:48:48 2017 +-----------------------------------------------------------------------------+ | NVIDIA-SMI 384.90 Driver Version: 384.90 | |-------------------------------+----------------------+----------------------+ | GPU Name Persistence-M| Bus-Id Disp.A | Volatile Uncorr. ECC | | Fan Temp Perf Pwr:Usage/Cap| Memory-Usage | GPU-Util Compute M. | |===============================+======================+======================| | 0 GeForce GTX 108... On | 00000000:04:00.0 Off | N/A | | 23% 28C P8 8W / 250W | 10MiB / 11172MiB | 0% Default | +-------------------------------+----------------------+----------------------+ | 1 GeForce GTX 108... On | 00000000:05:00.0 Off | N/A | | 23% 26C P8 7W / 250W | 10MiB / 11172MiB | 0% Default | +-------------------------------+----------------------+----------------------+ | 2 GeForce GTX 108... On | 00000000:08:00.0 Off | N/A | | 36% 61C P2 126W / 250W | 2131MiB / 11172MiB | 55% Default | +-------------------------------+----------------------+----------------------+ | 3 GeForce GTX 108... On | 00000000:09:00.0 Off | N/A | | 38% 65C P2 123W / 250W | 2247MiB / 11172MiB | 48% Default | +-------------------------------+----------------------+----------------------+ | 4 Quadro GP100 On | 00000000:84:00.0 Off | Off | | 38% 55C P0 91W / 235W | 2209MiB / 16273MiB | 57% Default | +-------------------------------+----------------------+----------------------+ | 5 Tesla V100-PCIE... On | 00000000:85:00.0 Off | 0 | | N/A 46C P0 43W / 250W | 436MiB / 16152MiB | 7% Default | +-------------------------------+----------------------+----------------------+ | 6 GeForce GTX 108... On | 00000000:88:00.0 Off | N/A | | 29% 51C P2 127W / 250W | 2211MiB / 11172MiB | 53% Default | +-------------------------------+----------------------+----------------------+ | 7 Quadro GP100 On | 00000000:89:00.0 Off | Off | | 37% 55C P0 100W / 235W | 2227MiB / 16273MiB | 55% Default | +-------------------------------+----------------------+----------------------+ +-----------------------------------------------------------------------------+ | Processes: GPU Memory | | GPU PID Type Process name Usage | |=============================================================================| | 2 6588 C HDAtomNNP-Trainer 2121MiB | | 3 6592 C HDAtomNNP-Trainer 2237MiB | | 4 6596 C HDAtomNNP-Trainer 2199MiB | | 5 1901 C /usr/bin/python 426MiB | | 6 6594 C HDAtomNNP-Trainer 2201MiB | | 7 6591 C HDAtomNNP-Trainer 2217MiB | +-----------------------------------------------------------------------------+ JAC_PRODUCTION_NVE - 23,558 atoms PME 4fs - LONG RUN ----------------------------------------- [0] 1 x GPU: Note: The following floating-point exceptions are signalling: IEEE_UNDERFLOW_FLAG IEEE_DENORMAL | ns/day = 934.01 seconds/ns = 92.50 Fri Dec 8 09:04:15 2017 +-----------------------------------------------------------------------------+ | NVIDIA-SMI 384.90 Driver Version: 384.90 | |-------------------------------+----------------------+----------------------+ | GPU Name Persistence-M| Bus-Id Disp.A | Volatile Uncorr. ECC | | Fan Temp Perf Pwr:Usage/Cap| Memory-Usage | GPU-Util Compute M. | |===============================+======================+======================| | 0 GeForce GTX 108... On | 00000000:04:00.0 Off | N/A | | 23% 30C P8 8W / 250W | 10MiB / 11172MiB | 0% Default | +-------------------------------+----------------------+----------------------+ | 1 GeForce GTX 108... On | 00000000:05:00.0 Off | N/A | | 23% 27C P8 8W / 250W | 10MiB / 11172MiB | 0% Default | +-------------------------------+----------------------+----------------------+ | 2 GeForce GTX 108... On | 00000000:08:00.0 Off | N/A | | 36% 63C P2 131W / 250W | 2131MiB / 11172MiB | 50% Default | +-------------------------------+----------------------+----------------------+ | 3 GeForce GTX 108... On | 00000000:09:00.0 Off | N/A | | 39% 67C P2 131W / 250W | 2247MiB / 11172MiB | 46% Default | +-------------------------------+----------------------+----------------------+ | 4 Quadro GP100 On | 00000000:84:00.0 Off | Off | | 40% 57C P0 100W / 235W | 2209MiB / 16273MiB | 60% Default | +-------------------------------+----------------------+----------------------+ | 5 Tesla V100-PCIE... On | 00000000:85:00.0 Off | 0 | | N/A 50C P0 44W / 250W | 436MiB / 16152MiB | 7% Default | +-------------------------------+----------------------+----------------------+ | 6 GeForce GTX 108... On | 00000000:88:00.0 Off | N/A | | 30% 53C P2 106W / 250W | 2185MiB / 11172MiB | 45% Default | +-------------------------------+----------------------+----------------------+ | 7 Quadro GP100 On | 00000000:89:00.0 Off | Off | | 39% 56C P0 101W / 235W | 2227MiB / 16273MiB | 60% Default | +-------------------------------+----------------------+----------------------+ +-----------------------------------------------------------------------------+ | Processes: GPU Memory | | GPU PID Type Process name Usage | |=============================================================================| | 2 6588 C HDAtomNNP-Trainer 2121MiB | | 3 6592 C HDAtomNNP-Trainer 2237MiB | | 4 6596 C HDAtomNNP-Trainer 2199MiB | | 5 1901 C /usr/bin/python 426MiB | | 6 6594 C HDAtomNNP-Trainer 2175MiB | | 7 6591 C HDAtomNNP-Trainer 2217MiB | +-----------------------------------------------------------------------------+ JAC_PRODUCTION_NVE - 23,558 atoms PME 4fs - SHORT RUN ----------------------------------------- [0] 1 x GPU: Note: The following floating-point exceptions are signalling: IEEE_UNDERFLOW_FLAG IEEE_DENORMAL | ns/day = 929.69 seconds/ns = 92.93 Fri Dec 8 09:05:49 2017 +-----------------------------------------------------------------------------+ | NVIDIA-SMI 384.90 Driver Version: 384.90 | |-------------------------------+----------------------+----------------------+ | GPU Name Persistence-M| Bus-Id Disp.A | Volatile Uncorr. ECC | | Fan Temp Perf Pwr:Usage/Cap| Memory-Usage | GPU-Util Compute M. | |===============================+======================+======================| | 0 GeForce GTX 108... On | 00000000:04:00.0 Off | N/A | | 23% 30C P8 8W / 250W | 10MiB / 11172MiB | 0% Default | +-------------------------------+----------------------+----------------------+ | 1 GeForce GTX 108... On | 00000000:05:00.0 Off | N/A | | 23% 27C P8 8W / 250W | 10MiB / 11172MiB | 0% Default | +-------------------------------+----------------------+----------------------+ | 2 GeForce GTX 108... On | 00000000:08:00.0 Off | N/A | | 36% 62C P2 103W / 250W | 2131MiB / 11172MiB | 29% Default | +-------------------------------+----------------------+----------------------+ | 3 GeForce GTX 108... On | 00000000:09:00.0 Off | N/A | | 39% 67C P2 131W / 250W | 2247MiB / 11172MiB | 55% Default | +-------------------------------+----------------------+----------------------+ | 4 Quadro GP100 On | 00000000:84:00.0 Off | Off | | 40% 57C P0 96W / 235W | 2209MiB / 16273MiB | 58% Default | +-------------------------------+----------------------+----------------------+ | 5 Tesla V100-PCIE... On | 00000000:85:00.0 Off | 0 | | N/A 49C P0 44W / 250W | 436MiB / 16152MiB | 3% Default | +-------------------------------+----------------------+----------------------+ | 6 GeForce GTX 108... On | 00000000:88:00.0 Off | N/A | | 30% 53C P2 133W / 250W | 2119MiB / 11172MiB | 57% Default | +-------------------------------+----------------------+----------------------+ | 7 Quadro GP100 On | 00000000:89:00.0 Off | Off | | 39% 56C P0 103W / 235W | 2227MiB / 16273MiB | 57% Default | +-------------------------------+----------------------+----------------------+ +-----------------------------------------------------------------------------+ | Processes: GPU Memory | | GPU PID Type Process name Usage | |=============================================================================| | 2 6588 C HDAtomNNP-Trainer 2121MiB | | 3 6592 C HDAtomNNP-Trainer 2237MiB | | 4 6596 C HDAtomNNP-Trainer 2199MiB | | 5 1901 C /usr/bin/python 426MiB | | 6 6594 C HDAtomNNP-Trainer 2109MiB | | 7 6591 C HDAtomNNP-Trainer 2217MiB | +-----------------------------------------------------------------------------+