Skip to content

002: HW Validation List

KaiGai Kohei edited this page Oct 27, 2021 · 14 revisions

Summary

This note shares the list of validated hardware configurations. Note that our open source community never guarantee it works fine. This list just informs you the following hardware configuration passed the validation test sponsored by the provider. Please contact to the provider for shipping availability and commercial support.

List of supported GPU models

GPU Model Tested Architecture Bus CC # of SM RAM size Memory Band Memo
Tesla A100 Yes Ampere PCI-E 4.0 8.0 108 40GB HBM2e 1555GB/s
Tesla V100s Volta PCI-E 3.0 7.0 80 32GB HBM2 1133GB/s
Tesla V100 Yes Volta PCI-E 3.0 7.0 80 32GB HBM2 897GB/s
Tesla V100 Yes Volta PCI-E 3.0 7.0 80 16GB HBM2 897GB/s
Tesla P100 Yes Pascal PCI-E 3.0 6.0 56 16GB HBM2 732GB/s
Tesla P100 Pascal PCI-E 3.0 6.0 56 12GB HBM2 549GB/s
Tesla P40 Yes Pascal PCI-E 3.0 6.1 30 24GB GDDR5X 694GB/s

Except for the above models, device does not support GPUDirect RDMA or does not provide enough space of PCI-E Bar1 area; that is a basis of GPUDirect SQL.

As long as you don't use GPUDirect SQL, PG-Strom may be workable on the GPU devices at Pascal or newer. But we don't have test and environment for reproduction on these devices. Please enjoy your own risks.

Hardware Validation List

This section shows a list of complete systems which we have validated.

Component List:

Type Parts Name # of items Memo
Chassis AS-2014CS-TR 1 2U Rack Server
CPU AMD EPYC 7402P(24C, 2.8GHz) 1
RAM DDR4-3200 16GB DIMM(ECC) 8 128GB in total
GPU NVIDIA A100 (PCI-E; 40GB) 1
SSD Intel D7-P5510 (U.2; 3.84TB) 4
N/W AIOM 2-port 10GBase-T 2
  • Installation Note
    • NVIDIA A100 GPU is installed on the rear slot-1
    • Internal NVME-slots are used for D7-P5510 SSD drives
  • Provider Info

Component List:

Type Parts Name # of items Memo
Chassis SYS-4029GP-TRT 1 4U Rack Server
CPU Intel Xeon Gold 6226 2 12C,24HT,2.7GHz
RAM DDR4-2933 16GB DIMM 12 192GB in total
GPU NVIDIA Tesla V100 4 5120C, 16GB/32GB, Volta
SSD Intel DC P4510 16 1.0TB, U.2
N/W Built-in 10Gb ethernet 2
  • Installation Note
    • NVIDIA Tesla V100 GPUs are installed on the slot 1,3,9 and 11 (x16)
    • PCIe direct attach host bus adopter cards are installed on the slot 2,4,8 and 10 (x16). HBA card host 4 of Intel DC P4510 SSDs for each.
  • Provider Info

Component List:

Type Parts Name # of items Memo
Chassis SYS-1019GP-TT 1 1U Rack Server
CPU Intel Xeon Gold 6126T 1 12C,24HT,2.6GHz
RAM DDR4-2666 32GB DIMM 6 192GB in total
GPU NVIDIA Tesla P40 1 3840C, 24GB, Pascal
SSD Intel DC P4600 3 2.0TB, HHHL
N/W Built-in 10Gb ethernet 2
  • Installation Note
    • NVIDIA Tesla P40 GPU is installed on the left PCIe slot (x16) from the rear.
    • Intel DC P4600 SSDs are installed on the center PCIe slot (x16), right upper/lower PCIe slot (x8) (by riser card) from the rear.
  • Provider Info

Software Support List

General Requirement

  • Operating System
    • Red Hat Enterprise Server 8.3 or later (x86_64)
    • CentOS 8.3 or later (x86_64)
  • CUDA Toolkit
    • NVIDIA CUDA Toolkit 11.5
  • PostgreSQL
    • PostgreSQL v11.x
    • PostgreSQL v12.x
    • PostgreSQL v13.x

FYI: NVMe-SSD models which we had run

This section shows a list of NVMe-SSD systems which we have tested in the past.

Vendor Model Form Capacity SeqRead [MB/s] PCIe Spec Memo
Intel D7-P5510 U.2 3.84TB 6500MB/s PCIe 4.0 x4
Intel DC P4510 U.2 1.0TB 2850MB/s PCIe 3.0 x4
Intel DC P4511 M.2 1.0TB 1950MB/s PCIe 3.0 x4 using carrier board
Intel DC P4600 HHHL 2.0TB 3200MB/s PCIe 3.0 x4
HGST SN260 HHHL 7.6TB 6100MB/s PCIe 3.0 x8
Samsung PRO 960SSD M.2 512GB 3500MB/s PCIe 3.0 x4 using carrier board
Intel 750 SSD HHHL 400GB 2200MB/s PCIe 3.0 x4