Scalable Multi GPU
H100 SXM
Unlock unprecedented performance with the NVIDIA® H100 Tensor Core GPU in SXM form factor. Connect up to 256 GPUs for accelerated exascale workloads. Featuring a dedicated Transformer Engine, it boosts large language models (LLMs) by 30X. Enjoy over 80% increased memory bandwidth for enhanced efficiency.
AI-Powered Enterprise
Unprecedented Performance, Scalability and Security.
Transformational
AI Training
Fourth-generation Tensor Cores and a Transformer Engine with FP8 precision provide up to 4X faster training for GPT-3 (175B) models.
Real-Time
Deep Learning
Speed up all precisions, including FP64, TF32, FP32, FP16, INT8, and FP8 to reduce memory usage and increase performance.
Accelerated
Data Analytics
Accelerated servers with H100 provide over 3 TB/sec of memory bandwidth per GPU and scalability with NVIDIA® NVLink® and NVSwitch™.
Enterprise-Ready
Utilisation
H100 allows secure, end-to-end, multi-tenant usage, making it ideal for cloud service provider (CSP) environments.
Specifications
H100 SXM
| Form Factor | H100 SXM | |
|---|---|---|
| FP64 | 34 teraFLOPS | |
| FP64 Tensor Core | 67 teraFLOPS | |
| FP32 | 67 teraFLOPS | |
| TF32 Tensor Core | 989 teraFLOPS2 | |
| BFLOAT16 Tensor Core | 1,979 teraFLOPS2 | |
| FP16 Tensor Core | 1,979 teraFLOPS2 | |
| FP8 Tensor Core | 3,958 teraFLOPS2 | |
| INT8 Tensor Core | 3,958 TOPS2 | |
| GPU memory | 80GB | |
| GPU memory bandwidth | 3.35TB/s | |
| Decoders | 7 NVDEC 7 JPEG |
|
| Max thermal design power (TDP) | Up to 700W (configurable) | |
| Multi-Instance GPUs | Up to 7 MIGS @ 10GB each | |
| Form factor | SXM | |
| Interconnect | NVLink: 900GB/s PCIe Gen5: 128GB/s | |
| Server options | NVIDIA HGX H100 Partner and NVIDIA-Certified Systems™ with 4 or 8 GPUs NVIDIA DGX H100 with 8 GPUs | |
| NVIDIA AI Enterprise | Add-on | |
Your Trusted NVIDIA Partner
Upgrade your data centre with LUNIQ.
We provide our clients with a fully bespoke upgrade plan to ensure your business is ready for the next generation of AI-powered computing. Our experts have years of proven experience and will work with you at every step to make the process straightforward and easy.
Connect With One of Our Specialists
Unlock a new era of AI-powered computing
At LUNIQ, we ensure a seamless, value-driven integration tailored to your organisational needs.