Deploy and own NVIDIA H200 servers

Hopper with 141 GB of memory per GPU. Proven, lower power, and quick to ship.

HGX H200 at a glance

GPUs
8x NVIDIA H200 (Hopper) with NVLink
GPU memory
141 GB per GPU, 1.1 TB per server
CPUs
2x Intel Xeon or AMD EPYC
Networking
Usually 8x ConnectX-7 at 400 Gb/s
Form factor
Air-cooled, typically 8U
Power
About 10 kW per server
Ballpark price
$340K per server

Availability

H200 is the easiest current GPU to get, and servers usually ship in weeks. At about 10 kW, they also fit more data centers.

What you need to run H200s

  • Power

    About 10 kW per server. Most high-density data centers can host them.

  • Networking

    For a cluster, a 400G network of switches, optics, and cables.

  • Compliance

    NVIDIA’s partners check the buyer, the site, and the use before they ship.

  • Setup

    Racking, cabling, and testing before handover.

We guide. You decide.

  1. Scope it

    Tell us your workload, budget, and timeline. You get a plan and ballpark costs.

    One call

  2. We build it

    We compare vendors and data centers side by side. You pick, and we handle the rest in your name.

    60-90 days typically

  3. We run it

    Monitoring, repairs, and warranty claims, on an annual contract.

    Ongoing

What it costs

We take no cut of your hardware or data center. Brokers often earn a percentage of what you spend. We charge flat fees, so a better price only saves you money.

Paid to vendors, in your name

  • Hardware

    Servers, networking, and shipping. Paid to the vendor, with nothing added.

  • Colocation

    Space, power, and cooling, usually on a 3-year contract. Paid to the data center.

Paid to us, flat

  • Setup fee

    $25K for 1-7 servers. Half at signing, half when live. Custom pricing for 8 or more.

  • Management fee

    From $1K a month per 4 servers. Covers monitoring, repairs, and warranty claims.

Want a customer for the GPUs? We charge 2.5% of the contract, only if it signs.

Ballpark: one B300 server (8 GPUs)

The server
$550-650K
Shipping
$2,500
Data center
$4-5K a month
Our setup fee
$25K
Our management fee
$1K a month

A cluster also needs networking, about $50-70K per server.

Don’t want to pay for the hardware all at once?

  • Put in half yourself, and we can usually introduce a lender for the other half.
  • Lenders want to see cash or funding of 1.5x the hardware cost. For a $550K server, you put in $275K, the lender covers $275K, and you show $825K.

Tell us what you’re planning.

  • A call with our CTO about what you need
  • Ballpark costs and timelines for your budget
  • A straight answer if it’s not a fit

Prefer email? hello@amcompute.com

NVIDIA H200 servers: questions

How much does an H200 server cost?
Ballpark $340K for a new 8-GPU server, before networking, shipping, and the data center.
H200 or B200?
H200 costs less, draws less power, and ships sooner. B200 has more memory and much more compute.
HGX H200 or H200 NVL?
HGX H200 links all eight GPUs with NVLink, and it’s what we deploy for clusters. H200 NVL is a PCIe card version.
Is H200 still worth buying?
For inference on models that fit its memory, yes. The software is mature and resale values have held up.

Further reading

More hardware and hosting

Who it’s for

Want H200s of your own? We’ll run them.

Plan a deployment