# Deploy and own NVIDIA H200 servers

Hopper with 141 GB of memory per GPU. Proven, lower power, and quick to ship.

## HGX H200 at a glance

- **GPUs:** 8x NVIDIA H200 (Hopper) with NVLink
- **GPU memory:** 141 GB per GPU, 1.1 TB per server
- **CPUs:** 2x Intel Xeon or AMD EPYC
- **Networking:** Usually 8x ConnectX-7 at 400 Gb/s
- **Form factor:** Air-cooled, typically 8U
- **Power:** About 10 kW per server
- **Ballpark price:** $340K per server

## Availability

H200 is the easiest current GPU to get, and servers usually ship in weeks. At about 10 kW, they also fit more data centers.

## What you need to run H200s

- **Power.** About 10 kW per server. Most high-density data centers can host them.
- **Networking.** For a cluster, a 400G network of switches, optics, and cables.
- **Compliance.** NVIDIA’s partners check the buyer, the site, and the use before they ship.
- **Setup.** Racking, cabling, and testing before handover.

## We guide. You decide.

1. **Scope it.** Tell us your workload, budget, and timeline. You get a plan and ballpark costs. One call.
2. **We build it.** We compare vendors and data centers side by side. You pick, and we handle the rest in your name. 60-90 days typically.
3. **We run it.** Monitoring, repairs, and warranty claims, on an annual contract. Ongoing.

## What it costs

We take no cut of your hardware or data center. Brokers often earn a percentage of what you spend. We charge flat fees, so a better price only saves you money.

### Paid to vendors, in your name

- **Hardware.** Servers, networking, and shipping. Paid to the vendor, with nothing added.
- **Colocation.** Space, power, and cooling, usually on a 3-year contract. Paid to the data center.

### Paid to us, flat

- **Setup fee.** $25K for 1-7 servers. Half at signing, half when live. Custom pricing for 8 or more.
- **Management fee.** From $1K a month per 4 servers. Covers monitoring, repairs, and warranty claims.

Want a customer for the GPUs? We charge 2.5% of the contract, only if it signs.

Ballpark: one B300 server (8 GPUs)

- **The server:** $550-650K
- **Shipping:** $2,500
- **Data center:** $4-5K a month
- **Our setup fee:** $25K
- **Our management fee:** $1K a month

A cluster also needs networking, about $50-70K per server.

**Don’t want to pay for the hardware all at once?**

- Put in half yourself, and we can usually [introduce a lender](https://gpulenders.com) for the other half.
- Lenders want to see cash or funding of 1.5x the hardware cost. For a $550K server, you put in $275K, the lender covers $275K, and you show $825K.

## Tell us what you’re planning.

- A call with our CTO about what you need
- Ballpark costs and timelines for your budget
- A straight answer if it’s not a fit

Prefer email? [hello@amcompute.com](mailto:hello@amcompute.com)

## NVIDIA H200 servers: questions

**How much does an H200 server cost?**

Ballpark $340K for a new 8-GPU server, before networking, shipping, and the data center.

**H200 or B200?**

H200 costs less, draws less power, and ships sooner. B200 has more memory and much more compute.

**HGX H200 or H200 NVL?**

HGX H200 links all eight GPUs with NVLink, and it’s what we deploy for clusters. H200 NVL is a PCIe card version.

**Is H200 still worth buying?**

For inference on models that fit its memory, yes. The software is mature and resale values have held up.

## Further reading

- [NVIDIA GPU differences, from Ampere to Blackwell](https://www.amcompute.com/blog/nvidia-gpu-generations)
- [SXM vs PCIe for GPU servers](https://www.amcompute.com/blog/sxm-vs-pcie)
- [Rack Report: monthly GPU resale prices](https://www.amcompute.com/rack-report)

## More hardware and hosting

- [NVIDIA B300 servers](https://managedgpus.com/b300) - Ballpark pricing, power, and lead times for HGX B300 servers.
- [NVIDIA B200 servers](https://managedgpus.com/b200) - Ballpark pricing, power, and availability for HGX B200 servers.
- [NVIDIA RTX PRO 6000 servers](https://managedgpus.com/rtx-pro-6000) - Ballpark pricing and power for RTX PRO 6000 servers, the lower-cost way in.
- [NVIDIA GB300 NVL72 racks](https://managedgpus.com/gb300-nvl72) - What it takes to own a liquid-cooled GB300 NVL72 rack.
- [GPU colocation](https://managedgpus.com/gpu-colocation) - A U.S. data center for the GPU servers you own.

## Who it’s for

- [AI startups](https://managedgpus.com/ai-startups) - Own your GPU servers instead of renting cloud GPUs.
- [Universities and research labs](https://managedgpus.com/research) - A private GPU cluster in your institution’s name, run for you.
- [Family offices and funds](https://managedgpus.com/family-offices) - Own GPU servers in your own entity and rent them to AI companies.
- [Individual investors](https://managedgpus.com/individual-investors) - Own one or a few GPU servers through your LLC, rented out and run for you.

## Want H200s of your own? We’ll run them.

[Plan a deployment](https://managedgpus.com/h200#discuss)

Source: https://managedgpus.com/h200