# Deploy and own NVIDIA RTX PRO 6000 servers

Blackwell with 96 GB per GPU at a fraction of the price. Air-cooled and quick to ship.

## RTX PRO 6000 server at a glance

- **GPUs:** 8x NVIDIA RTX PRO 6000 Blackwell Server Edition
- **GPU memory:** 96 GB GDDR7 per GPU, 768 GB per server
- **GPU link:** PCIe Gen 5, no NVLink
- **CPUs:** 2x Intel Xeon or AMD EPYC
- **Form factor:** Air-cooled, typically 4U-5U
- **Power:** About 6-7 kW per server
- **Ballpark price:** $100-150K per server

## Availability

Most server makers sell RTX PRO 6000 systems, and they usually ship in weeks. They draw about half the power of a B300 server, so far more data centers can host them.

## What you need to run RTX PRO 6000s

- **Power.** About 6-7 kW per server. Many standard data centers can host them.
- **Networking.** For a cluster, a 200G or 400G network. Simpler and cheaper than for B300s.
- **Compliance.** Vendors check the buyer, the site, and the use before they ship.
- **Setup.** Racking, cabling, and testing before handover.

## We guide. You decide.

1. **Scope it.** Tell us your workload, budget, and timeline. You get a plan and ballpark costs. One call.
2. **We build it.** We compare vendors and data centers side by side. You pick, and we handle the rest in your name. 60-90 days typically.
3. **We run it.** Monitoring, repairs, and warranty claims, on an annual contract. Ongoing.

## What it costs

We take no cut of your hardware or data center. Brokers often earn a percentage of what you spend. We charge flat fees, so a better price only saves you money.

### Paid to vendors, in your name

- **Hardware.** Servers, networking, and shipping. Paid to the vendor, with nothing added.
- **Colocation.** Space, power, and cooling, usually on a 3-year contract. Paid to the data center.

### Paid to us, flat

- **Setup fee.** $25K for 1-7 servers. Half at signing, half when live. Custom pricing for 8 or more.
- **Management fee.** From $1K a month per 4 servers. Covers monitoring, repairs, and warranty claims.

Want a customer for the GPUs? We charge 2.5% of the contract, only if it signs.

Ballpark: one B300 server (8 GPUs)

- **The server:** $550-650K
- **Shipping:** $2,500
- **Data center:** $4-5K a month
- **Our setup fee:** $25K
- **Our management fee:** $1K a month

A cluster also needs networking, about $50-70K per server.

**Don’t want to pay for the hardware all at once?**

- Put in half yourself, and we can usually [introduce a lender](https://gpulenders.com) for the other half.
- Lenders want to see cash or funding of 1.5x the hardware cost. For a $550K server, you put in $275K, the lender covers $275K, and you show $825K.

## Tell us what you’re planning.

- A call with our CTO about what you need
- Ballpark costs and timelines for your budget
- A straight answer if it’s not a fit

Prefer email? [hello@amcompute.com](mailto:hello@amcompute.com)

## NVIDIA RTX PRO 6000 servers: questions

**How much does an RTX PRO 6000 server cost?**

Ballpark $100-150K for a new 8-GPU server, before networking, shipping, and the data center.

**RTX PRO 6000 or H200?**

H200 has faster memory and NVLink, so it trains large models better. RTX PRO 6000 costs about a third as much and suits inference, fine-tuning, and graphics.

**Can you train models on RTX PRO 6000?**

Yes, for fine-tuning and smaller models. Without NVLink, large training runs across many GPUs are slower than on HGX servers.

**Does it need liquid cooling?**

No. The servers are air-cooled and draw about 6-7 kW each.

## Further reading

- [NVIDIA GPU differences, from Ampere to Blackwell](https://www.amcompute.com/blog/nvidia-gpu-generations)
- [SXM vs PCIe for GPU servers](https://www.amcompute.com/blog/sxm-vs-pcie)
- [Rack Report: monthly GPU resale prices](https://www.amcompute.com/rack-report)

## More hardware and hosting

- [NVIDIA B300 servers](https://managedgpus.com/b300) - Ballpark pricing, power, and lead times for HGX B300 servers.
- [NVIDIA B200 servers](https://managedgpus.com/b200) - Ballpark pricing, power, and availability for HGX B200 servers.
- [NVIDIA H200 servers](https://managedgpus.com/h200) - Ballpark pricing and availability for HGX H200 servers.
- [NVIDIA GB300 NVL72 racks](https://managedgpus.com/gb300-nvl72) - What it takes to own a liquid-cooled GB300 NVL72 rack.
- [GPU colocation](https://managedgpus.com/gpu-colocation) - A U.S. data center for the GPU servers you own.

## Who it’s for

- [AI startups](https://managedgpus.com/ai-startups) - Own your GPU servers instead of renting cloud GPUs.
- [Universities and research labs](https://managedgpus.com/research) - A private GPU cluster in your institution’s name, run for you.
- [Family offices and funds](https://managedgpus.com/family-offices) - Own GPU servers in your own entity and rent them to AI companies.
- [Individual investors](https://managedgpus.com/individual-investors) - Own one or a few GPU servers through your LLC, rented out and run for you.

## Want RTX PRO 6000s of your own? We’ll run them.

[Plan a deployment](https://managedgpus.com/rtx-pro-6000#discuss)

Source: https://managedgpus.com/rtx-pro-6000