Deploy and own NVIDIA RTX PRO 6000 servers
Blackwell with 96 GB per GPU at a fraction of the price. Air-cooled and quick to ship.
RTX PRO 6000 server at a glance
- GPUs
- 8x NVIDIA RTX PRO 6000 Blackwell Server Edition
- GPU memory
- 96 GB GDDR7 per GPU, 768 GB per server
- GPU link
- PCIe Gen 5, no NVLink
- CPUs
- 2x Intel Xeon or AMD EPYC
- Form factor
- Air-cooled, typically 4U-5U
- Power
- About 6-7 kW per server
- Ballpark price
- $100-150K per server
Availability
Most server makers sell RTX PRO 6000 systems, and they usually ship in weeks. They draw about half the power of a B300 server, so far more data centers can host them.
What you need to run RTX PRO 6000s
Power
About 6-7 kW per server. Many standard data centers can host them.
Networking
For a cluster, a 200G or 400G network. Simpler and cheaper than for B300s.
Compliance
Vendors check the buyer, the site, and the use before they ship.
Setup
Racking, cabling, and testing before handover.
We guide. You decide.
Scope it
Tell us your workload, budget, and timeline. You get a plan and ballpark costs.
One call
We build it
We compare vendors and data centers side by side. You pick, and we handle the rest in your name.
60-90 days typically
We run it
Monitoring, repairs, and warranty claims, on an annual contract.
Ongoing
What it costs
We take no cut of your hardware or data center. Brokers often earn a percentage of what you spend. We charge flat fees, so a better price only saves you money.
Paid to vendors, in your name
Hardware
Servers, networking, and shipping. Paid to the vendor, with nothing added.
Colocation
Space, power, and cooling, usually on a 3-year contract. Paid to the data center.
Paid to us, flat
Setup fee
$25K for 1-7 servers. Half at signing, half when live. Custom pricing for 8 or more.
Management fee
From $1K a month per 4 servers. Covers monitoring, repairs, and warranty claims.
Want a customer for the GPUs? We charge 2.5% of the contract, only if it signs.
Ballpark: one B300 server (8 GPUs)
- The server
- $550-650K
- Shipping
- $2,500
- Data center
- $4-5K a month
- Our setup fee
- $25K
- Our management fee
- $1K a month
A cluster also needs networking, about $50-70K per server.
Don’t want to pay for the hardware all at once?
- Put in half yourself, and we can usually introduce a lender for the other half.
- Lenders want to see cash or funding of 1.5x the hardware cost. For a $550K server, you put in $275K, the lender covers $275K, and you show $825K.
Tell us what you’re planning.
- A call with our CTO about what you need
- Ballpark costs and timelines for your budget
- A straight answer if it’s not a fit
Prefer email? hello@amcompute.com
NVIDIA RTX PRO 6000 servers: questions
- How much does an RTX PRO 6000 server cost?
- Ballpark $100-150K for a new 8-GPU server, before networking, shipping, and the data center.
- RTX PRO 6000 or H200?
- H200 has faster memory and NVLink, so it trains large models better. RTX PRO 6000 costs about a third as much and suits inference, fine-tuning, and graphics.
- Can you train models on RTX PRO 6000?
- Yes, for fine-tuning and smaller models. Without NVLink, large training runs across many GPUs are slower than on HGX servers.
- Does it need liquid cooling?
- No. The servers are air-cooled and draw about 6-7 kW each.
Further reading
More hardware and hosting
- NVIDIA B300 serversBallpark pricing, power, and lead times for HGX B300 servers.
- NVIDIA B200 serversBallpark pricing, power, and availability for HGX B200 servers.
- NVIDIA H200 serversBallpark pricing and availability for HGX H200 servers.
- NVIDIA GB300 NVL72 racksWhat it takes to own a liquid-cooled GB300 NVL72 rack.
- GPU colocationA U.S. data center for the GPU servers you own.
Who it’s for
- AI startupsOwn your GPU servers instead of renting cloud GPUs.
- Universities and research labsA private GPU cluster in your institution’s name, run for you.
- Family offices and fundsOwn GPU servers in your own entity and rent them to AI companies.
- Individual investorsOwn one or a few GPU servers through your LLC, rented out and run for you.
