1 rack is a recipe for failure, you need to split, even without that consider

  how many SSD's you need.
  power usage for all those SSD's
  inter-site connectivity (need to keep transferring data between the sites otherwise customers are going to be very surprised.
  maintenance and software costs (at the colo level)

All these add up, closer to $50K than some $2K (LOL). The way you guys (below) are talking, this is not some home server that serves personal videos. It runs (some) business operations for thousands of small/medium companies.

I've talked about 2 racks in different datacenters for 10k not 2k total. As you seem to like LLM here's the answer for a 50k colo

For $50,000/month in the USA, you could likely secure:

    Multiple full cabinets (approximately 10-12 cabinets)
    Higher power allocation (50-60kW total)
    Extensive bandwidth packages with multiple high-capacity connections

This seems both on the space of 10 full racks and 50kw power extensive.

I'm open to more details from you on why 50k is reasonable.

The power must be way less especially without spinning drives.