How to Use Ceph Storage on Proxmox

  • Post author:WunderTech
  • Post published:May 10, 2024
  • Post last modified:May 10, 2024
  • Post category:Proxmox
  • Reading time:5 mins read

Share what you're reading!

If you’re a Proxmox user and you’re interested in distributed storage, Ceph storage on Proxmox is most likely your best option. It functions extremely well with high availability and is scalable. Ceph can handle large amounts of data, is self-healing, and can help protect your VMs and Containers in the event of a hardware failure. This will be a quick look at how you can configure Ceph storage on Proxmox.

Benefits of Using Ceph with Proxmox

There are a few benefits that you’ll have if you decide to use Ceph storage on Proxmox.

  • Scalability: The storage is distributed which allows you to scale out your storage as your needs grow, without downtime.
  • High Availability: Ceph ensures that your data is always available, even if some of the storage nodes fail.
  • Cost-Effectiveness: You can build a Ceph cluster without the need for expensive proprietary storage solutions.
  • Flexibility: Ceph supports block, object, and file storage.

With that said, it’s recommended by Proxmox to use at least a 10 Gb network infrastructure. Keep in mind this is suggested and not required and I was able to get it working well on a 1 Gb test environment, but that doesn’t mean it’ll function as well as it probably should.

Setting Up Ceph on Proxmox

Setting up Ceph on Proxmox is extremely easy, however, you must have storage available that hasn’t been configured yet. If you’re using High Availability, you’d want to set this up on each node in the Proxmox cluster.

1. Open your Proxmox host and select Ceph inside of the Node. On mine, I’ll configure it on all three nodes since I’m planning on using this with high availability. Select Install Ceph.

select install ceph

2. Make sure the No-subscription repository is selected, select the Ceph version you’d like to use, then select Start installation.

selecting the no subscription repository

3. Enter yes to continue with the Ceph installation.

entering yes to install

4. In the Configuration section, select the Public Network and Cluster Network you’d like to use.

adding the public and cluster IP

5. Select OSD and then select the Disk you’d like to use for Ceph.

creating OSD storage.

6. Create OSD storage on each of your node(s) if you’d like to use it with High Availability. Then, in the Monitor tab, create a monitor for each node.

7. In the Pools section, create a new Ceph Pool.

creating the ceph storage on proxmox.

8. Moving forward, when creating your VM or Container, you can select the Ceph storage pool that was created and it’ll automatically use the storage we configured.

Conclusion & Final Thoughts

Combining Proxmox with Ceph storage offers powerful, scalable, and resilient storage for your Proxmox server. It’s recommended by the Proxmox team to use Ceph storage with at least a 10Gb network infrastructure, but that’s not to say it’s mandatory. Assess your Proxmox server as well as the requirements you have to determine if it’s an option for you.