Kuber.Host

Situation: Users should have persistent storage, it must be limited in space per user, distributed, and reliable.

I started with rook (ceph running in kubernetes cluster with dynamic provisioning), it was easy to start but I had some problems:

• sometimes it behaves unpredictable
• updates are hard
• restarting cluster take longer time because some pods can not start before rook is ready
• when rook is broken - monitoring is broken too (it uses persistent storage), so no alerts

Ceph itself is already complex, it requires at least 4 components running together (mon, mgr, mds, osd). And I decided it will be easier to manage it manually, at least I will understand what is going on inside. So I installed ceph with ansible to run as system service, since then I have much more confidence in it