I have been using MinIO for my self hosted S3 needs but I now have a need to break up my backing storage into SSD for images and other small files and HDD for videos. From what I can tell this is not possible with MinIO and I would rather not run two instances if I can help it. Are there other self hosted solutions where this is easy to do?
Good question, but I‘m afraid we‘re looking for a solution to a problem that S3 is not trying to solve. Blob storage solves problems such as redundancy and resiliency, effectively abstracting away the underlying storage.
That said, I would recommend hosting different instances (“clusters”) of Garage S3 for that purpose. You could also use the storage type as the region name for more clarity (AFAIK a garage cluster works with a single region).
This would probably work well because Garage is so light on resources (unlike minio). I also have Garage running in a similar setup for around 2 years, with daily reads/writes… Never had an operational issue. Rock-solid stuff.
I have been looking at Garage. Not sure if you can set certain buckets to different mount points or whatever but it does seem to be easier to setup and update which would make running two instances much less painful.
Looks like MinIO supports tiering. Does that not do what you want?
Thanks, this looks like a possible solution. I will have to dive into it to see if it will work the way I need it to.
Seaweedfs?
Why don’t you do some bash scripting and route files to different buckets depending on their extensions or mime types? You can easily do that with rclone for example.
