Dockerized single-node EdgeFS with geo-transparent S3/NFS access

Dmitry Yusupov
EdgeFS
Published in
11 min readMar 12, 2019

--

If you happen to need a quick and easy way to start a single-node S3/NFS cluster with geo-transparent data access, or simply single-node EdgeFS installation, this article can be of help!

What is EdgeFS? This is a new storage provider addition to CNCF Rook project and you can read more about it at https://rook.io/docs/rook/master/edgefs-storage.html. But you can also run it in a so-called “solo” mode, a single-node Docker container with an ability to scale out your deployment as it grew by simply connecting more nodes and/or geographically distributed cluster segments to it.

EdgeFS stronghold is its ability to virtualize underlying infrastructure as a scalable, highly-available and distributed storage system. It works similarly to “git” where all modifications are globally immutable, fully versioned, self-validated, distributed and therefore fault-tolerant. As a result, it enables cross-cloud and geographically transparent high-performance distributed access to commonly used storage protocols for Object, File and Block.

Use Case — Geo-distributed S3/NFS archive

Geographically distributed and transparent S3/NFS accessible archive. Many millions of small objects of ~ 1MB of size, accessible at 2+ segmented locations for unstructured archive-pattern read-write with performance characteristics constrained by segment’s memory, CPU, and disk types.

--

--