regzon/dfs

[Innopolis University Project] Distributed File System implemented in Python

Distributed File System

Innopolis Unversity, 2019
Distributed Systems

Team

Andrey Volkov
Madina Gafarova
Gleb Petrakov

Structure

client

A simple Python package to perform operations to FS from user space.

Calls

Create a new instance of client with Client(nameserver_addr), where nameserver_addr is nameserver ip address.

naming_server

A Django server for managing storage nodes and to transit filesystem operations to storage servers.

Original Docker image: regzon/dfs-naming-server

Port: 6500

Endpoints

Running

Environment

Set up all environmental variables within .env file (example given).

Execute to export variables manually:
export $(grep -v '^#' .env | xargs)

Docker

Images:

regzon/dfs-naming-server - naming server image.
https://hub.docker.com/r/regzon/dfs-naming-server

regzon/dfs-storage-server - storage server image.
https://hub.docker.com/r/regzon/dfs-storage-server

Build

To build specific image, run:

docker build -t <image_name>:<image_tag> ./<context>

E. g.: docker build -t regzon/dfs-naming-server ./naming_server

Run

Execute to run container: docker run -d -it --restart=always --name=<name> -p <port>:<port> <image>

Docker-Compose

Execute to build and run the whole system within docker-compose environment:
docker-compose up -d --build

Execute to stop all containers:
docker-compose down -v

Docker Swarm

Initialize Swarm node:
docker swarm init --advertise-addr <ip_address>

Clone this repo:
git clone https://github.com/regzon/dfs && cd dfs

Execute to export variables for Docker Swarm:
export $(grep -v '^#' .env | xargs)

Deploy stack:
docker stack deploy --compose-file docker-compose.yml dfs