z5labs/hfs

HTTP File Server

hfs's Issues

test(hfs): add upload and download load tests

By leveraging Terraform and k6, a load testing env should be able to be stood up in AWS quickly and test should be able to be ran on it quickly.

test(hfs): add large file tests

Simulate large file upload/downloads (e.g. large ISO files for iPXE boots). HFS should ideally consume a constant amount of memory when uploading/downloading from/to a single client.

build(hfs): update workflow to create github releases on tags

A GitHub release should be created with prebuilt binaries and Github Container registry should be updated

feat(cmd/cp): support copy from and to hfs

deploy(hfs): add helm chart for deploying to k8s cluster

feat(hfs): support multipart upload/download

Browsers will most likely upload files using multipart/form and for reference AWS S3 defaults to using multipart/form for any file above 8MB.

feat(hfs): add web ui for admin mgmt

An interesting idea would be to add a admin endpoint for easier management of files. It could leverage a simple CSS framework, the html/template package and possibly Vue.

bug(hfs): remove caching for now

Unfortunately, the CacheOnReadFs from afero.Fs doesn't allow for a max cache size to be set so running this on low RAM machines is a no go if the file sizes are large.

build(hfs): produce multi-arch docker images

test(hfs): improve unit test coverage

feat(cmd/rm): support removing a file from hfs

feat(hfs): add Dockerfile