umass-rescue / mlmicroservicetemplate Goto Github PK
View Code? Open in Web Editor NEWConcise template to rapidly deploy and share a machine learning model
License: MIT License
Concise template to rapidly deploy and share a machine learning model
License: MIT License
Currently, the Docker container used for the microservice only has access to the CPU and memory. Enabling the container to interact with the system GPU can lead to large speed ups in prediction tasks.
When creating a prediction request, the images that are passed in are accessed via a local Docker volume shared between the model microservice and the server. While straightforward in its current implementation, this is not the best way to set up the transfer of data since it forces all prediction microservices to be on the same machine as the central server.
Determine how to receive images directly via HTTP request in the /predict
endpoint and remove any Docker volume dependencies from the docker-compose.yml
file.
Once this is complete, modify the corresponding code in the central server's /model/predict
endpoint to send the file via HTTP instead of via filename.
Right now when a user wants to test their model, they must either connect via the docker shell or use the server + client to submit requests.
There should be a UI that allows for users to upload images to the model and then view the results.
Once Issue #7 is complete and images can be received via HTTP, changes can be made to improve the efficiency of predictions.
Images are received and models predict on them one-by-one. However, batching is a more efficient way to handle larger jobs. Determine the best way to predict on batches of images.
A declarative, efficient, and flexible JavaScript library for building user interfaces.
๐ Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
An Open Source Machine Learning Framework for Everyone
The Web framework for perfectionists with deadlines.
A PHP framework for web artisans
Bring data to life with SVG, Canvas and HTML. ๐๐๐
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
Some thing interesting about web. New door for the world.
A server is a program made to process requests and deliver data to clients.
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Some thing interesting about visualization, use data art
Some thing interesting about game, make everyone happy.
We are working to build community through open source technology. NB: members must have two-factor auth.
Open source projects and samples from Microsoft.
Google โค๏ธ Open Source for everyone.
Alibaba Open Source for everyone
Data-Driven Documents codes.
China tencent open source team.