๐ | A simple worker that can be used as a starting point to build your own custom RunPod Endpoint API worker.
- Clone this repository.
- Add your code to the
src
directory. - Update the
handler.py
file to load models and process requests. - Add any dependencies to the
requirements.txt
file. - Add any other build time scripts to the
builder
directory, for example, downloading models. - Update the
Dockerfile
to include any additional dependencies.
This repository is setup to automatically build and push a docker image to the GitHub Container Registry. You will need to add the following to the GitHub Secrets for this repository to enable this functionality:
DOCKERHUB_USERNAME
| Your DockerHub username for logging in.DOCKERHUB_TOKEN
| Your DockerHub token for logging in.DOCKERHUB_REPO
| The name of the repository you want to push to.DOCKERHUB_IMG
| The name of the image you want to push to.
The CD-docker_dev.yml
file will build the image and push it to the dev
tag, while the CD-docker_release.yml
file will build the image on releases and tag it with the release version.
Models should be part of your docker image, this can be accomplished by either copying them into the image or downloading them during the build process.
If using the input validation utility from the runpod python package, create a schemas
python file where you can define the schemas, then import that file into your handler.py
file.