svpino/clip-container

A containerized REST API around OpenAI's CLIP model.

Hey! 👋

My name is Santiago, and I'm a Computer Scientist focusing on applied Machine Learning. I have more than two decades of experience building software to solve exciting and —sometimes— hard problems.

I care deeply about unlocking the power of technology for individuals and businesses, so they can use computers in a way that was previously unrealistic for them. I find joy in ambiguity and feel more engaged when working on problems that can't be solved by merely searching the web or reading a book. Bonus points if I can collaborate with a team of like-minded engineers!

This is where I've worked during the last 10 years

DIRECTOR OF COMPUTER VISION SOLUTIONS

Levatas. Oct 2018 - Present

I lead a small team of software developers and machine learning engineers in the development of Levatas' flagship product, a platform to augment the productization of machine learning models with human reviews, where I'm the main contributor to the core Python engine. Other than that, the majority of my work centers around building solutions to help operationalize machine learning models running on AWS.

DIRECTOR OF ENGINEERING | ENGINEER MANAGER | SENIOR SOFTWARE ENGINEER

Levatas. Oct 2010 – Oct 2018.

I joined Levatas in 2010 as a Senior Software Engineer, moved to Engineer Manager three years later, before becoming the director of the department in May 2016. During this time, I had the opportunity to help deliver software solutions for companies like IBM, Dell, and HSBC. I moved through the entire development stack and touched projects every step of the way, from ideation to final delivery.

My education

MASTER OF SCIENCE (M.Sc.), COMPUTER SCIENCE

Machine Learning Specialization. Georgia Institute of Technology, 2019. 4.0 GPA

I was a Teaching Assistant of Graduate Algorithms during two semesters. Coursework: Software Architecture and Design, Software Development Process, Algorithms, Software Testing, Machine Learning, Reinforcement Learning, Database Systems, Computer Vision, Human-Computer Interaction.

BACHELOR OF SCIENCE (B.S.), INFORMATION TECHNOLOGY

University of Camaguey, Cuba. 2004. 3.84 GPA

Coursework: Software Engineering, Data Structures and Algorithms, Database Design, File Structures, Artificial Intelligence, Information Technology.

OTHER CERTIFICATIONS

• TensorFlow Developer Certificate (Google)
• Machine Learning (Standford Online - Coursera)
• TensorFlow In Practice (deeplearning.ai - Coursera)
• Developing Scalable Apps with Java and Google App Engine (Google - Udacity)
• Mobile Web Development (Google - Udacity)

I've also accumulated other certifications from 2001 to 2015 covering OO Concepts, Java, C, JavaScript, and C# development.

My most relevant technical skills

These are the highlights of the skills I consider to be the keystone of my abilities:

• I have a lot of experience designing and architecting systems of different sizes and complexity.
• I've become an excellent Python 🐍 developer. And this happened after years dedicated to Java.
• I have a lot of experience with Machine Learning using TensorFlow.
• I have been focusing mainly on AWS. It's the place where most of my work goes to serve its purpose.
• I have substantial experience dealing with relational databases (mainly MySQL), and non-relational ones (Amazon's DynamoDB, Google's Firestore, and MongoDB.)
• I've done a lot of front-end development, and at some point, I was pretty good using Angular.

Some of the things I've built

It's hard to decide what things should make it into this list, so I'm opting for a combination of private and public projects where I've participated over the last ten years.

• A Python library that orchestrates a workflow of images between different services deployed in AWS.
• An application that connects to Spot's cameras, and makes the robot react to visual clues.
• A process using OpenCV and TensorFlow to analyze a video feed and flag break-ins into an amusement park.
• A library to generate RSS 2.0 feeds in Python.
• A project to run TensorFlow Object Detection models on SageMaker.
• A very simple and fully responsive file system-based blog engine.
• Some really cool and interesting projects during my Masters that have become popular solutions to their respective problems.
• A full Android application to follow stock tickers from different markets worldwide.

Other accomplishments

• I love to write. I contribute articles about Python to the Real Python website.
• I won a bunch of medals competing nationally on Computer Science. Since that time I've loved algorithms and data structures
• I have a beautiful family. For sure my best accomplishment by far.

📫 You can find me on Twitter or LinkedIn.

clip-container's Issues

Loop when running the container

Hi svpino,

this happens when running the container:

root@megacool:/tmp/clip-container# docker run -it -p 8080:10000 --name "clip-container" --rm clip-container:latest /opt/ml/code/serve
Starting the inference server with 16 workers.
[2022-07-08 07:31:12 +0000] [10] [INFO] Starting gunicorn 20.1.0
[2022-07-08 07:31:12 +0000] [10] [INFO] Listening at: unix:/tmp/gunicorn.sock (10)
[2022-07-08 07:31:12 +0000] [10] [INFO] Using worker: gevent
[2022-07-08 07:31:12 +0000] [13] [INFO] Booting worker with pid: 13
[2022-07-08 07:31:12 +0000] [14] [INFO] Booting worker with pid: 14
[2022-07-08 07:31:12 +0000] [15] [INFO] Booting worker with pid: 15
[2022-07-08 07:31:12 +0000] [16] [INFO] Booting worker with pid: 16
[2022-07-08 07:31:12 +0000] [17] [INFO] Booting worker with pid: 17
[2022-07-08 07:31:12 +0000] [18] [INFO] Booting worker with pid: 18
[2022-07-08 07:31:12 +0000] [19] [INFO] Booting worker with pid: 19
[2022-07-08 07:31:12 +0000] [20] [INFO] Booting worker with pid: 20
[2022-07-08 07:31:12 +0000] [51] [INFO] Booting worker with pid: 51
[2022-07-08 07:31:12 +0000] [52] [INFO] Booting worker with pid: 52
[2022-07-08 07:31:12 +0000] [68] [INFO] Booting worker with pid: 68
[2022-07-08 07:31:12 +0000] [69] [INFO] Booting worker with pid: 69
[2022-07-08 07:31:12 +0000] [70] [INFO] Booting worker with pid: 70
[2022-07-08 07:31:12 +0000] [71] [INFO] Booting worker with pid: 71
[2022-07-08 07:31:12 +0000] [72] [INFO] Booting worker with pid: 72
[2022-07-08 07:31:12 +0000] [88] [INFO] Booting worker with pid: 88
/root/.local/lib/python3.8/site-packages/torch/cuda/init.py:52: UserWarning: CUDA initialization: Found no NVIDIA driver on your system. Please check that you have an NVIDIA GPU and installed a driver from http://www.nvidia.com/Download/index.aspx (Triggered internally at /pytorch/c10/cuda/CUDAFunctions.cpp:100.)
return torch._C._cuda_getDeviceCount() > 0
/root/.local/lib/python3.8/site-packages/torch/cuda/init.py:52: UserWarning: CUDA initialization: Found no NVIDIA driver on your system. Please check that you have an NVIDIA GPU and installed a driver from http://www.nvidia.com/Download/index.aspx (Triggered internally at /pytorch/c10/cuda/CUDAFunctions.cpp:100.)
return torch._C._cuda_getDeviceCount() > 0
/root/.local/lib/python3.8/site-packages/torch/cuda/init.py:52: UserWarning: CUDA initialization: Found no NVIDIA driver on your system. Please check that you have an NVIDIA GPU and installed a driver from http://www.nvidia.com/Download/index.aspx (Triggered internally at /pytorch/c10/cuda/CUDAFunctions.cpp:100.)
return torch._C._cuda_getDeviceCount() > 0
/root/.local/lib/python3.8/site-packages/torch/cuda/init.py:52: UserWarning: CUDA initialization: Found no NVIDIA driver on your system. Please check that you have an NVIDIA GPU and installed a driver from http://www.nvidia.com/Download/index.aspx (Triggered internally at /pytorch/c10/cuda/CUDAFunctions.cpp:100.)
return torch._C._cuda_getDeviceCount() > 0
/root/.local/lib/python3.8/site-packages/torch/cuda/init.py:52: UserWarning: CUDA initialization: Found no NVIDIA driver on your system. Please check that you have an NVIDIA GPU and installed a driver from http://www.nvidia.com/Download/index.aspx (Triggered internally at /pytorch/c10/cuda/CUDAFunctions.cpp:100.)
return torch._C._cuda_getDeviceCount() > 0
/root/.local/lib/python3.8/site-packages/torch/cuda/init.py:52: UserWarning: CUDA initialization: Found no NVIDIA driver on your system. Please check that you have an NVIDIA GPU and installed a driver from http://www.nvidia.com/Download/index.aspx (Triggered internally at /pytorch/c10/cuda/CUDAFunctions.cpp:100.)
return torch._C._cuda_getDeviceCount() > 0
/root/.local/lib/python3.8/site-packages/torch/cuda/init.py:52: UserWarning: CUDA initialization: Found no NVIDIA driver on your system. Please check that you have an NVIDIA GPU and installed a driver from http://www.nvidia.com/Download/index.aspx (Triggered internally at /pytorch/c10/cuda/CUDAFunctions.cpp:100.)
return torch._C._cuda_getDeviceCount() > 0
/root/.local/lib/python3.8/site-packages/torch/cuda/init.py:52: UserWarning: CUDA initialization: Found no NVIDIA driver on your system. Please check that you have an NVIDIA GPU and installed a driver from http://www.nvidia.com/Download/index.aspx (Triggered internally at /pytorch/c10/cuda/CUDAFunctions.cpp:100.)
return torch._C._cuda_getDeviceCount() > 0
/root/.local/lib/python3.8/site-packages/torch/cuda/init.py:52: UserWarning: CUDA initialization: Found no NVIDIA driver on your system. Please check that you have an NVIDIA GPU and installed a driver from http://www.nvidia.com/Download/index.aspx (Triggered internally at /pytorch/c10/cuda/CUDAFunctions.cpp:100.)
return torch._C._cuda_getDeviceCount() > 0
/root/.local/lib/python3.8/site-packages/torch/cuda/init.py:52: UserWarning: CUDA initialization: Found no NVIDIA driver on your system. Please check that you have an NVIDIA GPU and installed a driver from http://www.nvidia.com/Download/index.aspx (Triggered internally at /pytorch/c10/cuda/CUDAFunctions.cpp:100.)
return torch._C._cuda_getDeviceCount() > 0
/root/.local/lib/python3.8/site-packages/torch/cuda/init.py:52: UserWarning: CUDA initialization: Found no NVIDIA driver on your system. Please check that you have an NVIDIA GPU and installed a driver from http://www.nvidia.com/Download/index.aspx (Triggered internally at /pytorch/c10/cuda/CUDAFunctions.cpp:100.)
return torch._C._cuda_getDeviceCount() > 0
/root/.local/lib/python3.8/site-packages/torch/cuda/init.py:52: UserWarning: CUDA initialization: Found no NVIDIA driver on your system. Please check that you have an NVIDIA GPU and installed a driver from http://www.nvidia.com/Download/index.aspx (Triggered internally at /pytorch/c10/cuda/CUDAFunctions.cpp:100.)
return torch._C._cuda_getDeviceCount() > 0
/root/.local/lib/python3.8/site-packages/torch/cuda/init.py:52: UserWarning: CUDA initialization: Found no NVIDIA driver on your system. Please check that you have an NVIDIA GPU and installed a driver from http://www.nvidia.com/Download/index.aspx (Triggered internally at /pytorch/c10/cuda/CUDAFunctions.cpp:100.)
return torch._C._cuda_getDeviceCount() > 0
/root/.local/lib/python3.8/site-packages/torch/cuda/init.py:52: UserWarning: CUDA initialization: Found no NVIDIA driver on your system. Please check that you have an NVIDIA GPU and installed a driver from http://www.nvidia.com/Download/index.aspx (Triggered internally at /pytorch/c10/cuda/CUDAFunctions.cpp:100.)
return torch._C._cuda_getDeviceCount() > 0
/root/.local/lib/python3.8/site-packages/torch/cuda/init.py:52: UserWarning: CUDA initialization: Found no NVIDIA driver on your system. Please check that you have an NVIDIA GPU and installed a driver from http://www.nvidia.com/Download/index.aspx (Triggered internally at /pytorch/c10/cuda/CUDAFunctions.cpp:100.)
return torch._C._cuda_getDeviceCount() > 0
/root/.local/lib/python3.8/site-packages/torch/cuda/init.py:52: UserWarning: CUDA initialization: Found no NVIDIA driver on your system. Please check that you have an NVIDIA GPU and installed a driver from http://www.nvidia.com/Download/index.aspx (Triggered internally at /pytorch/c10/cuda/CUDAFunctions.cpp:100.)
return torch._C._cuda_getDeviceCount() > 0
0%| | 0.00/338M [00:00<?, ?iB/s]/root/.local/lib/python3.8/site-packages/clip/clip.py:57: UserWarning: /root/.cache/clip/ViT-B-32.pt exists, but the SHA256 checksum does not match; re-downloading the file
warnings.warn(f"{download_target} exists, but the SHA256 checksum does not match; re-downloading the file")
0%| | 0.00/338M [00:00<?, ?iB/s]/root/.local/lib/python3.8/site-packages/clip/clip.py:57: UserWarning: /root/.cache/clip/ViT-B-32.pt exists, but the SHA256 checksum does not match; re-downloading the file
warnings.warn(f"{download_target} exists, but the SHA256 checksum does not match; re-downloading the file")
15%|█████▋ | 50.2M/338M [00:18<01:42, 2.95MiB/s]

This file gets redownloaded all the time resulting in a loop.

I hope you can help. :)