Comments (2)
0:00:00 - Testing best engineering practices.
0:00:34 - Test local AWS cloud stack with LocalStack for response to Kinesis Stream.
0:01:10 - Install local stock with Docker Compose, open port for requests.
0:01:53 - Start Kinesis server, test working.
0:02:29 - Testing integration with Kinesis.
0:03:09 - Test AWS setup with Kinesis.
0:03:46 - Use local endpoint instead of AWS.
0:04:27 - Create stream with Kinesis, check local stack.
0:05:04 - Create stream 'predictions' with chart count 1.
0:05:45 - Configure code to access local stack endpoint.
0:06:25 - Connect to Kinesis with Docker Compose.
0:07:03 - Create Kinesis client, set endpoint URL.
0:07:49 - Create Kinesis stream for tests.
0:08:28 - Services configured, stream created.
0:09:08 - Testing Kinesis stream setup.
0:09:52 - Testing Kinesis stream with Python.
0:10:34 - Copy short iterator, add URL.
0:11:20 - Testing prediction with boto3 & shard iterator.
0:12:04 - Decoding data & testing script.
0:12:38 - Communicate with local stack, get chart iterator with boto3.
0:13:18 - Comparing expected response to request.
0:13:55 - Comparing expected and actual records with Kinesis response.
0:14:37 - Automate records, exit on error, run test on success.
0:15:10 - Run test key, edges; check locks; stop containers; exit if fails; docker compose down.
0:15:46 - Testing new Kinesis response, success!
0:16:21 - Testing two sets of tests: unit & end-to-end.
0:17:04 - Checking code quality with tests and make files.
from mlops-zoomcamp.
Updated timecodes. Thanks!
from mlops-zoomcamp.
Related Issues (20)
- Data talks HOT 1
- Make a simple documentation based website HOT 5
- week2 pickle model for Lasso
- Timecodes for "MLOps Zoomcamp 3.1 - Introdution to Workflow Orchestration" HOT 2
- Timecodes for "MLOps Zoomcamp 3.2 - Introduction to Prefect" HOT 2
- Timecodes for "MLOps Zoomcamp 3.3 - Prefect Workflow" HOT 2
- Timecodes for "MLOps Zoomcamp 3.4 - Deploying Your Workflow" HOT 2
- Timecodes for "MLOps Zoomcamp 3.5 - Working with Deployments" HOT 2
- Timecodes for "MLOps Zoomcamp 3.6 - Prefect Cloud (optional)" HOT 2
- Timecodes for "MLOps Zoomcamp 5.1 - Intro to ML monitoring" HOT 2
- Timecodes for "MLOps Zoomcamp 5.2 - Environment setup" HOT 2
- Timecodes for "MLOps Zoomcamp 5.3 - Prepare reference and model" HOT 2
- Timecodes for "MLOps Zoomcamp 5.4 - Evidently metrics calculation" HOT 2
- Timecodes for "MLOps Zoomcamp 5.5 - Dummy monitoring" HOT 2
- Timecodes for "MLOps Zoomcamp 5.6 - Data quality monitoring" HOT 2
- Timecodes for "MLOps Zoomcamp 5.7 - Save Grafana Dashboard" HOT 2
- Timecodes for "MLOps Zoomcamp 5.8 - Debugging with test suites and reports" HOT 2
- Timecodes for "Experiment Tracking with Weights and Biases - Soumik Rakshit" HOT 2
- Timecodes for "MLOps Zoomcamp 2023 - Pre-Course Live Q&A" HOT 2
- Timecodes for "MLOps Zoomcamp 2023" HOT 3
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from mlops-zoomcamp.