Comments (1)
Hi,
Good question; at first glance, Medaipipe (MP) and DeepStream (DS) may seem similar. At the core of it, they both provide a framework that can run an inference task.
There are a few important differences:
- Data types: DS supports only video/image streams, while MP operates on generic packets (which can include video, audio, image, primitives, or any user-defined object types)
- Graphs: Data flow in both frameworks are described by a graph. DS is built on top of Gstreamer, which has a strictly linear pipeline model with very basic control flow. MP graphs offer more flexibility in design, and allows for very complex graph construction, including dynamic control flow and back edges.
- Hardware/OS: DS is restricted to high-end desktop Nvidia GPUs (and appears to be Linux only). MP supports running on desktop/mobile CPUs and mobile GPUs (via OpenGL), and desktop GPU support is planned. MP runs on Android/iOS/Linux/OSX.
- Tools: MP provides a powerful graph visualizer for interactive building and analyzing graphs, including graph performance tracing. I think DS relies on existing Gstreamer visualization tools like graphviz or dot (which is not interactive).
- Plugins/Calculators: Each node in a DS pipeline is a Gstreamer filter (limited to how you write Gstreamer plugins). Each node in a MP graph is a Calculator, representing a very generic operation[s] to any or multiple packet stream types, also not limited to inference or even machine learning at all.
Hope that can help distinguish the two frameworks.
from mediapipe.
Related Issues (20)
- Can we implement mediapipe hair segmentation model using mindAR ? HOT 2
- What are the indices of each body part in PoseLandmarkerResult? HOT 1
- Linker error when trying to build the C++ examples HOT 6
- Building from source fails
- MediaPipe Solutions state that it accepts either static data or a continuous stream. I didn't find any documentation for continuous stream implementation. HOT 5
- NPU Support HOT 1
- mp.Image can't deal with numpy array views HOT 5
- mediapipe failed to build on Windows
- FaceLandmarker is non-deterministic in VIDEO/LIVE-STREAM mode HOT 3
- 'FieldDescriptor' object has no attribute '_default_constructor' when using create_from_optioons HOT 5
- Merge LoRA weights to LLM at initialization time on-device (Gemma)
- Codepen example for the new javascript holistic Solution? HOT 1
- Problem when using mediapipes from inside a worker loaded as a module
- Converted Gemma 2b tflite generate same token
- Add support for Python 3.12 HOT 3
- How Mediapipe calculate the Z World Coordinate?
- How Mediapipe calculate the Z World Coordinate? HOT 2
- can't finish the download HOT 3
- MediaPipe GPU support in PyPi package HOT 4
- MediaPipe > 0.10.9 does not work on MacOS. HOT 3
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from mediapipe.