wang-bin/mdk-examples

media player examples based on mdk sdk. runs on all platforms. sdk download:

media player examples based on mdk sdk. runs on all platforms. Download the latest sdk

About libmdk sdk: https://github.com/wang-bin/mdk-sdk

Flutter

https://github.com/wang-bin/fvp

GLFW

glfwplay

• has the most features
• use glfw context as foreign context mode
• use glfw window to create render loop and gl/d3d11/metal/vulkan context internally

multiplayers

1 player per window

multiwindows

many windows as render targets sharing the same player

PlayListAsOne

Gapless play/seek multiple videos like a single video

simple

minimal glfw example

macOS

• use CAOpenGLLayer as foreign context
• use NSView to create render loop and gl context internally

iOS

Legacy Obj-C OpenGLES2 example

Apple

• HelloTriangle: Using mdk sdk to play video in Apple's official example https://developer.apple.com/documentation/metal/using_a_render_pipeline_to_render_primitives?language=objc
• OCPlayer: macOS only. via cocoapods
• SwiftMdkExample: supports macOS, iOS, macCatalyst. via submodule swiftMDK. requires mdk.xcframeworks
• SwiftPlayer: macOS only. via cocoapods

Native

examples without platform specific code

• mdkplay: a mininal player with internally created platform dependent window/surface and opengl context, also create render loop and gl context
• DecodeFps: a tool to test decoder performance. `./DecodeFps [-c:v DecoderName] file"
• offscreen: offscreen rendering guide

Qt

• Integrate with QOpenGLWindow and QOpenGLWidget. Use gl context provided by Qt.
• Render on QOpenGLWindow and QOpenGLWidget via gl context provided by Qt
• QML example via QOpenGLFrameBuffer
• RHI example: vulkan, d3d11, metal, opengl

SDL

Use gl context provided by SDL

SFML

• Use gl context provided by SFML
• Render to SFML texture

WindowsStore

UWP example, supports D3D11, and ANGLE GLES2

CoreWindowCx

• use Windows::UI::Core::CoreWindow as platform dependent surface to create render loop and gl context internally
• use App provided gl context

XamlCx

• Use Windows::UI::Xaml::Controls::SwapChainPanel as platform dependent surface to create render loop and gl context internally
• Switch between 2 render targets

Avalonia

use gl to render, (Only test on Windows x64).

mdk-examples's Issues

Getting video dimensions before allocating SFML texture

Would you please add a proper texture size initialization in the following code

mdk-examples/SFML/sfmltexture.cpp

Line 38 in f7ea5c7

if (!texture.create(500, 500)) // or use video size, see ../Native/offscreen.cpp

And maybe explain a bit how this callback works, and if It's blocking or not as I would like to reload movies in the main loop without introducing stuttering to all other screen elements.

The videos I'm reloading have various resolutions. I would like to know how it should be handled. Thanks

Qt RHI Crash when using Vulkan backend on Windows

Qt RHI example crashes on Windows, when requesting Vulkan backend.

Tested with 5.15.7 and 6.2.2

Steps to reproduce:

1. Download qmlrhi example
2. For Qt 6.2 set QQuickWindow::setGraphicsApi(QSGRendererInterface::Vulkan);. For Qt 5.15 set qputenv("QSG_RHI", "1"); qputenv("QSG_RHI_BACKEND", "vulkan"); in main.cpp
3. Start with any video file

It then crashes in

1  mdk::abi::VideoPresenter::setRenderAPI VideoPresenter.cpp      358 0x7fffea7a7bb9 
2  MDK_Player_setRenderAPI                Player.cpp              231 0x7fffea74947e 
3  mdk::Player::setRenderAPI              Player.h                434 0x7ff777cd33ca 
4  VideoTextureNodePub::ensureTexture     VideoTextureNodePub.cpp 217 0x7ff777cd1a0d 
5  VideoTextureNode::sync                 VideoTextureNode.cpp    49  0x7ff777ccfc33 
6  VideoTextureItem::updatePaintNode      VideoTextureItem.cpp    55  0x7ff777cc4be9 

Using latest nightly MDK SDK

QML itself with Vulkan backend works as expected

SFML texture example freezes near the end of the video

Hi, When I play any video using your sfml texture example I get a pause a few frames before end of the video. This happens without loop. With looping enabled it also pauses on frame one. The example video I attached has a freeze at frame 288. I was hoping for a seamless infinite loop, but I cannot find a way of making it not freeze. Would you help me solving this problem please

Rename the counter.mp4.txt to counter.mp4
counter.mp4.txt

Add QML example

It would be very nice if you add a simple example of QML to show the basic usage of MDK. Better to make it a QML element.

qtquick rhi: stutter in threaded render loop

qt6.2.

• threaded metal, vulkan render loop. smooth when resizing window
• basic opengl render loop(macos): black. smooth when resizing window

qtquick rhi: crash if window changes in threaded render loop

qtquick rhi use threaded render loop by default. if video window changes, a new render thread will be created. libmdk assume no render thread change, so may crash. An workaround is explicitly set environment QSG_RENDER_LOOP=basic

qmdkqmlplay QML example flickering on top of Qt 3D scene

qmdkqmlplay QML example based on QQuickFramebufferObject works fine as itself.

But if MDKPlayer is on top of Qt Scene3D, there is no video rendered or it is flickering in more complex application (it looks like something clearing item after renderVideo is called). Any other QML Quick items on top of Qt Scene3D are ok. Audio is working.
Example based on qmdkqmlplay + qt3d-scene3d-example for test:
mdk-example.zip

If renderPolicy: RenderSettings.OnDemand for Scene3D is set (uncomment the line in code) video stops flickering and get rendered right when 3d scene is still. Start rotate the 3d camera and MDKPlayer start flickering due to Scene3D updates.

Same behavior Windows 10, android armv7
Qt 5.9.5, MinGW 5.3.0 32bit, android SDK 25.2.5, NDK 16.1.44794999