How do I read the image buffer?

[svtlabs]

How do I read the image buffer?

[clearlysid]

Thanks for the example, appreciate it! 🙏

For my use I wanted the CVImageBufferRef directly so I can process it further using core-video-sys within my project. You can see the tweak I made here.

But the idea i have is to create safe functions for getting the data in the ScreenCaptureKit module.

Looking forward to seeing this happen. If you have any specific docs/PRs I can take up, I'm happy to do so!

[1313]

Hi! Sorry for the late reply, I'm writing up an example to illustrate how to do this. The safe wrapper does not yet have any functions to retrieve the image buffer data. The CMSampleBufferRef has a raw pointer to the underlying CMSampleBuffer. But the idea i have is to create safe functions for getting the data in the ScreenCaptureKit module.

[1313]

Added some code in the sys crate to show how to use CIImage in order to get the JPEG data.

https://github.com/svtlabs/screencapturekit-rs/blob/main/screencapturekit-sys/examples/store_image.rs

The compression is a bit heavy by default. It is possible to change that by passing different options to JPEGRepresentationOfImage.

https://developer.apple.com/documentation/coreimage/cicontext/1642214-jpegrepresentationofimage?language=objc