MetalCamera is an open source project for performing GPU-accelerated image and video processing on Mac and iOS.
There are many ways to use the GPU, including CIFilter, but it's not open or difficult to expand feature and contribute.
There are still a lot of bugs and many things to implement, but I created a repository because I wanted to develop camera and vision feature in iOS with many people.
Feel free to use, make some issue and PR when you have a idea.
Thanks.
To run the example project, clone the repo, and run pod install
from the Example directory first.
import MetalCamera
@IBOutlet weak var preview: MetalVideoView!
var camera: MetalCamera!
override func viewDidLoad() {
super.viewDidLoad()
guard let camera = try? MetalCamera(useMic: useMic) else { return }
camera-->preview
self.camera = camera
}
override func viewWillAppear(_ animated: Bool) {
super.viewWillAppear(animated)
camera?.startCapture()
}
override func viewDidDisappear(_ animated: Bool) {
super.viewDidDisappear(animated)
camera?.stopCapture()
}
let rotation90 = RotationOperation(.degree90_flip)
let imageCompositor = ImageCompositor(baseTextureKey: camera.textureKey)
guard let testImage = UIImage(named: "sampleImage") else {
fatalError("Check image resource")
}
let gray = Gray()
let compositeFrame = CGRect(x: 50, y: 100, width: 250, height: 250)
imageCompositor.addCompositeImage(testImage)
imageCompositor.sourceFrame = compositeFrame
videoCompositor = ImageCompositor(baseTextureKey: camera.textureKey)
videoCompositor.sourceFrame = CGRect(x: 320, y: 100, width: 450, height: 250)
camera-->rotation90-->gray-->imageCompositor-->videoCompositor-->preview
TBD
do {
if FileManager.default.fileExists(atPath: recordingURL.path) {
try FileManager.default.removeItem(at: recordingURL)
}
recorder = try MetalVideoWriter(url: recordingURL, videoSize: CGSize(width: 720, height: 1280), recordAudio: useMic)
if let recorder = recorder {
preview-->recorder
if useMic {
camera==>recorder
}
recorder.startRecording()
}
} catch {
debugPrint(error)
}
- Swift 4
- Xcode 11.5 or higher on Mac
- iOS: 13.0 or higher
MetalCamera is available through CocoaPods. To install it, simply add the following line to your Podfile:
pod 'MetalCamera'
When creating this repository, I referenced the following repositories a lot. First of all, thanks to those who have worked and opened many parts, and let me know if there are any problems.
jsharp83, [email protected]
MetalCamera is available under the MIT license. See the LICENSE file for more info.