laanlabs/arbrush

Quick demo of 3d drawing in ARKit using metal + SceneKit. NOTE: This is experimental code!

ARBrush

Quick demo of 3d drawing in ARKit using metal + SceneKit.

Code adapted from: https://github.com/lapfelix/ARKit-line-drawing and: https://www.raywenderlich.com/146414/metal-tutorial-swift-3-part-1-getting-started

NOTE: This is experimental code! ..I'm just learning swift.

Also note: this demo is pretty trivial to accomplish in Unity with the ARKit plugin (https://forum.unity3d.com/threads/arkit-support-for-ios-via-unity-arkit-plugin.474385/ https://www.assetstore.unity3d.com/en/#!/content/92515 ). This demo was more to see if metal drawing could be layered on top of scenekit.

Author

This project was created by Laan Labs. We design and build solutions at the intersection of Computer Vision and Augmented Reality.

http://labs.laan.com

@laanlabs

License

ARBrush is released under the MIT License. See LICENSE for details.

arbrush's Issues

Crash on renderEncoder.setRenderPipelineState(pipelineState)

Crash on touch iPhone 7+ iOS11

I cannot run the code successfully .

I am trying to run the code on Xcode 10.1, iOS 11 and Swift 4. However, I am getting two errors in shaders.metal line 104 and 109:
line 104: no matching function for call to 'dot'
line 109: no matching function for call to 'reflect'
does anyone solve the same issue?
Please let me know if you have any idea how to solve them. thank you

License

Can you please update the license?

Is it possible to clear line?

I try to brush.clear() and clearDrawing(). It works, but if I draw after clear -> app fails without any information in log.

App is broken

Something changed with metal / arkit to make this app no longer draw correctly for me. I'm on iOS 13.3

touch moved on screen

If I want to pan on the screen,not hold the draw button and remove the device,what should I do?thx.

Crashes on bgra10_XR_sRGB

The app crashes on view touch unless I change the pixelFormat in VertBrush.swift to pipelineStateDescriptor.colorAttachments[0].pixelFormat = MTLPixelFormat.bgra8Unorm_srgb

I'm on a iPhone 7, is this expected?

SCNMatrix4 init issue

Cannot invoke 'SCNMatrix4.Type.init' with an argument list of type '(matrix_float4x4)'

any fix ?