loganlxb/mediapipe_unity_handtracking

Hi there 👋

🖥️ Logan

I'm a developers experienced in creating and developing the future thanks to AR,VR and Mixed reality.

• 🔭 I’m currently working on democratizing mixed reality with Glassear
• 🌱 I’m currently learning computer vision, python and c#

💬 Ask me about ...

• Unity development
• Mobile / headmounted Augmented Reality
• Virtual Reality
• Image detection

👀 Find me

• 📫 How to reach me: [email protected]

mediapipe_unity_handtracking's Issues

Image orientations and alignments may not be correct on Android

Current merge was mainly to fix issues found on iOS. Android may have a totally different set of problems.

DllNotFoundException: Unable to load DLL 'libtensorflowlite_gpu_gl': The specified module could not be found.

Why Unity does not load the library on Android? I did just set arm64, illcpp and builded for android.
Hope a solution is found, thanks a lot!

HandTracking:Start()
07-19 23:01:31.328 17307 17334 I Unity   :
07-19 23:01:31.328 17307 17334 I Unity   : (Filename: ./Runtime/Export/Debug/Debug.bindings.h Line: 35)
07-19 23:01:31.328 17307 17334 I Unity   :
07-19 23:01:31.349 17307 17334 D Unity   : Failed to load native plugin: Unable to lookup library path for 'libtensorflowlite_gpu_gl'.
07-19 23:01:31.349 17307 17334 E Unity   : Unable to find libtensorflowlite_gpu_gl
07-19 23:01:31.349 17307 17334 D Unity   : Failed to load native plugin: Unable to lookup library path for 'tensorflowlite_gpu_gl'.
07-19 23:01:31.350 17307 17334 E Unity   : Unable to find tensorflowlite_gpu_gl
07-19 23:01:31.360 17307 17334 D Unity   : Uploading Crash Report
07-19 23:01:31.360 17307 17334 E Unity   : DllNotFoundException: Unable to load DLL 'libtensorflowlite_gpu_gl': The specified module could not be found.
07-19 23:01:31.360 17307 17334 E Unity   :   at TensorFlowLite.Interpreter.TFLGpuDelegateCreate (TensorFlowLite.Interpreter+TfLiteMetalDelegateOptions delegateOptions) [0x00000] in <00000000000000000000000000000000>:0
07-19 23:01:31.360 17307 17334 E Unity   :   at TensorFlowLite.Interpreter.GpuDelegateCreate () [0x00000] in <00000000000000000000000000000000>:0
07-19 23:01:31.360 17307 17334 E Unity   :   at TensorFlowLite.Interpreter..ctor (System.Byte[] modelData, System.Boolean useGPU) [0x00000] in <00000000000000000000000000000000>:0
07-19 23:01:31.360 17307 17334 E Unity   :   at Inferencer.InitInterpreter (UnityEngine.TextAsset model, System.Boolean useGPU) [0x00000] in <00000000000000000000000000000000>:0
07-19 23:01:31.360 17307 17334 E Unity   :   at Inferencer.Init (UnityEngine.TextAsset palmDetection, UnityEngine.TextAsset handLandmarks, System.Boolean useGPU, System.Int32 palmDetectionLerpFrameCount, System.Int32 handLandmark3DLerpFrameCount) [0x00000] in <00000000000000000000000000000000>:0
07-19 23:01:31.360 17307 17334 E Unity   :   at HandTracking.Start () [0x00000] in <00000000000000000000000000000000>:0
07-19 23:01:31.360 17307 17334 E Unity   :
07-19 23:01:31.360 17307 17334 E Unity   : (Filename: currently not
07-19 23:01:31.382 17307 17334 D Unity   : Uploading Crash Report
07-19 23:01:31.382 17307 17334 E Unity   : NullReferenceException: Object reference not set to an instance of an object.07-19 23:01:31.382 17307 17334 E Unity   :   at Inferencer.DetectePalmRect () [0x00000] in <00000000000000000000000000000000>:0
07-19 23:01:31.382 17307 17334 E Unity   :   at Inferencer.Update (UnityEngine.Texture2D texture) [0x00000] in <00000000000000000000000000000000>:0
07-19 23:01:31.382 17307 17334 E Unity   :   at HandTracking.Update () [0x00000] in <00000000000000000000000000000000>:0
07-19 23:01:31.382 17307 17334 E Unity   :
07-19 23:01:31.382 17307 17334 E Unity   : (Filename: currently not available on il2cpp Line: -1)

How do I get the .bytes file?

Hello.
I do want to update hand models to the latest ones by MediaPipe. I have downloaded them and they are in the .tflite format I can't import into the script. What should I do?
Thanks

Null Pointer Exception

I'm getting the following error,

NullReferenceException: Object reference not set to an instance of an object
Inferencer.DetectePalmRect () (at Assets/TensorFlowLite/Examples/HandTracking/Scripts/Inferencer.cs:214)
Inferencer.Update (UnityEngine.Texture2D texture) (at Assets/TensorFlowLite/Examples/HandTracking/Scripts/Inferencer.cs:130)
HandTracking.Update () (at Assets/TensorFlowLite/Examples/HandTracking/Scripts/HandTracking.cs:87)