marekkowalski / livescan3d-hololens Goto Github PK
View Code? Open in Web Editor NEWA Unity application for receiving and rendering point clouds on Hololens and other devices.
License: MIT License
A Unity application for receiving and rendering point clouds on Hololens and other devices.
License: MIT License
Is it available for ARM or only for ARM64? Any chance it will be supported on ARM?(32 bit) on Hololens 2?
greetings
Hi Marek,
any news about the release for HL2?
Hope everything is fine.
FB
Originally posted by @fberna in #20 (comment)
We're trying to run this on VR HMDs (Vive, Rift...). Which works fine in the Unity Editor.
But, building hasn't worked out at all.
First, I ripped out all the Hololens related objects/scripts in the Unity project and instead called Connect
manually (in the PointCloudReceiver.cs
).
Building for Windows (x64) failed because Unity won't include the referenced platform.winmd
which appears to be a hard requirement of the NetworkCommunication project.
Building via XAML and for PC only and messing a bit with the csproj
(to rip out Hololens references) worked, but I won't see anything in the app, nor will it launch on the VR HMD.
Do you have any hints where to dig around in the project? Can you estimate how hard it would be to rip out the platform.winmd
dependent code and re-write that?
Could you please update the project to support the new visual studio?
Hey,
I tried to get the new version for the Hololens 2 running but i get some issues.
If i am use the version of MRTK that comes in the folder it doesnt show the point cloud
and i tried to update the version of mrtk but this doesnt work at all.
can you help me with my Promblem?
Best regards
Max
Hi, I'm trying to stream pointcloud data from two kinects 2 (on two computers) and the framerate is super low (1-3), any idea of how to improve that? Both the computers are quite powerful
There are something wrong when i apply it on my machine.
I first open the Hololens Receiver folder using Unity, and then build it. The build setting is under.
It is successful. And I get a new APP folder, which I selected as the output folder.
Next, I open the HololensReceiver.sln in that folder using VS and try to release it.
But there are build errors, for both hololens emulator and the device.
Are there are some wrong steps?
My Unity version is 5.6.0 and VS is 2017.
The solution that recompile the NetworkCommunication I have tried. But it failed.
Thanks a lot.
1> Copying unprocessed assemblies...
1> Running AssemblyConverter...
1> System.Collections.Generic.KeyNotFoundException: The given key was not present in the dictionary.
1> at System.Collections.Generic.Dictionary`2.get_Item(TKey key)
1> at UnityEditor.Scripting.Compilers.NuGetPackageResolver.Resolve()
1> at Unity.UWPAssemblyResolver..ctor(String projectLockFile, String desiredUWPSDKVersion)
1> at Unity.OperationContext.SetPlatform(Platform platform, String projectLockFile, String uwpSDK)
1> at Unity.ParseArgsStep.Execute()
1> at Unity.Step.Execute(OperationContext operationContext, IStepContext previousStepContext)
1> at Unity.Operation.Execute()
1> at Unity.Program.Main(String[] args)
error MSB3073
How to solve it? Any tips?
In the meantime, is there somewhere a pre-build package in order to test it on HoloLens?
Thank you
Hi,
I'm using my PC as a server. My Kinect and HoloLens are connected to the PC. The project works fine on Unity but when it asked me for the IP address the following appeared on the output window: " has exited with code -1073740791 (0xc0000409)" I thought I entered the wrong IP addres but the same happens with every different address.
Thanks.
Telelens of hololens must try in vaccum so it can provide better visuals. Marek have test in vacuum. All the best. My wish is with and whole upcoming generations will work on this technology.
Using Unity 5.6.0 There is a "shader error in 'Custom/GS Billboard' : 'UnityObjectToClipPos': cannot implicitly convert from 'float4x4' to 'float4' at line 82 ( on d3d11)"
Hi,
Can this sdk work with Kinect v1 ???
If no, can u please tell me any possibility with the source code to make it work with Kinect v1.
Thanks
Krishna
Hi, this is great! The only problem is... I can't seem to get it to work on the hololens :(
It runs well in the Unity editor, and I can build a visual studio solution, but when I try to deploy it to the hololens it ends in failure. I have a feeling it must have something to do with a combination of conflicts regarding updates. I'm using Unity 2017, VS 2017, and the latest mixed reality toolkit (however I am not importing this into your sample project). Any suggestions on how to get this to deploy to the hololens? Thanks!
I've tried to use the hololens2 branch in unity and it works,but when I built them in hololens2, there was no reaction.
Then I rebuilt the NetworkCommunication in Release mode,but it failed and I could only ues Debug mode to rebuild.
The release mode error is MSB3073.
Hi,
I wanted to inquire if LiveScan3D-Hololens would work with the Realsense D400 series cameras ?
Thanks and Best Regards
Hi Marek,
I am trying to implement a headtracking based camera for a screen setup so that the pointclouds stand out more as threedimensional. Both the Kinect Client and the server have the skeleton data. Is there a good "official" way to access it in unity without having to adjust the server code? If not I might look into this on the server side but I wanted to ask before I start fiddling with that codebase as well.
Best,
Kai
I dont see any point cloud after entering the IP address. I dint have any errors building this.
Hi,@MarekKowalski, I use deploy the app on the hololens and input the server ip, but the hololens couldn't get any cloud points, and the server can run. I don't know where is wrong, Could you help me?
Thanks!
@MarekKowalski I have tried to open the LiveScan3D-Hololens with different versions of Unity.
Unity 5.6.1f1 crashes when I open the the project. Same result with Unity 5.6.0 too. I have tried auto-port (offered by Unity in latest version unity 2019.x and 2018.x) and there are complilation issues. In summary, I have livescan3D working properly but struggling to get LiveScan3D-Hololens to work with windows 10 and different versions of Unity.
Can you please say which windows version you used originally or the combined version of windows and unity (5.6.0 or Unity 5.6.1f1,...) that worked for you? I tried in Windows 10 Enterprise 64-bit (10.0, Build 17763).
Thank you and cheers,
Aravinda
P.S: A shout out to @marc-hanheide (my mentor) since he wished to join the discussion.
I build the vs project successfully and I could see the panel to input the ip. But after that, there is noting at all.
Hello,
First, very cool project! I wanted to try building this for iOS, but I'm running into an issue. What I've done:
The project compiles fine, but I see a warning under the GSG Billboard shader object, saying: "Shader Is Not Supported On This GPU (none of subshaders/fallbacks are suitable)". Does anyone know the reason for this? I'm not quite sure why the iOS GPU wouldn't be able to properly render this shader.
Thanks for any information you can provide, and thanks again for the cool project!
SocketException:由于目标计算机积极拒绝,无法连接。
System.Net.Sockets .Socket.Connect (System.Net.EndPoint remoteEP, Boolean requireSocketPolicy)
System.Net.Sockets .Socket.Connect (System.Net.EndPoint remoteEP)
System.Net.Sockets TcpClient.Connect (System .Net.IPEndPoint remote_ end_ point)
System.Net .Sockets .TcpClient.Connect(System.Net.IPAddres[] ipAddresses, Int32 port)
Hi guys,
When I try to run the code on HoloLens, it says the NetworkCommunication.winmd Module was built without symbols. Do you know what does that mean?
Thanks.
Changlin
Sorry, I have never learned Unity before. I have installed all the required applications (LiveScan3D /Kinects V2 / Unity-2018.4.14C1 /Visual Studio 2019), but when I opened Unity there was no response. Is there anything else I need to do after I open Unity? thank you
Hi,
Thank you for the really impressive application, I was very happy when I found it. I am an enthusiastic layman but I managed to use the LiveScan application, but I got stuck with Unity.
I have a Hololens 2 so I would like to be able to connect it but I couldn’t.
The LiveScan application is running, I see the live image, I can save ply, which I can play.
However, I ran into a problem with the LiveScan3D-Hololens application. The LiveScanServer is running, I see the live image. I open the project folder in Unity but I get stuck there. I get 6 error messages but each one starts the same way.
“DirectoryNotFoundException: Could not find a part of the path”
Unfortunately, based on this, I’m afraid I won’t be able to connect the thing with the Hololens either. Could you help me with what to install on the Hololens and exactly how to run the programs?
Use unity 2018.4.14f1 and VS 2017&2019 (recommended)
Thank you for your answer,
Benedek
Is it possible to increase the resolution of the point cloud?
Thanks
Does this code support Azure Kinect DK and Hololens2?
Thanks for providing source code of this project. I was trying to build this repository to use it together with LiveScan3D. I built the AuzreKinect branch of LiveScan3D and it works well. The problem is when I try to build LiveScan3D-Hololens for a HoloLens. To make it clear, the project works when it is inside Unity and even when the visual studio version is running it is inside the a HoloLens emulator.
Inside HoloLens, it stops working here:
As it is code from NetworkCommunication.dll, I tried adding dependency dlls of NetworkCommunication (i.e., msvcp140_app.dll, vccorlib140_app.dll, vcruntime140_app.dll), but it was not a fix. For the build, I used Unity 2018.4.14., Visual Studio 2019, and Windows SDK 10.0.18362.0. I used the .NET scripting backend for UWP from Unity.
Would there be any suggestions?
I can think of getting inside NetworkCommunication or using IL2CPP scripting backend, but not sure they make sense...
Hi,
When application is deployed to Microsoft Hololens, app opens asking to enter IP address. When server IP address is entered and submitted, it exits the application within few seconds. But in unity editor point cloud is rendered perfectly.
Unity Version - 5.6.0
Visual Studio Version - Visual Studio Community 2015.
LiveScan3d SDK - Livescan3d-1.0.0-vc12
Build Type - XAML UWP
Could you please have a look into this issue.
Thanks
Hello, great project! I am currently trying to get this to display on a magic leap. I removed the windows libraries, like was mentioned on the issue "Build for OpenVR", but it doesn't seem to show the stream. I changed the shader, thinking that was the issue, to another one that I saw would be able to render on many more devices, including phones, but that doesn't seem to be the issue. After debugging, it seems like everything is connected and working fine (Firewalls off, etc..) and I have it running on mobile phones, but I can't see the stream, although I can see other 3D objects that I put in the scene. I changed the scale and position, and still nothing. Any help would be appreciated!
A declarative, efficient, and flexible JavaScript library for building user interfaces.
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
An Open Source Machine Learning Framework for Everyone
The Web framework for perfectionists with deadlines.
A PHP framework for web artisans
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
Some thing interesting about web. New door for the world.
A server is a program made to process requests and deliver data to clients.
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Some thing interesting about visualization, use data art
Some thing interesting about game, make everyone happy.
We are working to build community through open source technology. NB: members must have two-factor auth.
Open source projects and samples from Microsoft.
Google ❤️ Open Source for everyone.
Alibaba Open Source for everyone
Data-Driven Documents codes.
China tencent open source team.