doughtmw / hololensforcv-unity Goto Github PK
View Code? Open in Web Editor NEWHoloLens research mode streams for use in Unity.
HoloLens research mode streams for use in Unity.
Hi, I followed the instructions in your repo. I have built and deployed the app to the HoloLens 2. I can see the blank Canvas with the Text which never goes beyond the message: "Initializing MediaFrameSourceGroups". I have questions in order to clarify your instructions to make sure I did it correctly:
In step 2: I presume I need to create the subfolder folder named x86 in Assets->Plugins in the Unity project and copy the 2 dlls and winmd files into it.
In step 3: "build using IL2CPP" Does this involve importing the MRTK2 Foundation package to the Unity project, or does this just involve switching platform to Universal Windows Platform (UWP)?
In step 4: Do I manually edit the <Capabilities> xxx </Capabilities> xml myself to match what you've shown or does this happen as a result of editing the code above it during build time.
In step 5: To build and deploy from Visual Studio, do I target ARM or ARM64? The HoloLens 2 device does not support x86.
From your personal blog:
" be sure to select the Assembly-CSharp.Player ": Where can I find this setting in Visual Studio?
Other potential issues:
I would be obliged and indebted to you if you can clarify these questions. Thank you in advance.
x86 configuration is not available for HololensForCV in configuration manager dropdown. I wanted to add some extra bit of code to "DepthPvMapper" but not sure how to build it after that..Please help
From your blog:
"Open C# Unity scripts in Visual Studio, and be sure to select the Assembly-CSharp.Player viewing option for code, otherwise ENABLE_WINMD_SUPPORT code in the #define directive with appear greyed out."
How exactly do I enable Assembly-CSharp.Player?
Nice work,
Thank you.
First of all, thank you for your hard work.
my project is creating a 3D model on a specific color area as some kind of marker.
Basically it works like a point cloud that transformed a specific pixel area of color range in a color image into spatial coordinates.
In my opinion, It's a necessary process that pixel-by-pixel mapping between color and depth images, for this project.
So your code is a very good reference to me, but I don't know how to apply it in hololens2 .
https://github.com/petergu684/HoloLens2-ResearchMode-Unity
Apart from this, I am trying to translate a python script in the official repo of the link to c++, for frame-by-frame processing.
can you help me?
I successfully configured your project, this is a very good example. But I have some questions to ask you. I changed the code to directly read the depth map information and save it in byte[]. When I display it on the texture, it seems to be almost completely black. My code as follow:
` var DepthFrame = latestShortDepthCameraFrame.SoftwareBitmap;
DepthFrame = SoftwareBitmap.Convert(DepthFrame, BitmapPixelFormat.Rgba8, BitmapAlphaMode.Premultiplied);
var w = DepthFrame.PixelWidth;
var h = DepthFrame.PixelHeight;
Destroy(_pvDepthTexture);
_pvDepthTexture = new Texture2D(
w,
h,
TextureFormat.RGBA32, false);
if (bytes==null)
{
bytes = new byte[w * h * 4];
}
DepthFrame.CopyToBuffer(bytes.AsBuffer());
DepthFrame.Dispose();
_pvDepthTexture.LoadRawTextureData(bytes);
`
I also noticed that in your example, it seems that all the depths are displayed in white. I am a novice and it is really difficult to understand. Please help me to solve this confusion.
It can be deployed to the HoloLens successfully, but it is prompted that it cannot load "kernelbase.pdb/dll" during operation. After ignoring that, I can not the image, only blank. However, the text and the gesture recognition are normal. Did you meet this problem???
The following error is populating when run the command
git submodule update --init
D:\Work\HiTechTEDs\AR\experimental\HoloLensForCV-Unity>git submodule update --init
Cloning into 'D:/Work/HiTechTEDs/AR/experimental/HoloLensForCV-Unity/HoloLensForCV'...
[email protected]: Permission denied (publickey).
fatal: Could not read from remote repository.
Please make sure you have the correct access rights
and the repository exists.
fatal: clone of '[email protected]:doughtmw/HoloLensForCV.git' into submodule path 'D:/Work/HiTechTEDs/AR/experimental/HoloLensForCV-Unity/HoloLensForCV' failed
Failed to clone 'HoloLensForCV'. Retry scheduled
Cloning into 'D:/Work/HiTechTEDs/AR/experimental/HoloLensForCV-Unity/HoloLensForCV'...
[email protected]: Permission denied (publickey).
fatal: Could not read from remote repository.
Please make sure you have the correct access rights
and the repository exists.
fatal: clone of '[email protected]:doughtmw/HoloLensForCV.git' into submodule path 'D:/Work/HiTechTEDs/AR/experimental/HoloLensForCV-Unity/HoloLensForCV' failed
Failed to clone 'HoloLensForCV' a second time, aborting
Wonderful project, with the Readme descriptions the build worked without a problem, thanks!
Two issues I am having:
Hi,
How to get the 3D world point of a pixel position in the color frame?
I want to get output files of hololensforcv project, but it built error because:Unable to resolve external symbols... I konw that maybe configurations' wrong, but do not know how to slove it. Hope you can help me.
I did not have opencv4.1.1 in my PC and not creat NuGet package(that is necessary?), and I don't know if it can cause the error.
A declarative, efficient, and flexible JavaScript library for building user interfaces.
๐ Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
An Open Source Machine Learning Framework for Everyone
The Web framework for perfectionists with deadlines.
A PHP framework for web artisans
Bring data to life with SVG, Canvas and HTML. ๐๐๐
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
Some thing interesting about web. New door for the world.
A server is a program made to process requests and deliver data to clients.
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Some thing interesting about visualization, use data art
Some thing interesting about game, make everyone happy.
We are working to build community through open source technology. NB: members must have two-factor auth.
Open source projects and samples from Microsoft.
Google โค๏ธ Open Source for everyone.
Alibaba Open Source for everyone
Data-Driven Documents codes.
China tencent open source team.