buildingvolumes/unity_geometry_sequence_streaming

A package and tools for Unity to stream large Pointcloud and Mesh frame sequences from disk

---

A package for Unity to stream large pointcloud and (textured) mesh sequences from disk

Github_showreel.mp4

Credits

Overview:

This package allows you to stream large and heavy geometric frame sequences (where each frame of an animated sequence is saved in a single file) inside of Unity. The package was orginally developed to allow playback of Volumetric Video captures, but can also be used to play any animated 3D-sequences, that are unsuitable for bone or blendshape workflows. Usecases are for example: Simulations (physics, fluids), animated meshes with changing topology and animated pointclouds.

Quickstart

Features

• Streams sequences directly from disk, no import into Unity needed
• Support for animated Pointclouds, Meshes and Textures
• Control your playback with a custom Editor UI
• Timeline support
• Scripting API

Install & Usage:

Please see the documentation website

Unity Forums Thread

License:

Licensed under the MIT License

Thanks to:

Charite Experimental Surgery lab, for supporting much of the development: Website | Github

unity_geometry_sequence_streaming's Issues

Pointcloud Shader not working on Metal/OpenGL

Problem:
The Pointcloud Geometry Shader does not work on Apple Metal or OpenGLCore. Error is: Shader not supported on this GPU: Found no suitable fallbacks.

Expected Behaviour / Fix
Pointcloud Geometry Shader should work on Apple Metal, OpenGLCore and other OpenGL versions on Android.

The transform of Streamed Meshes should be settable before going into play mode

Problem:
Currently, you can only change the position of a streamed mesh after going into play mode, as the streamed mesh is created on runtime. You should be able to set it's position in the editor

Expected Behaviour / Fix
Add an option to parent the streamed mesh to an exisiting gameobject, which you can then use to transform the streamed mesh.

Android /WebGL cannot load data from StreamingAssets Path

Problem:
Android builds won't show any Streamed Geometry, as the path cannot be read properly from the StreamingAssets. Streamingsassets path on Android is a URL, not a file, which can't be read by the Streaming code.
Additionally, StreamingAssets should not be promoted as the go-to destination on Android for files, this should be the ApplicationDataPath.

Solution:
Load Streamingasset files on Android and WebGL builds via the WebRequest Class. Additionally add info into the documentation and editor which promotes the correct usage of the ApplicationDataPath

Currently working on fixing this!

Cannot build as AssetDatabase cannot be used outside the editor

Problem:
At the moment, builds on all platforms are not possible, as the code for auto-populating Material Slots can only run inside the editor

Solution:
Make the auto-population script run only inside the Editor

Currently working on fixing this!

API Player Example: Pathtype not defined

Problem:
When loading the samples, a compiler error will appear, that "Pathtype is not defined" in the API Player Example script. This is caused by some refactoring.

Expected Behaviour / Fix
Change Classname which contains the pathtype to the correct class

Meshes/Pointclouds are mirrored on the X-Axis

Problem:
Meshes and Pointclouds that are loaded through the plugin will appear mirrored on the X-Axis. Could be a problem caused through the coordinate system of Unity

Expected Behaviour / Fix
Add an option that is enabled by default to mirror the X-Axis, if it's not a bug caused while reading the geometry.