shycats / virtucamerablender Goto Github PK
View Code? Open in Web Editor NEWBlender add-on to use with VirtuCamera iOS App for realtime camera motion capture.
Home Page: https://virtucamera.com
License: Other
Blender add-on to use with VirtuCamera iOS App for realtime camera motion capture.
Home Page: https://virtucamera.com
License: Other
If we press CTRL+SPACE to maximize the viewport, during an active vCam session, the app becomes unresponsive.
Error as below
Read prefs: C:\Users\sgoda\AppData\Roaming\Blender Foundation\Blender\2.93\config\userpref.blend
VirtuCamera: Blender plug-in version 1.1.0 | Server version 2.1.2
Loading vCam settings
Read blend: C:\Users\sgoda\Downloads\3_treescene_front.blend
Loading vCam settings
VirtuCamera: Listening on TCP port 23354
VirtuCamera: Accepted connection from: 192.168.1.179:49490
VirtuCamera: Starting Viewport Capture. 60.00 fps, 2.00 Mbits/s, Opaque: 1, Autosend: 1
Traceback (most recent call last):
File "C:\pipeline\work\code\wkr\wkr_vp_tools_win\blender\2.93\win\scripts\addons\virtucamera_blender\virtucamera_blender.py", line 862, in timer_function
vcserver.execute_pending_events()
File "vc_core.pyx", line 1007, in virtucamera.vc_core.VCServer.execute_pending_events
File "vc_core.pyx", line 1408, in virtucamera.vc_core.VCServer._async_get_capture_pointer
File "C:\pipeline\work\code\wkr\wkr_vp_tools_win\blender\2.93\win\scripts\addons\virtucamera_blender\virtucamera_blender.py", line 669, in get_capture_pointer
(x, y, width, height) = self.get_view_camera_rect()
File "C:\pipeline\work\code\wkr\wkr_vp_tools_win\blender\2.93\win\scripts\addons\virtucamera_blender\virtucamera_blender.py", line 88, in get_view_camera_rect
zoom_value = r3d.view_camera_zoom
AttributeError: 'NoneType' object has no attribute 'view_camera_zoom'
Hi.
I am on a M2 MacBook and I downloaded the latest Blender plugin. I am able to start the server, but when connecting to it from the app, Blender crashes. Following is the trace report after crash.
# Blender 4.0.0, Commit date: 2023-11-13 17:26, Hash 878f71061b8e
bpy.context.space_data.system_bookmarks_active = 4 # Property
bpy.ops.file.external_operation(filepath="/Users/sgoda/Downloads/", operation='FOLDER_OPEN') # Operator
Modules Installed (virtucamera_blender) from '/Users/sgoda/Downloads/VirtuCameraBlender-cp310-macos-universal64-v1.2.0.zip' into '/Users/sgoda/Library/Application Support/Blender/4.0/scripts/addons' # Info
# backtrace
0 Blender 0x00000001050e4190 BLI_system_backtrace + 56
1 Blender 0x0000000104a0724c _ZL16sig_handle_crashi + 352
2 libsystem_platform.dylib 0x0000000183f20a24 _sigtramp + 56
3 vc_core.cpython-310-darwin.so 0x00000001680c2204 PyInit_vc_core + 122856
4 vc_core.cpython-310-darwin.so 0x00000001680dc4a0 PyInit_vc_core + 230020
5 vc_core.cpython-310-darwin.so 0x00000001680cd230 PyInit_vc_core + 167956
6 vc_core.cpython-310-darwin.so 0x00000001680dd9f4 PyInit_vc_core + 235480
7 Blender 0x000000010b0d6034 cfunction_vectorcall_O + 316
8 Blender 0x000000010b160ab0 _PyEval_EvalFrameDefault + 24176
9 Blender 0x000000010b15ab34 _PyEval_Vector + 164
10 Blender 0x000000010b163a4c call_function + 452
11 Blender 0x000000010b1607a4 _PyEval_EvalFrameDefault + 23396
12 Blender 0x000000010b15ab34 _PyEval_Vector + 164
13 Blender 0x000000010b163a4c call_function + 452
14 Blender 0x000000010b1607a4 _PyEval_EvalFrameDefault + 23396
15 Blender 0x000000010b15ab34 _PyEval_Vector + 164
16 Blender 0x000000010b0920b0 method_vectorcall + 308
17 Blender 0x000000010b1fc9cc thread_run + 72
18 Blender 0x000000010b1b0674 pythread_wrapper + 28
19 libsystem_pthread.dylib 0x0000000183ef1034 _pthread_start + 136
20 libsystem_pthread.dylib 0x0000000183eebe3c thread_start + 8
# Python backtrace
File "/Applications/Blender.app/Contents/Resources/4.0/python/lib/python3.10/threading.py", line 953 in run
File "/Applications/Blender.app/Contents/Resources/4.0/python/lib/python3.10/threading.py", line 1016 in _bootstrap_inner
File "/Applications/Blender.app/Contents/Resources/4.0/python/lib/python3.10/threading.py", line 973 in _bootstrap
Hello !
This add-on is very promising ! I would like to know if it is possible to get the stream directly from the computer where Blender is executed ? It would be awesome - and very useful for me - to be able to read the stream from a browser, or from vlc for instance :)
If not, do you think it would be something easy to develop from what you did ?
Thank you !
hi,
I tested in both Blender 3.2.2 with v1.1.1 and 3.6.9 versions with v1.2.0 on Windows, and both my iPhone and iPad showed the same result: stuck at Connecting stage, no further movement. My firewall was turned off, and all connected to same stable wifi, any idea why this happened? Terminal output I got after tried to connect. Thanks
Read prefs: "C:\Users\Linsong\AppData\Roaming\Blender Foundation\Blender\3.6\config\userpref.blend"
HardOps 0.9.87.37 available!
Registered MACHIN3tools 1.0.2 with 1 tool, 1 pie menu
Pillow is not installed, therefore:
- BIP images load without scaling.
- Other images load slowly (Blender standard).
Pillow is not installed, therefore:
- BIP images load without scaling.
- Other images load slowly (Blender standard).
Pillow is not installed, therefore:
- BIP images load without scaling.
- Other images load slowly (Blender standard).
Registered MESHmachine 0.11.2 with 2 plug libraries
• plug library: Examples
• plug library: MyPlugs
DEBUG:BlenderGIS-master.core.checkdeps:GDAL Python binding unavailable
DEBUG:BlenderGIS-master.core.checkdeps:PyProj unavailable
DEBUG:BlenderGIS-master.core.checkdeps:Pillow unavailable
DEBUG:BlenderGIS-master.core.checkdeps:ImageIO Freeimage plugin available
Substance 3D in Blender: INFO - Shader Presets initialized...
VirtuCamera: Blender plug-in version 1.2.0 | Server version 2.1.2
Substance 3D in Blender: INFO - Scene Substances loaded correctly
Pillow is not installed, therefore:
- BIP images load without scaling.
- Other images load slowly (Blender standard).
Substance 3D in Blender: INFO - Scene Substances loaded correctly
VirtuCamera: Listening on TCP port 23354
VirtuCamera: Accepted connection from: 10.0.0.115:54951
Traceback (most recent call last):
File "C:\Users\Linsong\AppData\Roaming\Blender Foundation\Blender\3.6\scripts\addons\virtucamera_blender\virtucamera_blender.py", line 862, in timer_function
vcserver.execute_pending_events()
File "vc_core.pyx", line 1007, in virtucamera.vc_core.VCServer.execute_pending_events
File "vc_core.pyx", line 1842, in virtucamera.vc_core.VCServer._send_server_info
File "vc_core.pyx", line 1830, in virtucamera.vc_core.VCServer._get_server_name
UnicodeEncodeError: 'ascii' codec can't encode character '\u2018' in position 7: ordinal not in range(128)
VirtuCamera: Listening on TCP port 23354
VirtuCamera: Accepted connection from: 10.0.0.115:54952
Traceback (most recent call last):
File "C:\Users\Linsong\AppData\Roaming\Blender Foundation\Blender\3.6\scripts\addons\virtucamera_blender\virtucamera_blender.py", line 862, in timer_function
vcserver.execute_pending_events()
File "vc_core.pyx", line 1007, in virtucamera.vc_core.VCServer.execute_pending_events
File "vc_core.pyx", line 1842, in virtucamera.vc_core.VCServer._send_server_info
File "vc_core.pyx", line 1830, in virtucamera.vc_core.VCServer._get_server_name
UnicodeEncodeError: 'ascii' codec can't encode character '\u2018' in position 7: ordinal not in range(128)
Blender 3.5 introduces the Metal backend on MacOS platform and when using VirtuCamera on those devices, the streaming of the viewport does not occur. It says that the gpu module must be used, instead of the bgl module.
Hi
When I tap the eye icon in iPad app to stream viewport, the plugin crashes and stop working
If I don't touch it, everything else works fine
Software: Blender 2.93.4
Scene: Default cube setup
Plugin version: VirtuCameraBlender-cp39-windows-x64-v1.1.0.zip
Here is the console
VirtuCamera: Starting Viewport Capture. 60.00 fps, 2.00 Mbits/s, Opaque: 1, Autosend: 1 Traceback (most recent call last): File "C:\Users\Reiko\AppData\Roaming\Blender Foundation\Blender\2.93\scripts\addons\virtucamera_blender\virtucamera_blender.py", line 862, in timer_function vcserver.execute_pending_events() File "vc_core.pyx", line 1007, in virtucamera.vc_core.VCServer.execute_pending_events File "vc_core.pyx", line 1795, in virtucamera.vc_core.VCServer._start_streaming File "vc_core.pyx", line 1583, in virtucamera.vc_core.VCServer._start_encoding File "vc_core.pyx", line 1537, in virtucamera.vc_core.VCServer._start_subprocess File "vc_core.pyx", line 1520, in virtucamera.vc_core.VCServer._get_environment TypeError: can only concatenate list (not "str") to list
The ios app is not letting me pick any camera in the scene when first connecting to the desktop. I've tried multiple new files and versions 2.93, 3.1 and 3.2 and the cameras still don't show up.
It works fine in blender 4.0 though.
Traceback (most recent call last):
File "C:\apps\blender-4.1.0-candidate+v41.b9ef66693adf-windows.amd64-release\4.1\scripts\modules\addon_utils.py", line 376, in enable
mod = importlib.import_module(module_name)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\apps\blender-4.1.0-candidate+v41.b9ef66693adf-windows.amd64-release\4.1\python\Lib\importlib_init_.py", line 126, in import_module
return _bootstrap._gcd_import(name[level:], package, level)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "", line 1204, in _gcd_import
File "", line 1176, in _find_and_load
File "", line 1147, in _find_and_load_unlocked
File "", line 690, in load_unlocked
File "", line 940, in exec_module
File "", line 241, in call_with_frames_removed
File "C:\Users\rajar\AppData\Roaming\Blender Foundation\Blender\4.1\scripts\addons\virtucamera_blender_init.py", line 37, in
from .virtucamera_blender import *
File "C:\Users\rajar\AppData\Roaming\Blender Foundation\Blender\4.1\scripts\addons\virtucamera_blender\virtucamera_blender.py", line 39, in
from .virtucamera import VCBase, VCServer
File "C:\Users\rajar\AppData\Roaming\Blender Foundation\Blender\4.1\scripts\addons\virtucamera_blender\virtucamera_init.py", line 42, in
from .vc_core import VCServer
ModuleNotFoundError: No module named 'virtucamera_blender.virtucamera.vc_core'
I think the tool is amazing and works quite well.
One feature it's missing I think is the ability to offset the camera position / rotation while holding the phone/tablet.
The Lock XZ / Y feature helps to get to an initial start position that correlates better with the real world.
But the ability to rotate the Z Axis would help a lot.
I'm not sure how to extend the python script to set_camera_transform. I think it would require extending the iOS App as well for a convenient UI.
One or two suggestions:
Anyway great tool!
I just tested latest addon for Blender 2.93 and 3.0, both unable to connect to iPhone, eventhough they are using the same WIFI. Not sure why.
Something wrong with QR and the address, I thought, but I checked and manual input, none seems to be working.
Hello! Thanks for your great application!
I have an issue. Plugin works on 2.83 but not in 2.93
Would you kindly fix it please
Not sure if this is related to scene density, or number of vertices, but sometimes even simple scenes don't display a QR code when I start serving no matter how many times I try to restart blender or the file. I tried both v1.0.0 and v1.0.1
PC: Ryzen 3900X with RTX 2080 Super, Windows 10 (20H2), Blender 2.90.1
iOS device: iPad Pro 2020 (11-inch)
Everything works fine with the default cube setup. (This is a very promising app + plugin!).
Then, I tried a more complex scene, which is the official demo scene "Mr. Elephant" from Blender (https://download.blender.org/demo/eevee/mr_elephant/). At first, the tracking system works fine, I can also stream blender viewport to my iPad easily. However, whenever I hit the record button to start recording camera movement, the stream would suddenly freeze, and the blender plugin seemed to stop responding to the iOS client. Even when the blender viewport is at wireframe mode and the streaming from blender to iOS is not enabled, still, that record button would make the plugin suddenly paralyzed. And I have to manually click "stop serving" and then click "start serving" to be able to reconnect to the server and make tracking system work again.
I believe this very well may not be a performance problem since my machine is a pretty decent one if not the best specced. At least it should handle the wireframe mode with no problem.
Would love to know the cause of this and maybe the solutions. Thank you so much.
Hey ! Thanks a lot for your so amazing add-on ! I love it !
It would be so great to add the possibility to play the audio in the edit page while recording, especially for music videos.
It's more an update idea than an issue.
Thanks again for your work !
Marian
It would be really great to be able to hold the phone vertically while using this addon. especially for making blender animations that are a portrait resolution
At the moment, when recording takes (after hitting the record button), we have to manually hit playback button in Blender/Maya, so that animation in the scene also plays back.
It will be great if the recording action in the app can call the server callback that plays back the animation (It seems to already exist), but is not called yet.
Hello,
after finish capturing Blender crashes. What can I do?
System Information
Operating system: Windows-10-10.0.22000-SP0 64 Bits
Graphics card: NVIDIA GeForce GTX 1080 Ti/PCIe/SSE2 NVIDIA Corporation 4.5.0 NVIDIA 472.12
Blender Version
Broken: version: 3.0.0 Alpha, branch: K-CyclesX2, commit date: 2021-09-07 16:45, hash: rB99e8feeac826
Worked: (newest version of Blender that worked as expected)
Hi.
While Blender 3.0.x uses Python 3.9 version, the upcoming release of Blender, Blender 3.1.0 (slated to be released in March, 2022) is switching to Blender 3.10.2. What is the timeline for releasing the add-on to work with Blender 3.1.0?
Thank you,
Satish.
the addon for blender fails to install in the current version of blender.
I would like the device position to define rate, not absolute position and remove the limits. Also when the device it rotated, I want the position/rate command to be correct wrt to the current orientation of the device/camera. Basically make fly through / fly around possible. Thank you,
A declarative, efficient, and flexible JavaScript library for building user interfaces.
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
An Open Source Machine Learning Framework for Everyone
The Web framework for perfectionists with deadlines.
A PHP framework for web artisans
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
Some thing interesting about web. New door for the world.
A server is a program made to process requests and deliver data to clients.
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Some thing interesting about visualization, use data art
Some thing interesting about game, make everyone happy.
We are working to build community through open source technology. NB: members must have two-factor auth.
Open source projects and samples from Microsoft.
Google ❤️ Open Source for everyone.
Alibaba Open Source for everyone
Data-Driven Documents codes.
China tencent open source team.