mprib/visionflow

Vison Flow

A place for me to start to figure out how to use sockets to transmit frame data from an embedded device (i.e. Orange Pi) to a central client. I believe this is the primary component needed to create a scaleable open-source motion capture system. Otherwise, the bottleneck of a single system for pulling down pixels will result in a profound limnitation on number of cameras/available workflows.

notes to self

Needed to install sudo apt install qt6-wayland on Orange Pi Ubuntu `

visionflow's Issues

script takes CLI arg for host address

Trying to streamline the process of moving back between running localhost and running as remote server. To streamline the workflow I think a command line argument may save me from having to make little one off changes in the code and pull them back onto the pi

run local on orange pi

For initial testing purposes I need to make sure that I can get the localhost up and running on the orange pi and get a sense of the system resources it takes up.

pass frame through socket

This is a central issue that I need to figure out here. There are some components here that will be important:

create header for each packet that describes the contents

combine header and actual data into stream

send over socket

receive and unpack

Create separate processes in python

Create camera server as separate processes as part of python script .The client camera server can then be in the main thread and just connect to the appropriate port.

Do I need to do something to make sure the port is available? Not sure...

switch resolution of camera from client

convert to UDP for frame data

Optimization stage 2: This is the generally recommended way to handle video streaming so it is something that should definitely be done. Commands and other communication between client and server should still be on TCP, so I'll need the current framework to stay and become more robust/adaptible. Just something to keep in mind.

compress and decompress images

This is stage one of optimizations. Interested in how much it improves things while still using TCP

measure fps of send and receive