robotpt / vision-project Goto Github PK
View Code? Open in Web Editor NEWA robot interaction to help low vision people read more.
License: MIT License
A robot interaction to help low vision people read more.
License: MIT License
This issue will be a place for discussion and collecting resources for using audio features for robot interaction adaptation
It is one goal of the project to use audio data from the participant reading various texts in some meaningful way to cause the robot to adapt the interaction. The first part of this is to understand what features we can sense and from there we can think about what we can adapt based on this information.
We are having trouble restarting interactions on QT likely because of how it's network is setup. Instead can make a script to start the interaction from Dataplicity. This is an easy workaround for now and will let us focus on getting the full interaction together.
The ros-vision-interaction
folder is in the top directory. It would be more consistent to put the directory in the src
folder.
For some reason (probably network reasons), the Docker container doesn't restart correctly on QT. A possible approach to solving this is by installing the required software locally.
It would be great to run the interaction directly, as we did in the ABM project.
If we want the interaction to continue on restarts, we can do step 7 here.
The title of "On your local machine" is kind of confusing with Docker, since Docker can also be installed on the local machine but not native.
This project uses packages including robotpt_common_utils
, schedule
, and freezegun
that need to be included in the Dockerfile.
We will need to have a persistent state database of some sort. This database should handle concurrency issues, that is being written to by several sources at the same time.
This can be accomplished by creating a node that uses audrow/email-keyword-matcher
(which requires Python 3.6 or newer) and having that node listen for file upload events from robotpt/ros-data-capture
's aws_uploader
. When a new file is uploaded (possibly after regexing for video formats), an email is sent with possible modes of feedback. Once an email reply is recieved, that feedback can be sent to the main controller to use.
Also, robotpt/ros-data-capture
's directory_size_manager
should be used to make sure that the folder where the videos are saved doesn't grow too large if videos are being recorded but not uploaded, say, due to slow internet.
A declarative, efficient, and flexible JavaScript library for building user interfaces.
๐ Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
An Open Source Machine Learning Framework for Everyone
The Web framework for perfectionists with deadlines.
A PHP framework for web artisans
Bring data to life with SVG, Canvas and HTML. ๐๐๐
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
Some thing interesting about web. New door for the world.
A server is a program made to process requests and deliver data to clients.
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Some thing interesting about visualization, use data art
Some thing interesting about game, make everyone happy.
We are working to build community through open source technology. NB: members must have two-factor auth.
Open source projects and samples from Microsoft.
Google โค๏ธ Open Source for everyone.
Alibaba Open Source for everyone
Data-Driven Documents codes.
China tencent open source team.