Comments (2)
Hi, I just wanted to clarify, is the task here creating a signals feature which allows the user to provide the replay strategies with additional information, whether that be in the form of files, databases, urls (api data), or functions?
from openadapt.
Hi @AvidEslami , thanks for asking!
First step would be to support this at a low level, e.g. to implement the APIs outlined above and figure out how to supply the results to a large language model in a way that makes sense.
Next up would be to figure out what is the appropriate means for the user to specify the signal. I think ideally we want to do this automatically behind the scenes as much as possible, for example by looking at what files are open in applications the user is interacting with, but this may not work or be sufficient in all cases.
from openadapt.
Related Issues (20)
- Audio recording instrumentation with `get_events`
- [Bug]: rename "window_data" to "a11y_data"
- [Bug]: rename "parent events" to "keyframe events"
- Onboarding HOT 1
- Docker + sockets
- Model pipeline HOT 1
- Add Posthog to system tray HOT 2
- [Bug]: Anthropic adapter logging issue
- [Bug]: `python -m openadapt.app.dashboard.run` broken HOT 6
- Simplify image description in `visual.py` and `segment.py`
- [Bug]: “OpenAdapt.app” cannot be opened because the developer cannot be verified. HOT 1
- [Bug]: recording from Dashboard doesn't display toast notifications HOT 1
- Expandable stack trace in error message HOT 1
- Price out self hosting glitchtip
- Upload data from dashboard
- Modify `WindowEvent.to_prompt_dict` to include computed centroid
- [Bug]: embedded video recordings don't start at 0:00
- Test opening a recording in the dashboard
- [Bug]: "copying a recording" appears to take a very long time when scrubbing from dashboard for the first time HOT 2
- Log everything to a file
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from openadapt.