Comments (2)
We don't have support for streaming audio right now.
There's nothing stopping you from sending one request after another with all the audio chunks you've received so far, and each time ask how many complete chants have been seen.
Or in a more "chat" style, after each new chunk ask how many new ones have been completed.
from cookbook.
We also need input audio streaming but for a less spiritual app. We're working on a WebRTC based terminal (https://github.com/tuzig/terminal7) and we want to let the user speak to the terminal and get assistance from Gemini. For example, when the user says: "Print all my GCP instances", Gemini's response - gcloud compute instances list
- is printed on the terminal leaving the user to press enter.
I've tested the current interface, sending an inline 10 second recording (~70K) and got a TTFB of ~3.5 seconds which is almost too slow. If gemini would accept voice input over a WebRTC audio channel and process the packets as they are received the TTFB will probably cut in half.
from cookbook.
Related Issues (20)
- https://github.com/google-gemini/cookbook/blob/main/quickstarts/File_API.ipynb gives error when loading HOT 1
- Cookbook: "Code examples" links needs to be updated HOT 2
- Enhance Function_calling.ipynb cookbook
- Gemini handle the pdf file? HOT 6
- Token counting for Audio input HOT 2
- AttributeError: 'File' object has no attribute 'state' HOT 1
- in Audio.ipyn count_tokens results in 403 HOT 3
- AI agent HOT 1
- A small spelling mistake HOT 4
- Add table of contexts for examples https://github.com/google-gemini/cookbook/tree/main/examples
- Run on Multiple Images HOT 2
- Sherlock_Jr.ipynb was removed HOT 3
- ALIHOSSAIN YT
- https://github.com/google-gemini/cookbook.git
- REST Example for Video prompting
- Bug Report the model often starts creating repetitive sequences of tokens HOT 9
- "response_schema" results in KeyError HOT 4
- Difference in Output Between PDF and DOC File Upload Methods HOT 2
- How to fine tune the model with images? HOT 1
- Cook book - responseSchema HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from cookbook.