Comments (6)
I'm trying to debug an issue with the example you've shared which is documented. At first my implementation was working but after a few interactions I am no longer getting results.
My investigation brought me to this issue in which I'd thought the source was with the API reponse, however I have been unable to debug where the problem occurs.
First thought was perhaps there is an issue with the streams not being closed which is exacerbated when NextJS restarts the dev server on code change. I'm currently unable to confirm this and as there are so many moving parts, I fear this may take some time to debug.
In the meantime, I have fallen back to using the OpenAI integration which has been easier to setup.
Absolutely love the project and the work that has gone into streamlining the integrations ❤️ I'm excited to see where this project goes.
from ai.
Thank you! Feel free to open an issue or discussion whenever you're running into a problem again. I'll close this for now as there's nothing to track at the moment.
from ai.
Can you check what response
is? There might be some error message attached.
from ai.
Running the following:
const h = require('@huggingface/inference');
const Hf = new h.HfInference(process.env.HUGGINGFACE_API_KEY);
// Request the HuggingFace API for the response
async function start() {
const response = Hf.textGenerationStream({
model: 'oasst-sft-4-pythia-12b-epoch-3.5',
inputs: 'Hello',
parameters: {
max_new_tokens: 200,
typical_p: 0.2,
repetition_penalty: 1,
truncate: 1000,
},
});
console.log('Response: ', response);
const completion = response.generated_text;
console.log('Completion: ', completion);
}
start();
Outputs:
Response: Object [AsyncGenerator] {}
Completion: undefined
from ai.
As you can see, response.generated_text
is not defined. Where did you find the code of response.generated_text
in the docs?
We have an example here here that shows how the SDK should be used:
from ai.
@karlbateman did you find what was the issue? I encounter the same situation in which it just stops working and I can't error handle it. Code change hot reloading came to my mind too but can't confirm it
from ai.
Related Issues (20)
- Add stop helper to useAssistant HOT 4
- Request to review changes for Vercel deployment HOT 3
- DOMException [InvalidCharacterError]: Invalid character HOT 1
- `streamObject` alternating between `undefined` and the response HOT 8
- aistate messages dissapear?
- 'useUIState' is not exported from 'ai/rsc' HOT 4
- Tool calls do not work as expected HOT 14
- No errors thrown even if there is no response HOT 3
- streamObject works on local machines, but not when deployed to vercel (pro user) HOT 11
- fail type inference at createStreamableValue HOT 3
- Error: action is not a function HOT 4
- AI State not updated during iterations
- Client side not working Next:JS HOT 5
- Demo streamUI with a custom provider HOT 1
- web-llm integration HOT 3
- "You uploaded an unsupported image" when trying to streamText with image data HOT 8
- `experimental_onToolCall` callback is not triggered but the `tool_calls` correctly streamed HOT 1
- Issue submitting image query with base64 data HOT 5
- Multiple Streamable UIs Disappear in Production Builds When Calling .done() HOT 2
- Examples for function composition HOT 2
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from ai.