Comments (12)
Hi @goldengrape , an autonomous agent is a concept from the LangChain library for GPT to take iterative actions based on user input and available information (context). More details can be found here: https://python.langchain.com/en/latest/modules/agents.html
Agent's ability to make incremental progress through iterative API calls is what gives it power to solve complex problems. However, sometimes it gets stalled after repeated tries until the max iterations.
In the short term, one potential way to alleviate this problem is through API caching, which is part of our road map.
Thank you!
from ai-research-assistant.
Could you share the queries you used in Zotero RA, so I can test on my side?
I just tested two queries and none of them worked for me. One of the queries is something like “How to design a controller to control a vehicle.”
from ai-research-assistant.
In the latest release, the chat window will display all the intermediate actions taken by the bot for each output. This hopefully gives you more insight into what it is doing and where it gets into problems.
Thank you for the update! Now I got the desired responses with version 0.0.8! I tested for both "Hello" and more specific questions as before.
Also, the token usage is much smaller now.
First query:
gpt-3.5-turbo-0301, 3 requests
2,945 prompt + 216 completion = 3,161 tokens
Second query:
gpt-3.5-turbo-0301, 3 requests
2,913 prompt + 609 completion = 3,522 tokens
Third query:
gpt-3.5-turbo-0301, 6 requests
6,667 prompt + 633 completion = 7,300 tokens
from ai-research-assistant.
Hi @andreifoldes The chatbot uses GPT to decide how to answer a question by breaking it up into several steps.
In your case, it 1) converted your question into a search query, 2) used the query to search in Zotero and then 3) tried to retrieve an article (item 194) for response synthesis. This process makes sense. But the last step somehow went wrong as the chatbot was repeatedly trying to fetch the same item - likely it was not able to get enough information to answer your question.
You can ask the chatbot to retrieve item 194 to take a look yourself.
I am currently working on a "routing" mechanism to give users more control over how a question should be answered. I invite you to give it a try when it is released.
from ai-research-assistant.
I hope this could be resolved soon. Today, I had found the following token usage but I got no results from the query.
First query:
gpt-3.5-turbo-0301, 22 requests
28,762 prompt + 1,018 completion = 29,780 tokens
Second query:
gpt-3.5-turbo-0301, 15 requests
25,971 prompt + 919 completion = 26,890 tokens
from ai-research-assistant.
Could this be related to the fact that there are too many items in the Zotero library? In my current Zotero library, there are more than 800 items. If this is the case, to partly address this issue, it would be great if one can query based on a certain sub-collection of a library. Maybe within this sub-collection, there are 10 items. Then the token usage would be much smaller?
from ai-research-assistant.
Could this be related to the fact that there are too many items in the Zotero library?
Hi @wenlzhang , it is a valid hypothesis, although I can't be sure without knowing your questions. Would you mind sharing your questions so we can potentially use them for future optimization? Thanks
from ai-research-assistant.
I can't be sure without knowing your questions
My questions and assumptions are as follows:
- My Zotero library contains too many items. This might require many tokens/iterations to handle, which may be one of the reasons for causing the current issue: "Agent stopped due to max iterations".
- Even if the current issue is not caused by this point, allowing to query based on a sub-collection may help reduce the token usage and make the answers more relevant.
from ai-research-assistant.
Hi @wenlzhang thanks for the suggestions. Totally make sense to me.
Could you share the queries you used in Zotero RA, so I can test on my side?Thanks!
from ai-research-assistant.
I just tested two queries and none of them worked for me. One of the queries is something like “How to design a controller to control a vehicle.”
When I further reflect on this now, the max iterations issue could also be related to the fact that the items in my Zotero library cover may topics. Let's say, there are 800 items in total, but only 20 papers are closely related to my query. Still, the RA may need to handle all items and try to find related items. If not handled efficiently, this may easily cause issues, I assume.
from ai-research-assistant.
@wenlzhang In the latest release, the chat window will display all the intermediate actions taken by the bot for each output. This hopefully gives you more insight into what it is doing and where it gets into problems.
@goldengrape The maximum iterations (steps) has been reduced from 15 to 6. Beyond that, it is most likely running in circles and won't produce meaningful output.
Please give it a try and let me know your feedback.
from ai-research-assistant.
I brushed up against a similar issue. My question would be whether it would be possible the return at least "some" intermediate answer even when "max iteration stoppage" happens? If I understand correctly some information has been gained up to this point no?
(thanks for aria!)
from ai-research-assistant.
Related Issues (20)
- Unable to install - not compatible with Z 6.0.30? HOT 4
- Appearance and font size HOT 9
- Cannot resize window HOT 6
- not extracting text HOT 3
- Umlauts are misrepresented in output. HOT 5
- "Paper doesn't provide abstract or additional information", is PDF not considered in GPT4 call? HOT 4
- The model `gpt-4-1106-preview` is not available. Zotero 6.0.30 ARIA 0.6.5. HOT 5
- getBestAttachment() can only be called on regular items HOT 1
- Field 'title' Not Set HOT 4
- How to fix the window in the front HOT 2
- Not finding all papers in Zotero library HOT 1
- does not look into the paper? HOT 5
- ARIA icon not appearing in the setting panel on Mac OS HOT 1
- Any prompt leads to 'Something has gone wrong within Aria' HOT 2
- Allow ARIA to cancel a query HOT 2
- Something has gone wrong within Aria HOT 1
- I encountered this error, though I have chatgpt 4 and valid API key? HOT 8
- LLMAs alternatives to ChatGPT HOT 9
- ARIA into other languages portuguese HOT 4
- Issue on using model chatgpt-3.5-turbo HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from ai-research-assistant.