Comments (19)
Where is for Linux?
Also I did it on Windows 10 and nothing hapened? Can you explain me in details? Maybe I'm missing something.
from freedomgpt.
Sorry, it's unusably slow. I have an Intel i7-12700F, 32 GB RAM, GeForce GTX 1080Ti. I'm not going to leave it on overnight to wait for an answer. Disappointed.
from freedomgpt.
try executing the chat app in resources/models/(OS) and see what happens...
from freedomgpt.
It is a CLI application, so execute it in terminal or command prompt. You will have to direct it to the model location and run it in interactive mode, something like:
chat.exe -m %USERPROFILE%\FreedomGPT\ggml-alpaca-7b-q4.bin -i --color
You will get a prompt once the model is loaded. You should tell it what to do there.
For Linux, I don't know where it is located. You should have installed the chat compiled from alpaca.cpp in a bin directory somewhere...
probably in /usr/bin/chat but who knows.
from freedomgpt.
C:\Users\IvanB\AppData\Local\FreedomGPT\app-1.1.2\resources\models\windows> chat.exe -m C:\Users\IvanB\FreedomGPT\ggml-alpaca-7b-q4.bin -i --color
Still nothing..
from freedomgpt.
Can you help me? Why I got nothing?
from freedomgpt.
Can you help me? Why I got nothing?
You don't get a response at all?
Do you get the opportunity back to write a new command, or does it hang?
You may need to tell us your computer specifications.
Maybe your pc cannot handle this.
from freedomgpt.
That is:
CPU: Intel(R) Pentium(R) Gold G5400 CPU @ 3.70GHz 3.70 GHz
GPU: nVidia Geforce GTX 1650 4GB
RAM: 8,00 GB
System type: 64-bit, processor x64
from freedomgpt.
Yeah, then you should hold your breath. For a long time.
With those specs it will take a lot of time for the model to be ready and it will be so slow I am almost going to say, don't bother.
Your CPU is a 2 core with 4 threads. And you have 8 GB of ram which is almost used by just running Windows.
Even in Linux, your system will struggle with a 4 GB model af it also needs ram to do the work besides the 4 GB the smallest model requires.
My suggestion would be to get one of the last two generations of i7 or i9. And at least 32 GB ram, at the bare minimum 16. These models will run ok with those specifications, it's what I do.
But your specifications are so low that this won't be funny if it even works.
from freedomgpt.
Yeah, then you should hold your breath. For a long time.
With those specs it will take a lot of time for the model to be ready and it will be so slow I am almost going to say, don't bother.
Your CPU is a 2 core with 4 threads. And you have 8 GB of ram which is almost used by just running Windows.
Even in Linux, your system will struggle with a 4 GB model af it also needs ram to do the work besides the 4 GB the smallest model requires.
The GPU wouldn't even be able to handle this model if GPI was supported by the alpaca program.
My suggestion would be to get one of the last two generations of i7 or i9. And at least 32 GB ram, at the bare minimum 16. These models will run ok with those specifications, it's what I do.
But your specifications are so low that this won't be funny if it even works.
from freedomgpt.
I get the exact same problem with a i7 8th gen, GeForce GTX 1050 Ti, 16Gb ram.
I don't see any error under any tab on localhost:9000, but I'm running it on linux.
Will let it run for a while to see if something happens, but from what I've already tried, 5-10min still no replies.
Under http://localhost:8889/ and http://localhost:3000 I get:
Cannot GET /
But under renderers I have: webpack-dev-server - 404s will fallback to '/index.html'
Dunno if there is any issue there.
from freedomgpt.
Same issue. It can respond, but at a super laggy pace.....
2.6 GHz 6-Core Intel Core i7
AMD Radeon Pro 5300M 4 GB
Intel UHD Graphics 630 1536 MB
16 GB 2667 MHz DDR4
Start the program by yarn start:prod
from freedomgpt.
Yes and therefore when FreedomGPT.com will be fixed??
from freedomgpt.
GTX 3070 8GB with Ryzen 7 and 16GB RAM. Rarely, it will respond quickly. But the majority of time, it never answers. I've left it overnight and still no response. Need fixed please.
from freedomgpt.
GTX 3070 8GB with Ryzen 7 and 16GB RAM. Rarely, it will respond quickly. But the majority of time, it never answers. I've left it overnight and still no response. Need fixed please.
Why fix when it is likely your computer specifications that are not good enough? 16 GB ram is not much for AI. And Alpaca does NOT support GPU. I would get at least 16 more.
That said, the problem likely lies elsewhere anyway. The FreedomGPT is a simple graphic interface for Alpaca, a console program to process the AI model.
I would advise you to test that program (it is in the resources/models subdir).
from freedomgpt.
That is:
CPU: Intel(R) Pentium(R) Gold G5400 CPU @ 3.70GHz 3.70 GHz
GPU: nVidia Geforce GTX 1650 4GB
RAM: 8,00 GBSystem type: 64-bit, processor x64
Based on that spec and comparing it to my laptop (100 words in 45 minutes), your computer is probably gonna take like an hour to generate 100 words.
from freedomgpt.
Sorry, it's unusably slow. I have an Intel i7-12700F, 32 GB RAM, GeForce GTX 1080Ti. I'm not going to leave it on overnight to wait for an answer. Disappointed.
Then that's just your CPU and storage. The app itself isn't slow. Do you have an HDD or an SSD for your OS drive?
from freedomgpt.
Sorry, it's unusably slow. I have an Intel i7-12700F, 32 GB RAM, GeForce GTX 1080Ti. I'm not going to leave it on overnight to wait for an answer. Disappointed.
Can you check the cpu amd gpu utilisation?. For me it's 100% hence it's very slow.
from freedomgpt.
Intel Core I5-12600k Desktop Processor
Crucial Ballistix MAX 32GB Kit (2 x 16GB) DDR4 4000 Memory
WD_BLACK 1TB SN750 SE NVMe Internal Gaming SSD Solid State Drive - Gen4 PCIe, M.2 2280, Up to 3,600 MB/s -
GPU | ZOTAC | ZOTAC NVIDIA GeForce RTX 3090 Trinity OC
Still facing an endless loading on the desktop version on Windows 11
from freedomgpt.
Related Issues (20)
- [Question] Download link for Windows App? HOT 1
- Windows 2.0.1 both liberty and scarlett not run HOT 9
- Can't run offline HOT 3
- error when building HOT 1
- cmakelists.txt issue when trying install on windows
- The GPT reply is interrupted
- Failed to create a folder named Release in the llama.cpp folder, but no error was displayed during the running process. HOT 1
- Windows 2.5.1 scarlett download url is not updated
- Windows 2.5.1 server.exe is not shutdown correctly on click close window button
- Is there any way to call API of the Liberty edge Model?
- Very unsafe looking instalation process HOT 1
- (node:103168) electron: Failed to load URL: http://localhost:3001/ with error: ERR_CONNECTION_REFUSED HOT 1
- Mining process exited with code 2 and signal null HOT 2
- No inference earnings on Windows 10 AMD Ryzen 7 HOT 10
- Llama cuda support? HOT 1
- Malicious files blocked by kaspersky antivirus during install HOT 4
- Config.json contains malware. Stopped by Anti-spy. HOT 1
- No mining rewards after 3.0.3. HOT 1
- About fnt tokens. HOT 1
- 3.0.4 Run slow on Hyper-V dynamic ram virtual machine HOT 2
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from freedomgpt.