Comments (1)
This is not an direct issue of this project.
Firstly, access http://[::1]:3000/ and see if you can assess this from your host, I tested without any issue. Ensure you have allowed ufw or iptables to expose port 3000 to network. Especially if you are in a managed network like in company or school, double check if IT has not block the port by default.
If you are sure there is nothing wrong about the firewall, then there are two possible methods,
- Use of Nginx or other software as a gateway, when user access a certain port of the host listened by Nginx, it proxy the request to your service, in this case, port 3000. This might be much easier if know Nginx.
- Enable the IPv6 support of the Docker by referring https://docs.docker.com/config/daemon/ipv6/
from llama-gpt.
Related Issues (20)
- Brackets in run.sh
- Installation on windows - please elaborate more
- docker compose: Permission denied running /api/run.sh HOT 2
- CUDA Support for Kubernetes
- Errors thrown when trying to start llama-gpt api using docker-compose-gguf.yml HOT 2
- Not enough space HOT 1
- Support Multi-part .bin files?
- Is there the ability to swap the language to answer?
- Llama GPT extremely slow on Umbrel Home HOT 1
- Can't use GPU: could not select device driver "nvidia" with capabilities: [[gpu]] HOT 3
- Can't run on Linux HOT 2
- Way to change model on UmbrelOS HOT 1
- Error when deploying in Kubernetes: Model path does not exist
- Add API Key restriction so the API is not always OPEN
- llama 3 support HOT 3
- [FEATURE REQUEST] Support for NPU hardware acceleration
- Unable to increase max token size
- coroutine error StopIteration if the AI response is empty
- models download
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from llama-gpt.