Comments (3)
I'll look into it!
from backend.ai.
The number of workers in the Backend.AI gateway is not related to the performance of your Backend.AI user-code execution. It mainly affects the API (HTTP request) processing throughput.
Therefere it is safe to have low numbers for private setups where the concurrent client connections are far less than hundreds or thousands. Even a single thread setup can handle hundreds of concurrent HTTP requests without hassles. (In Backend.AI, the main performance-limiting factor is the latency of Docker APIs in the agents.)
So I'm going to add a patch so that you can customize the number of gateway processes using a CLI argument while its default is set to a small number (at most 4).
from backend.ai.
As there are no more responses after I have provided the patch, closing the issue.
Please reopen or open another issue if you have further problems.
from backend.ai.
Related Issues (20)
- Prevent from folder mount including automount folder in session creation when its status is dead
- DDoS prevention for anonymous manager API requests
- [Docs: Install from Package Guide] Not working Postgresql statements in Backend.AI Manager Part HOT 1
- [Docs: Install from Package Guide] Fix typo on Install Backend.AI Agent section
- [Docs: Install from Package Guide] have to modify webserver redis local configuration
- Make storage-proxy a little more stateful HOT 1
- Cannot change vfolder operation status from `delete-pending` to `delete-complete` on certain condition
- Refactor and refine the resource usage API implementation
- User access logs
- ci: Make adding area:docs label trigger more precise
- Improve auto-healing of "insufficient amount of resource" errors
- Security vulnerability of `sudo_session_enabled` implementation HOT 1
- Preserve the labels of the original PR in the backport PRs
- Add the linking issue of the existing pr to the backport pr
- Refactor `concurrency_used`
- Warning in WebUI if the pre-open port and the app port of the image overlap
- Add option to use the original image entrypoint when creating session containers
- Dropbear cannot read /etc/shadow file on CentOS 8 kernel images
- Refactor kernel/session status update APIs
- Allow running storage-proxy as root
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from backend.ai.