Need a way to limit threads per remote

[pylons]

Need a way to limit threads per remote

[ztane]

Also this is not possible to do on the front side nor would it be comparable - Apache cannot differentiate between long requests over slow links and requests that block the worker.

[digitalresistor]

I don't think that waitress is the right place to do this. I would highly recommend using some sort of reverse proxy in front of waitress that is better design to deal with such scenarios.

[ztane]

The reverse proxy would not be in Python, thus much harder to implement.

[digitalresistor]

http://opensource.adnovum.ch/mod_qos/ implements this, so it's a simple config flag for Apache.

[ztane]

Waitress specifically works like this: "When a channel determines the client has sent at least one full valid HTTP request, it schedules a “task” with a “thread dispatcher”. The thread dispatcher maintains a fixed pool of worker threads available to do client work (by default, 4 threads). If a worker thread is available when a task is scheduled, the worker thread runs the task. The task has access to the channel, and can write back to the channel’s output buffer. When all worker threads are in use, scheduled tasks will wait in a queue for a worker thread to become available." Thus it would be just a matter of being allowed to configure a queueing policy where the supplied default works like now.