[AWS] Having more then 1000 concurrent connections?

Maciej Sobczak prog at msobczak.com
Wed Aug 24 08:21:43 CEST 2011


Hi,

On 24/08/2011 08:08, Thomas Løcke wrote:

> Is there actually any gains at all by having max connection set>  than
> the amount of CPU cores available?

I guess that in a realistic application the request handler will not 
have 100% CPU usage across its all execution, for example because it 
will access some external database and will have to wait on I/O or for 
whatever other reason. The complete problem is not that straightforward, 
but just to give a picture-like example: if the request handler has 50% 
CPU usage during its execution and that is more or less independent on 
what other handlers are doing, then it might make sense to have up to 2x 
actively working connections than CPUs.

In reality the problem is much more complicated, because for example 
many (or all) handlers will access the same database (that is, they are 
not independent) and in many cases the database sits on the same machine 
and competes for CPU with the webserver itself, and so on.
For this reason the "proper" value is usually a result of continuous 
benchmarking and monitoring.

Regards,

-- 
Maciej Sobczak * www.msobczak.com * www.inspirel.com


More information about the AWS mailing list