[AWS] Further info on the weird "AWS is returning too much data" issue

[Thomas Løcke]

On Sat, Jan 29, 2011 at 3:55 PM, Pascal Obry <pascal at obry.net> wrote:
> I've also tried on my side. I've found nothing wrong on AWS code up to
> know. I found also that ab is really sending those extra requests. I
> don't understand why though...


That is very odd, especially because it is not sending them to node.js
or Apache.


> It would be nice to have a C driver instead of the ab code that try to
> reproduce the problem.


Or perhaps we could use AWS.Communication.Client and build our own
little driver.  :o)



> My bet is that ab is sending a request and AWS does not respond (quick
> enough) or properly, then ab is sending another request...


If that was the case, ab would've reported it as a failed request.

Not once have I seen ab report any failed requests, so I don't think
this is what happens. Unless of course we don't trust ab, in which
case we have a completely different situation. <g>


> What is really strange is that it does not reproduce on some machines.
> I've been able to reproduce on a quad-core machine but not on mine. I've
> also never been able to reproduce on a dual-code machine...


Ditto.

This problem appears to only manifest itself when the request rate is
> 10_000 per second.


> For sure this will be a time consuming problem :(


Well, it's all the more satisfying when it's finally fixed then.  :)

Thomas Løcke