Update: A very helpful bloglines engineer got in touch with me and they’ve applied a special script to set up a combined rate limit for 10 requests per second for the edublogs domain. Seems to be working nicely so far so you’re back in the good books Bloglines ;)
A year on Bloglines continues to misbehave attempting to make hundreds to simultaneous connections through it’s crawler to WPMU hosts like edublogs – causing slowness and even crashing even on brand new clusters.
They don’t respond to emails about it and the only solution seems to be to limit their IP (188.8.131.52) to something like 20-40 concurrent connections – naturally massively slowing down the updates that get through.
It stinks and if they don’t do something about it we’re going to actively start asking the 100K+ users of edublogs sites to use Google Reader and discourage their readers /subscribers from using bloglines in favour of another RSS reader.
It’s a real shame as they were pioneers of web based aggregators and I used them for years but to be honest I’ve had enough.