http://incsub.org/blog/2006/bloglines-the-lover-with-a-sting Thu, 04 Feb 2010 12:15:39 -0800 http://wordpress.org/?v=2.8.1 hourly 1 http://incsub.org/blog/2006/bloglines-the-lover-with-a-sting/comment-page-1#comment-13164 James Thu, 13 Jul 2006 09:18:13 +0000 http://incsub.org/blog/2006/bloglines-the-lover-with-a-sting#comment-13164 Kinda - they may have tweaked something to decrease intensity but still an issue. Nothing official though (i.e. I haven't been told they've done anything) Kinda – they may have tweaked something to decrease intensity but still an issue. Nothing official though (i.e. I haven’t been told they’ve done anything)

]]> http://incsub.org/blog/2006/bloglines-the-lover-with-a-sting/comment-page-1#comment-13163 Changing Way » Blog Archive » Bloglines-lines-lines Wed, 12 Jul 2006 15:23:39 +0000 http://incsub.org/blog/2006/bloglines-the-lover-with-a-sting#comment-13163 [...] While I’m providing freedback to Bloglines, I’m wondering if they have fixed the overcrawling problem reported by James a while back. [...] [...] While I’m providing freedback to Bloglines, I’m wondering if they have fixed the overcrawling problem reported by James a while back. [...]

]]> http://incsub.org/blog/2006/bloglines-the-lover-with-a-sting/comment-page-1#comment-13162 Andrew Wed, 12 Jul 2006 15:00:11 +0000 http://incsub.org/blog/2006/bloglines-the-lover-with-a-sting#comment-13162 James, Did you get this resolved? James,
Did you get this resolved?

]]> http://incsub.org/blog/2006/bloglines-the-lover-with-a-sting/comment-page-1#comment-13154 James Wed, 05 Jul 2006 08:41:46 +0000 http://incsub.org/blog/2006/bloglines-the-lover-with-a-sting#comment-13154 Google happened a while back, search my archives for it - they fixed it in the end. Google happened a while back, search my archives for it – they fixed it in the end.

]]> http://incsub.org/blog/2006/bloglines-the-lover-with-a-sting/comment-page-1#comment-13152 Website Monitoring Tue, 04 Jul 2006 11:51:11 +0000 http://incsub.org/blog/2006/bloglines-the-lover-with-a-sting#comment-13152 Same problem with Google. Wrote a letter but didn't any response yet :( Same problem with Google. Wrote a letter but didn’t any response yet :(

]]> http://incsub.org/blog/2006/bloglines-the-lover-with-a-sting/comment-page-1#comment-13115 James Farmer Thu, 29 Jun 2006 01:03:30 +0000 http://incsub.org/blog/2006/bloglines-the-lover-with-a-sting#comment-13115 I'm gonna submit a request. I’m gonna submit a request.

]]> http://incsub.org/blog/2006/bloglines-the-lover-with-a-sting/comment-page-1#comment-13111 Dougal Campbell Wed, 28 Jun 2006 21:27:44 +0000 http://incsub.org/blog/2006/bloglines-the-lover-with-a-sting#comment-13111 I haven't had problems with the Bloglines crawler (yet), but the Googlebot was hammering my server a little more than I liked. I wrote to them and asked them to slow it down, and they did. I also suggested that they might consider following Yahoo!'s "crawl_delay" extension to the robots.txt file. Maybe we could lobby that with Bloglines, as well. I haven’t had problems with the Bloglines crawler (yet), but the Googlebot was hammering my server a little more than I liked. I wrote to them and asked them to slow it down, and they did. I also suggested that they might consider following Yahoo!’s “crawl_delay” extension to the robots.txt file. Maybe we could lobby that with Bloglines, as well.

]]> http://incsub.org/blog/2006/bloglines-the-lover-with-a-sting/comment-page-1#comment-13110 Photo Matt » Bloglines DOS Wed, 28 Jun 2006 18:57:39 +0000 http://incsub.org/blog/2006/bloglines-the-lover-with-a-sting#comment-13110 [...] Bloglines is DOSing blog providers. Every other major crawler implements some sort of per-resolved-IP throttle, why can’t Bloglines? Even if there were a way to opt-out of their hundreds of simultanous crawlers descending on your service, it seems to me the default behavior should be to not be harmful, and then work with large providers on a case-by-case basis to increase the concurrency of requests. We don’t have this problem with any other aggregator or crawler, hosted or non-hosted. « Darwin on Web 2.0 [...] [...] Bloglines is DOSing blog providers. Every other major crawler implements some sort of per-resolved-IP throttle, why can’t Bloglines? Even if there were a way to opt-out of their hundreds of simultanous crawlers descending on your service, it seems to me the default behavior should be to not be harmful, and then work with large providers on a case-by-case basis to increase the concurrency of requests. We don’t have this problem with any other aggregator or crawler, hosted or non-hosted. « Darwin on Web 2.0 [...]

]]> http://incsub.org/blog/2006/bloglines-the-lover-with-a-sting/comment-page-1#comment-13109 Matt Wed, 28 Jun 2006 18:49:35 +0000 http://incsub.org/blog/2006/bloglines-the-lover-with-a-sting#comment-13109 We have the same problem on WordPress.com, except imagine it with 230,000 blogs. They said if we ping them it shouldn't be as bad, but that seems to have had no effect on the Bloglines DOS behavior. We have the same problem on WordPress.com, except imagine it with 230,000 blogs. They said if we ping them it shouldn’t be as bad, but that seems to have had no effect on the Bloglines DOS behavior.

]]>