Google is Leeching Bandwidth!

[Fyron]

Google is apparently the heaviest user of SpaceEmpires.net bandwidth thus far in November, using a whopping 3.49% all to itself! http://forum.shrapnelgames.com/images/smilies/eek.gif Does it really Cache web sites so many times to use an insane amount of bandwidth in 18 days?

[narf poit chez BOOM]

Maybe that's people connecting from google.

[Makinus]

yeah, when you search something in google and click the link provided it appears in the receiving site that google accessed the site...

[Atrocities]

google is the devil!

[Ragnarok]

Atrocities said:
google is the devil!



Nah, Google is one of the best search engines out there. It is not bloated with junk on the page like Yahoo and MSN are. MSN's new search may be good when it is completed. MSN new beta search. (http://beta.search.msn.com/)

[TurinTurambar]

Google is NOT the devil!! Google makes MY internet what it is. "Instant access to Information"

I have the Google Toolbar installed and the entire world is a few keystrokes away.

Google Rules. Yahoo drooles.

(OK, well THAT was just plain infantile of me, wasn't it...)

Turin

[Aiken]

Some people complained about searchbots, consuming their bandwidth. As I understand properly used robots.txt can prevent this.
http://forums.seochat.com/archive/t-14698

[Baron Munchausen]

Also see Google's own information page about their webcrawler:

http://www.google.com/bot.html

It's possible to set a config file (robots.txt) that keeps Googlebot from accessing certain things.

[Atrocities]

Well how do you do an advanced search with google.

Every time I type "OBJECT OF SEARCH" I get an error.

When I just do a search for OBJECT OF SEARCH, I get all these pages that have nothing to do with my search.

[Aiken]

I never got errors from serches for keywords in quotes.
But this link could help you:
http://www.google.com/advanced_search?hl=en

[Azselendor]

Actually, Google is completely rebuilding thier search database from the ground up by spidering the entire internet. This comes after the huge failure of thier 'Florida' index rebuild, they chose to simply re-spider everything and launch a new engine with it.

I should point out the biggest user of Google at the moment is MSN spidering google's results.

So for all you web masters, get your meta tags in order !

[Aiken]

I always knew that MS is a parazite.