Schot 411 Posted August 12, 2006 Share Posted August 12, 2006 Hey gang. Just wanted to let you all know that today I have set the forum up to disallow any and all search engine bots. Reasons being that they eat up resources such as bandwidth and also because of the risk that they might index and make available to the public classified information. So as of today no new information on our forum will be able to be found using google or any other search engine. Thanx. Link to comment
fRACTAL 0 Posted August 12, 2006 Share Posted August 12, 2006 Awww, but I liked the spiders dancing in our forum at night ~Doom Link to comment
Guest gogoblender Posted August 13, 2006 Share Posted August 13, 2006 yeesh...those spiders were gross lol, while it seem so many others are tryin go get more and more peeps at their forums, heh, we're tryin to keep out the madding crowds /rolleyes We'll probably allow a few of the major search engines back on in a few weeks...so enjoy the spider free browsing. And save on Raid gogo Link to comment
Schot 411 Posted August 13, 2006 Author Share Posted August 13, 2006 Heya Schot I just read your post about blocking spiders n bots...but I am still seeing them... So Hows about we close off the forum to guests like we have in the past? Just an idea....and glad you are getting rid of them they do my head in lol Oh I totally agree erialc. These bots are fast becoming a real pain. Thanks very much for the feedback on this erialc. I had lost the IP of this lil bugger and your info was useful in that I have had to put this bot in our banned list. Thanx also to esfan for your suggestions on msn. Gave me a good lead on what to search for. I've done some extensive reading on bots today and have learned that there is a web standard "robots.txt" file that you can add to your site which can do many things. In particular, it can refuse all bots from accessing a site. I have done this but even more reading has taught me that there are many bots that disobey web standards and effectively access your site anyway. There are several alternatives to blocking what they call "bad bots" but unfortunately I am not allowed to use these alternatives because of our TOS. Soooooo. I'm just going to ban those buggers. Works just as well except for the fact that I'll have to ban them as they come... So to those of us admining here I give full permission to shoot any bot on sight and then give'em a swift kick. Oh and send me there info so I can ban them, hehe. Death to bad bots! /viking Link to comment
Guest gogoblender Posted August 13, 2006 Share Posted August 13, 2006 indeed down with the bots of badness rawr! /viking gogo Link to comment
fRACTAL 0 Posted August 13, 2006 Share Posted August 13, 2006 Rawr! Kill kill kill! Go get em' team Rawr! /viking ~Doom Link to comment
OMGSTUFF 2 Posted August 14, 2006 Share Posted August 14, 2006 Good call. I don't want people to be able to search on Google and find my stories about me mistakenly blabbering about OGame @ work/ Link to comment
Guest gogoblender Posted August 14, 2006 Share Posted August 14, 2006 oooh...yeah good call there, schot... *wonders if he's himself has written anything troublesome " /whistle gogo Link to comment
Schot 411 Posted August 15, 2006 Author Share Posted August 15, 2006 Hmmm... Looks like despite my efforts the google.com bot continues to visit us. Not that I mind but it makes me question whether I set things up properly. /unsure If anyone sees a bot other than google could y'all let me know here? Thanx. Link to comment
fRACTAL 0 Posted August 17, 2006 Share Posted August 17, 2006 Ah well I suppsoe you know but I'll post all the same its a shame to waste the pic Googles not blocked /rolleyes ~Doom Link to comment
Schot 411 Posted August 17, 2006 Author Share Posted August 17, 2006 Noooooooooooo! Those bloody bots are refusing to follow web standards! Grrrrr! Link to comment
erialc 2 Posted August 17, 2006 Share Posted August 17, 2006 I'll send the boys round....do you know that cheeky buggar google even pm's!!.....I think we should charge em....like wounded bulls!....they just go no respect /lmao Link to comment
Schot 411 Posted August 18, 2006 Author Share Posted August 18, 2006 lol. I know! I can't believe they go through the pm's function. Caught google using it several times, grrrrr! I slapped those buggers MSN and GOOGLE straight into the banned list! Hahaha! Mwahahaha! I ween! Link to comment
Recommended Posts
Create an account or sign in to comment
You need to be a member in order to leave a comment
Create an account
Sign up for a new account in our community. It's easy!
Register a new accountSign in
Already have an account? Sign in here.
Sign In Now