Kathy F Posted November 30, 2006 Report Share Posted November 30, 2006 I don't know anything about search engines or groups to be worried about or anything like that.And at this point I don't much care if my site is indexed by search engines and stuff. The site is mainly for me and my family, and if we get visitors, that's fine, but I'm not trying to drum up business.That said: "lj611629.inktomisearch.com" has hit my site more than 200 times in a little over two hours: http://www.kfgeorgia.net/genealogy/showlog.php?autorefresh=1Should I be worried? Should I try denying them access?Thanks for your advice.P.S. They're not researching a particular line. They're bouncing all over the place... Quote Link to comment Share on other sites More sharing options...
Scotty Posted November 30, 2006 Report Share Posted November 30, 2006 I don't know anything about search engines or groups to be worried about or anything like that.And at this point I don't much care if my site is indexed by search engines and stuff. The site is mainly for me and my family, and if we get visitors, that's fine, but I'm not trying to drum up business.That said: "lj611629.inktomisearch.com" has hit my site more than 200 times in a little over two hours: http://www.kfgeorgia.net/genealogy/showlog.php?autorefresh=1Should I be worried? Should I try denying them access?Thanks for your advice.P.S. They're not researching a particular line. They're bouncing all over the place...Yahoo Search Robot....it's been discussed here before...how to get rid of inktomisearchin fact if you Google inktomisearch you'll find the link to Yahoo and how to control their robot using robots.txt.Scotty Quote Link to comment Share on other sites More sharing options...
Kathy F Posted November 30, 2006 Author Report Share Posted November 30, 2006 Yahoo Search Robot....it's been discussed here before...how to get rid of inktomisearchin fact if you Google inktomisearch you'll find the link to Yahoo and how to control their robot using robots.txt.ScottyThanks for the link. I've blocked them from the Access Log, but I'm not denying them access to my site.Of course, about the time I got them blocked, they developed a rival: phnx.qwest.netI'll let the new boys play for a while, but if they go as nuts as the Yahoo bot, I'll block them off the log, too. There's no point in having an Access Log if I get hit by the bots so much that any real users disappear off the log before I get a chance to spot them. Quote Link to comment Share on other sites More sharing options...
Scotty Posted November 30, 2006 Report Share Posted November 30, 2006 Thanks for the link. I've blocked them from the Access Log, but I'm not denying them access to my site.Of course, about the time I got them blocked, they developed a rival: phnx.qwest.netI'll let the new boys play for a while, but if they go as nuts as the Yahoo bot, I'll block them off the log, too. There's no point in having an Access Log if I get hit by the bots so much that any real users disappear off the log before I get a chance to spot them.You may want to consider this mod for the access log. It creates a new log file just for search bots. You just toggle between the normal and crawlers logs and it provides more info on the normal accesses.Very nice job. Main page for TNG mods#6 is what you want. Depending how brave you are there are others mods there as well. Scotty Quote Link to comment Share on other sites More sharing options...
Kathy F Posted November 30, 2006 Author Report Share Posted November 30, 2006 You may want to consider this mod for the access log. It creates a new log file just for search bots. You just toggle between the normal and crawlers logs and it provides more info on the normal accesses.Very nice job. Main page for TNG mods#6 is what you want. Depending how brave you are there are others mods there as well. ScottyThanks. I've bookmarked that page.I hope--in the next week or so--to set up a WAMP version of my site so I can play with it on my laptop and not risk breaking the on-line version as I customize things. I'll try implementing some of those scripts, as well as other customizations. Quote Link to comment Share on other sites More sharing options...
Recommended Posts
Join the conversation
You can post now and register later. If you have an account, sign in now to post with your account.