showlog.php and search engine robots

October 29, 2007

Thanks for catching my typo. I always, but *not* this time, cut-and-paste to prevent this kind of goof.
If you posted your URL, I missed it. If you do not mind, I think that some of us would like to see your access log.

I took the access log off of the main page. I can copy and paste the entries here....maybe tomorrow as I should have a full page of what they're accessing. I have my showlog set to 500 entries and as I mentioned they access every day as far as I can tell.

I appreciate your help....I make typos all the time. Just wanted to reply about that in case my tech support people were wrong about the name of the file.

Carol

October 29, 2007

When you deny access to an IP Address or to a Domain Name, a 403 error message pops up that the visitor sees. It is a generic error message, probably written by your ISP/host. It may not say at all what you want said.

I have rewritten our 403 error message to include why I have denied access, listed those IP Addresses and Domain Names denied access, and leave my e-mail address for them to contact me as to why I should let them back on.

A bit of navigating about your account on your server will reveal where this file is located. I use DreamWeaver to update the message. The file is kept on my hard drive and uploaded whenever I change it.

October 29, 2007

When you deny access to an IP Address or to a Domain Name, a 403 error message pops up that the visitor sees. It is a generic error message, probably written by your ISP/host. It may not say at all what you want said.
I have rewritten our 403 error message to include why I have denied access, listed those IP Addresses and Domain Names denied access, and leave my e-mail address for them to contact me as to why I should let them back on.
A bit of navigating about your account on your server will reveal where this file is located. I use DreamWeaver to update the message. The file is kept on my hard drive and uploaded whenever I change it.

Maybe I'm getting in over my head here but how do you create a special message? I think it was Kiwi who did a rip prevention mod and I used that for awhile but I started getting errors on it so I had to remove the mod from my site. The errors were due to mistakes I made....not a problem with the actual mod. Is there a particular file name that I should look for in File Manager. I can click on "Error Page" in ICDSoft and this is the content of the file....is this what I use to create a personalized 403 error code?............

<html>

<head>

<title>404 Not Found</title>

.style3 {

font-family: Verdana, Arial, Helvetica, sans-serif;

color: #CC0000;

}

.s {

font-family: Verdana, Arial, Helvetica, sans-serif;

font-size: 11px;

font-weight: normal;

color: #000000;

line-height: 18px;

text-align: center;

border: 1px solid #CCCCCC;

background-color: #FFFFEC;

}

body {

background-color: #FFFFFF;

margin-top: 100px;

}

--></style>

</head>

<body>

<h2><span class="style3">404 Not Found</span></h2>

<tbody><tr><td class="s">The requested URL was not found on this server.</td></tr></tbody>

</table>

</div>

</body>

</html>

October 29, 2007

I took the access log off of the main page. I can copy and paste the entries here....maybe tomorrow as I should have a full page of what they're accessing. I have my showlog set to 500 entries and as I mentioned they access every day as far as I can tell.

Nope. I am asking that we be provided the URL, the Internet address to your website so that we can see for ourselves the showlog.php webpage.

I appreciate your help....I make typos all the time. Just wanted to reply about that in case my tech support people were wrong about the name of the file.

Nope again. I made a serious error in the spelling of the file name. Not good, not good at all. Your tech folks would have had a good laugh at my expense and wondered aloud who is this fool trying to help you.

October 29, 2007

Nope. I am asking that we be provided the URL, the Internet address to your website so that we can see for ourselves the showlog.php webpage.
Nope again. I made a serious error in the spelling of the file name. Not good, not good at all. Your tech folks would have had a good laugh at my expense and wondered aloud who is this fool trying to help you.

My tech support folks are used to my typos and they never laugh! :-) Really excellent support in my book but I know a lot of people on this forum use different hosts and have equally excellent support.

Carol

Nope. I am asking that we be provided the URL, the Internet address to your website so that we can see for ourselves the showlog.php webpage.
Nope again. I made a serious error in the spelling of the file name. Not good, not good at all. Your tech folks would have had a good laugh at my expense and wondered aloud who is this fool trying to help you.

Arnold....here's a VERY SHORT list of what this company is accessing..........

Thu 25 Oct 2007 12:49:07 PM All Media (Tree: mcentyre) accessed by 65-101-142-132.tukw.qwest.net.

Thu 25 Oct 2007 12:48:15 PM What's New (past 10 days) accessed by 65-101-142-132.tukw.qwest.net.

Thu 25 Oct 2007 12:42:12 AM What's New (past 10 days) accessed by 65-101-142-132.tukw.qwest.net.

Thu 25 Oct 2007 12:42:00 AM Reports accessed by 65-101-142-132.tukw.qwest.net.

Thu 25 Oct 2007 12:41:51 AM Report: 17th Century Ancestor Births (Tree: mcentyre) accessed by 65-101-142-132.tukw.qwest.net.

Thu 25 Oct 2007 12:41:47 AM Reports accessed by 65-101-142-132.tukw.qwest.net.

Thu 25 Oct 2007 12:41:40 AM Documents (Tree: mcentyre) accessed by 65-101-142-132.tukw.qwest.net.

Thu 25 Oct 2007 12:41:30 AM Documents (Tree: mcentyre) accessed by 65-101-142-132.tukw.qwest.net.

Thu 25 Oct 2007 12:41:17 AM U.S. Federal Census-1930 Washington, Ridgeway Precint, Kittitas County. (60) accessed by 65-101-142-132.tukw.qwest.net.

Thu 25 Oct 2007 12:40:41 AM Documents (Tree: mcentyre) accessed by 65-101-142-132.tukw.qwest.net.

Thu 25 Oct 2007 12:39:08 AM Obituary-Richard Arlen McEntyre (1927-1986) (58) accessed by 65-101-142-132.tukw.qwest.net.

Thu 25 Oct 2007 12:38:40 AM Documents (Tree: mcentyre) accessed by 65-101-142-132.tukw.qwest.net.

Thu 25 Oct 2007 12:37:50 AM Memory Card-Andrew "Andy" Derrick Barrett (1890-1972) (57) accessed by 65-101-142-132.tukw.qwest.net.

Thu 25 Oct 2007 12:37:43 AM Documents (Tree: mcentyre) accessed by 65-101-142-132.tukw.qwest.net.

Thu 25 Oct 2007 12:36:57 AM MCENTYRE, Rolland James

(1927-1933) (201) accessed by 65-101-142-132.tukw.qwest.net.

Thu 25 Oct 2007 12:36:16 AM Documents (Tree: mcentyre) accessed by 65-101-142-132.tukw.qwest.net.

Thu 25 Oct 2007 12:35:03 AM Death Certificate

MCENTYRE, James Marion (1853-1919) (158) accessed by 65-101-142-132.tukw.qwest.net.

Thu 25 Oct 2007 12:34:50 AM Documents (Tree: mcentyre) accessed by 65-101-142-132.tukw.qwest.net.

Thu 25 Oct 2007 12:34:38 AM Documents (Tree: mcentyre) accessed by 65-101-142-132.tukw.qwest.net.

Thu 25 Oct 2007 12:33:49 AM Documents (Tree: mcentyre) accessed by 65-101-142-132.tukw.qwest.net.

Thu 25 Oct 2007 12:31:00 AM Obituary-SHAW, Della Maude (Scriven) McEntyre Rice(1879-1957) (123) accessed by 65-101-142-132.tukw.qwest.net.

Thu 25 Oct 2007 12:29:54 AM Documents (Tree: mcentyre) accessed by 65-101-142-132.tukw.qwest.net.

Thu 25 Oct 2007 12:29:43 AM All Albums (Tree: mcentyre) accessed by 65-101-142-132.tukw.qwest.net.

Thu 25 Oct 2007 12:29:30 AM Sources (Tree: mcentyre) accessed by 65-101-142-132.tukw.qwest.net.

Thu 25 Oct 2007 12:29:12 AM Source "Harlan County, Kentucky" (S29759) accessed by 65-101-142-132.tukw.qwest.net.

Thu 25 Oct 2007 12:29:05 AM Sources (Tree: mcentyre) accessed by 65-101-142-132.tukw.qwest.net.

Thu 25 Oct 2007 12:28:51 AM All Albums (Tree: mcentyre) accessed by 65-101-142-132.tukw.qwest.net.

Thu 25 Oct 2007 12:28:35 AM Don McEntyre & Family accessed by 65-101-142-132.tukw.qwest.net.

Thu 25 Oct 2007 12:28:33 AM All Albums (Tree: mcentyre) accessed by 65-101-142-132.tukw.qwest.net.

Thu 25 Oct 2007 12:28:14 AM Don McEntyre Photo Gallery accessed by 65-101-142-132.tukw.qwest.net.

Thu 25 Oct 2007 12:28:02 AM All Albums (Tree: mcentyre) accessed by 65-101-142-132.tukw.qwest.net.

Thu 25 Oct 2007 12:27:24 AM What's New (past 10 days) accessed by 65-101-142-132.tukw.qwest.net.

Wed 24 Oct 2007 01:50:44 PM Researchers accessed by 65-101-142-132.tukw.qwest.net.

Wed 24 Oct 2007 01:50:26 PM What's New (past 10 days) accessed by 65-101-142-132.tukw.qwest.net.

Wed 24 Oct 2007 01:49:26 PM What's New (past 10 days) accessed by 65-101-142-132.tukw.qwest.net.

October 29, 2007

PLEASE START A NEW THREAD addressing the problem that when one goes to your website and clicks on, for example, Statistics, that the Find, Media, and Info links do not work. This problem occurs in Firefox and Internet Explorer.

Further, I was unable to get your showlog.php webpage to show any of its entries.

Please begin a new thread. We need to keep these issues separated.

You are being hit five or six times a minute by 65-101-142-132.tukw.qwest.net. I would cut 65.101.142.132 off in a heartbeat, if what you are showing is only a small sample of what they are actually doing.

When you cut folks off by denying them access, they can be very rude when they contact you. I have found that if I do a cut-and-paste of the access log showing how hard they have been hitting my website and place it in a word processing file, then I can show it to them later on. They are normally surprised and then apologetic.

You are being hit five or six times a minute by 65-101-142-132.tukw.qwest.net. I would cut 65.101.142.132 off in a heartbeat, if what you are showing is only a small sample of what they are actually doing.

When you cut folks off by denying them access, they can be very rude when they contact you. I have found that if I do a cut-and-paste of the access log showing how hard they have been hitting my website and place it in a word processing file, then I can show it to them later on. They are normally surprised and then apologetic.

October 29, 2007

PLEASE START A NEW THREAD addressing the problem that when one goes to your website and clicks on, for example, Statistics, that the Find, Media, and Info links do not work. This problem occurs in Firefox and Internet Explorer.
Further, I was unable to get your showlog.php webpage to show any of its entries.
Please begin a new thread. We need to keep these issues separated.

Did I not do that? I thought the issue with the Find, Media, etc. was on a different thread. Where should I have put that? It's not on this thread.

This problem I'm having with tukw.qwest. net I put under Search Engines....was that not correct either?

Did you see the list I posted of some recent hits by tukw.qwest.net? That's just a smidgen of the files they are accessing.

You can't access my showlog. I took it off of the main page and another forum user told me how to prevent others from accessing it. So, as far as I know the only thing I can do is copy and paste my showlog in this forum. Should I do that tomorrow when I have a full page or is what I've already posted enough?

Carol

October 29, 2007

I tried to send this earlier, but it was not being accepted. I would hit Add Reply, but nothing happened. Am trying again.

============================

You are being hit five or six times a minute by 65-101-142-132.tukw.qwest.net. I would cut 65.101.142.132 off in a heartbeat, if what you are showing is only a small sample of what they are actually doing.

When you cut folks off by denying them access, they can be very rude when they contact you. I have found that if I do a cut-and-paste of the access log showing how hard they have been hitting my website and place it in a word processing file, then I can show it to them later on. They are normally surprised and then apologetic.

October 29, 2007

Sorry. Guess I forgot/was unaware that you had addressed this problem elsewhere.
Not sure of the rationale to hide the showlog.php page. Ours is free for one and all to see at http://www.sprague-database.org/genealogy/showlog.php
I tried to send this earlier, but it was not being accepted. I would hit Add reply, but nothing happened. Am trying again.
============================
You are being hit five or six times a minute by 65-101-142-132.tukw.qwest.net. I would cut 65.101.142.132 off in a heartbeat, if what you are showing is only a small sample of what they are actually doing.
When you cut folks off by denying them access, they can be very rude when they contact you. I have found that if I do a cut-and-paste of the access log showing how hard they have been hitting my website and place it in a word processing file, then I can show it to them later on. They are normally surprised and then apologetic.
I tried to send this earlier, but it was not being accepted. I would hit Add Reply, but nothing happened. Am trying again.
============================
You are being hit five or six times a minute by 65-101-142-132.tukw.qwest.net. I would cut 65.101.142.132 off in a heartbeat, if what you are showing is only a small sample of what they are actually doing.
When you cut folks off by denying them access, they can be very rude when they contact you. I have found that if I do a cut-and-paste of the access log showing how hard they have been hitting my website and place it in a word processing file, then I can show it to them later on. They are normally surprised and then apologetic.

Believe me, this is only a drop in the barrel of their access. It's ridiculous to say the least. I did a search on that company and as I mentioned before, I got an adult only site. There is no tukw.qwest.net internet site. I've tried copying and pasting that URL into my browser and what I get is a laundry list of sites but none match that URL exactly. Maybe Scotty knows since he's familiar with the company. Or, maybe I'm missing something in my search criteria?

Nope. I am asking that we be provided the URL, the Internet address to your website so that we can see for ourselves the showlog.php webpage.
Nope again. I made a serious error in the spelling of the file name. Not good, not good at all. Your tech folks would have had a good laugh at my expense and wondered aloud who is this fool trying to help you.

Arnold, could you tell me how to do a personalized error page as mentioned above? I'd like to do something like that if it's not too complicated. The file I copied and pasted isn't the right one? Should this question be posted on a different thread? I never did get an answer to my mouse hovering problem in Find, Media, etc. I wonder if it should be posted in a different place than where I originally put it?

Carol

October 29, 2007

There is no tukw.qwest.net internet site.

That is correct. The Internet website would be qwest.net, not tukw.qwest.net. This is the kind of thing you learn as you hang around here.

As Scotty mentioned earlier, the tukw part of the address shows the area the person hooks into Qwest. tukw stands for the town's name (Tukwila, WA). tukw shows up as part of the IP Address which is recorded in the TNG access log.

For example, when I log into our website, it appears as

Mon 29 Oct 2007 03:44:26 PM Search Results for Last Name contains dibblee accessed by cpe-65-26-73-131.we.res.rr.com (User: Webmaster)

on the TNG access log for our website. rr.com = RoadRunner and we.res = my part of the RoadRunner system.

October 29, 2007

That is correct. The Internet website would be qwest.net, not tukw.qwest.net. This is the kind of thing you learn as you hang around here.
As Scotty mentioned earlier, the tukw part of the address shows the area the person hooks into Qwest. tukw stands for the town's name (Tukwila, WA). tukw shows up as part of the IP Address which is recorded in the TNG access log.
For example, when I log into our website, it appears as
Mon 29 Oct 2007 03:44:26 PM Search Results for Last Name contains dibblee accessed by cpe-65-26-73-131.we.res.rr.com (User: Webmaster)
on the TNG access log for our website. rr.com = RoadRunner and we.res = my part of the RoadRunner system.

Thanks for your reply Arnold. I've posted on a new thread ".htaccess" and have asked the question how to personalize an error page. I hope I added that topic in the right place.

I've done the .htaccess file as you and Rush suggested according to the guidelines that you two suggested and ICDSoft. Will post again if this provider or domain or whatever it is continues to hammer my site.

You asked why I would delete the access log. Personally I'm turned off by seeing how much I'm accessing a site. I prefer that there not be a record of my access. My family members didn't appreciate it either. I guess it comes down to pleasing the majority of my users. I see the log on many sites. I just choose not to include it on mine for the reasons I already mentioned.

Carol

October 29, 2007

That is correct. The Internet website would be qwest.net, not tukw.qwest.net. This is the kind of thing you learn as you hang around here.
As Scotty mentioned earlier, the tukw part of the address shows the area the person hooks into Qwest. tukw stands for the town's name (Tukwila, WA). tukw shows up as part of the IP Address which is recorded in the TNG access log.
For example, when I log into our website, it appears as
Mon 29 Oct 2007 03:44:26 PM Search Results for Last Name contains dibblee accessed by cpe-65-26-73-131.we.res.rr.com (User: Webmaster)
on the TNG access log for our website. rr.com = RoadRunner and we.res = my part of the RoadRunner system.

Without going into overkill info on this.

TUKW is called the CLLI Code for a specific location.

Spokane, WA is SPKNWA. So, when the phone companys started to get into the ISP business they just used the CLLI of wherever they placed a node. And these are not on company premises... but we don't need to go there. Hence SPKN.QWEST.NET or TUKW.QWEST.NET. Hence you can not WHOIS the TUKW no matter how hard you try. It will always fall back to QWEST.NET corporate.

Scotty

October 29, 2007

Scotty has brought in a whole new topic which needs to be discussed.

WhoIs is a terrific website which allows you to learn who is coming to your website. ("Who" does not mean an individual. It means finding the ISP/host that is being used.) When you go to WhoIs, you can search on the following:

Domain Name e.g. sprague-database.org

NIC Handle e.g. vs1234

IP Address e.g. 216.168.224.69

You will probably never need to enter anything into the NIC Handle option.

How is your brain doing after all of this? A bit addled?

P.S. Thanks, Scotty, for the link to CLLI Code and the explanation as to why phone companies chose to use the term.

October 29, 2007

You asked why I would delete the access log. Personally I'm turned off by seeing how much I'm accessing a site. I prefer that there not be a record of my access. My family members didn't appreciate it either. I guess it comes down to pleasing the majority of my users. I see the log on many sites. I just choose not to include it on mine for the reasons I already mentioned.
Carol

Carol,

I have made my access log viewable only to ADMIN as I feel it's no ones business who accesses my site. And even a php noob like myself figured out how to do it.

And I have "Admin" in Exclude Host Names under Setup >> Configuration >> Log Settings. So, my name does not show up in the log.

And here are some TNG Mods that might interest you.

#6. Customized logs

#5. Rip Prevention also allows IP access banning without having to do the HT.ACCESS file. And a side effect you get an accurate count of which IP is hammering your site.

How is your brain doing after all of this? A bit addled?
P.S. Thanks, Scotty, for the link to CLLI Code and the explanation as to why phone companies chose to use the term.

Arnold,

Sadly, somethings never can be forgotten and I've been gone 5 1/2 years.

Scotty

October 29, 2007

Without going into overkill info on this.
TUKW is called the CLLI Code for a specific location.
Spokane, WA is SPKNWA. So, when the phone companys started to get into the ISP business they just used the CLLI of wherever they placed a node. And these are not on company premises... but we don't need to go there. Hence SPKN.QWEST.NET or TUKW.QWEST.NET. Hence you can not WHOIS the TUKW no matter how hard you try. It will always fall back to QWEST.NET corporate.
Scotty

Scotty and Arnold...thanks for your replies but honestly speaking, this is all Greek to me.

I just want to stop this ISP, Domain or whatever it is from accessing my site. They access hundreds of records at a time. If they aren't a bonafide search engine then they need to be stopped from access....at least on my site. Others may not mind it but I do if they aren't a search engine like Google who benefits family researchers to access my site because they are looking for a particular Surname or Line. Because of my ignorance in these matters then perhaps I don't understand the purpose of this qwest website.

If I'm mistaken as to their purpose please let me know.

Carol

www.mcentyrefamilyproject.org

October 29, 2007

Carol,
I have made my access log viewable only to ADMIN as I feel it's no ones business who accesses my site. And even a php noob like myself figured out how to do it.
And I have "Admin" in Exclude Host Names under Setup >> Configuration >> Log Settings. So, my name does not show up in the log.
And here are some TNG Mods that might interest you.
#6. Customized logs

#5. Rip Prevention also allows IP access banning without having to do the HT.ACCESS file. And a side effect you get an accurate count of which IP is hammering your site.
Arnold,
Sadly, somethings never can be forgotten and I've been gone 5 1/2 years.
Scotty

March 1, 2008

I have my bot access log separate from my regular access log. The entry goes into the bot log as defined in log.php via strpos($remhost ... and strpos($remip ... lines. How does one deal with a legitimate search engine such as Majestic-12 in the UK that uses a distributed search engine model because I will never know in advance what IP address or host the bot will be crawling from? In that case I am usually getting about 400 hits from one IP/host then about 400 from another IP/host and so forth. An example from my webhost's access log:

72.90.86.84 - - [29/Feb/2008:18:07:19 -0500] "GET /getperson.php?personID=I26027&tree=dyal_speckels HTTP/1.1" 200 20625 tree.barrittfamily.net "-" "Mozilla/5.0 (compatible; MJ12bot/v1.2.1; http://www.majestic12.co.uk/bot.php?+)" "-"

The log file on my TNG site for the same entry appears thusly:

Fri 29 Feb 2008 06:07:19 PM Individual info for Tom Dupree KIRKSCEY (I26027) accessed by pool-72-90-86-84.syrcny.fios.verizon.net/72.90.86.84/.

Thanks,

Robert

showlog.php and search engine robots

Recommended Posts

TNGUSER

Link to comment

Share on other sites

arnold

Link to comment

Share on other sites

TNGUSER

Link to comment

Share on other sites

arnold

Link to comment

Share on other sites

TNGUSER

Link to comment

Share on other sites

arnold

Link to comment

Share on other sites

TNGUSER

Link to comment

Share on other sites

arnold

Link to comment

Share on other sites

TNGUSER

Link to comment

Share on other sites

arnold

Link to comment

Share on other sites

TNGUSER

Link to comment

Share on other sites

Scotty

Link to comment

Share on other sites

arnold

Link to comment

Share on other sites

Scotty

Link to comment

Share on other sites

TNGUSER

Link to comment

Share on other sites

TNGUSER

Link to comment

Share on other sites

Robert Barritt

Link to comment

Share on other sites

Join the conversation

TNG

Activity

Browse