Google this yo - The Daily Render by Nikolas R. Schiller

Google this yo
|| 7/19/2005 || 3:44 pm || Comments Off on Google this yo || ||

I got an e-mail back from Google today in regards to the e-mail I sent them last week.

Hi Nikolas,

Thank you for your note. Please be assured that no one at Google manually adds
a site or a page to our search results.

We’ve submitted your robots.txt file for removal. This request should be
processed within three to five days. We appreciate your taking the time to
write.

Regards,
The Google Team

Original Message Follows:
————————
From: info at nikolasschiller dot com
Subject: Removal of Page
Date: Fri, 15 Jul 2005 16:57:17 -0000

Google Earth is here!

This link is listed when my name, “Nikolas Schiller” is searched. I have
the robots.txt file setup so that google does not traverse my website.
However, on the day that this entry was posted, a staff member from Google
in California visited my website (I have the logs to prove this) and now
that entry is listed. This violates my robots.txt request and I find it
in bad taste for Google to promote itself in such a way. Please remove
the URL listed above from your database.

Sincerely,
Nikolas Schiller

Language: en
WebUserLocale: en
IssueType: removal
url: www.nikolasschiller.com

The day that my website was crawled by Google was the same day my Google Earth posting was on the front page of DCist.
Below is the activity that took place….. nothing too big really, just annoying that when I googled my name the URL above was listed when it shouldn’t have been!

72.14.194.28 – – [30/Jun/2005:19:50:41 -0400] “GET /blog/wp-content/themes/Carrots/style.css HTTP/1.1” 200 2692 “https://www.nikolasschiller.com/blog/index.php/archives/2005/06/30/434/” “Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.7.8) Gecko/20050511 Firefox/1.0.4”
72.14.194.28 – – [30/Jun/2005:19:50:41 -0400] “GET /blog/print.css HTTP/1.1” 404 1013 “https://www.nikolasschiller.com/blog/index.php/archives/2005/06/30/434/” “Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.7.8) Gecko/20050511 Firefox/1.0.4”
72.14.194.28 – – [30/Jun/2005:19:50:41 -0400] “GET /photo/self/thumb/v/6.jpg HTTP/1.1” 200 11887 “https://www.nikolasschiller.com/blog/index.php/archives/2005/06/30/434/” “Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.7.8) Gecko/20050511 Firefox/1.0.4”
72.14.194.28 – – [30/Jun/2005:19:50:41 -0400] “GET /posters/ivanmemory-small.jpg HTTP/1.1” 200 10160 “https://www.nikolasschiller.com/blog/index.php/archives/2005/06/30/434/” “Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.7.8) Gecko/20050511 Firefox/1.0.4”
72.14.194.28 – – [30/Jun/2005:19:50:41 -0400] “GET /posters/abstractnetherlands-small.jpg HTTP/1.1” 200 9894 “https://www.nikolasschiller.com/blog/index.php/archives/2005/06/30/434/” “Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.7.8) Gecko/20050511 Firefox/1.0.4”
72.14.194.28 – – [30/Jun/2005:19:50:41 -0400] “GET /posters/starofdenver-small.jpg HTTP/1.1” 200 7602 “https://www.nikolasschiller.com/blog/index.php/archives/2005/06/30/434/” “Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.7.8) Gecko/20050511 Firefox/1.0.4”
72.14.194.28 – – [30/Jun/2005:19:50:41 -0400] “GET /posters/baltimoremandala-small.jpg HTTP/1.1” 200 25661 “https://www.nikolasschiller.com/blog/index.php/archives/2005/06/30/434/” “Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.7.8) Gecko/20050511 Firefox/1.0.4”
72.14.194.28 – – [30/Jun/2005:19:50:41 -0400] “GET /posters/post911reflection-small.jpg HTTP/1.1” 200 8867 “https://www.nikolasschiller.com/blog/index.php/archives/2005/06/30/434/” “Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.7.8) Gecko/20050511 Firefox/1.0.4”
72.14.194.28 – – [30/Jun/2005:19:50:41 -0400] “GET /posters/motherearth4-small.jpg HTTP/1.1” 200 8895 “https://www.nikolasschiller.com/blog/index.php/archives/2005/06/30/434/” “Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.7.8) Gecko/20050511 Firefox/1.0.4”
72.14.194.28 – – [30/Jun/2005:19:50:41 -0400] “GET /posters/dclenz4-small.jpg HTTP/1.1” 200 26277 “https://www.nikolasschiller.com/blog/index.php/archives/2005/06/30/434/” “Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.7.8) Gecko/20050511 Firefox/1.0.4”
72.14.194.28 – – [30/Jun/2005:19:50:41 -0400] “GET /design/images/ustreet2.gif HTTP/1.1” 200 6550 “https://www.nikolasschiller.com/blog/index.php/archives/2005/06/30/434/” “Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.7.8) Gecko/20050511 Firefox/1.0.4”
72.14.194.28 – – [30/Jun/2005:19:50:41 -0400] “GET /posters/mideaststlwave-small.jpg HTTP/1.1” 200 9097 “https://www.nikolasschiller.com/blog/index.php/archives/2005/06/30/434/” “Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.7.8) Gecko/20050511 Firefox/1.0.4”
72.14.194.28 – – [30/Jun/2005:19:50:41 -0400] “GET /swf/leftpanel.swf HTTP/1.1” 200 8883 “https://www.nikolasschiller.com/blog/index.php/archives/2005/06/30/434/” “Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.7.8) Gecko/20050511 Firefox/1.0.4”
72.14.194.28 – – [30/Jun/2005:19:50:41 -0400] “GET /blog/lenzprojectanimation.swf HTTP/1.1” 200 2793 “https://www.nikolasschiller.com/blog/index.php/archives/2005/06/30/434/” “Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.7.8) Gecko/20050511 Firefox/1.0.4”
72.14.194.28 – – [30/Jun/2005:19:50:41 -0400] “GET /swf/rightpanel.swf HTTP/1.1” 200 6034 “https://www.nikolasschiller.com/blog/index.php/archives/2005/06/30/434/” “Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.7.8) Gecko/20050511 Firefox/1.0.4”
72.14.194.28 – – [30/Jun/2005:19:50:41 -0400] “GET /swf/blogmiddlepanel.swf HTTP/1.1” 200 10559 “https://www.nikolasschiller.com/blog/index.php/archives/2005/06/30/434/” “Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.7.8) Gecko/20050511 Firefox/1.0.4”
72.14.194.28 – – [30/Jun/2005:19:50:41 -0400] “GET /images/googleearthscreenshot.jpg HTTP/1.1” 200 112121 “https://www.nikolasschiller.com/blog/index.php/archives/2005/06/30/434/” “Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.7.8) Gecko/20050511 Firefox/1.0.4”
72.14.194.28 – – [30/Jun/2005:19:50:41 -0400] “GET /blog/newplayer.swf HTTP/1.1” 200 13696 “https://www.nikolasschiller.com/blog/index.php/archives/2005/06/30/434/” “Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.7.8) Gecko/20050511 Firefox/1.0.4”
72.14.194.28 – – [30/Jun/2005:19:50:42 -0400] “GET /music/audiolist.xml HTTP/1.1” 200 2815 “-” “Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.7.8) Gecko/20050511 Firefox/1.0.4”
72.14.194.28 – – [30/Jun/2005:19:50:43 -0400] “GET /nik.ico HTTP/1.1” 200 1755 “-” “Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.7.8) Gecko/20050511 Firefox/1.0.4”
72.14.194.28 – – [30/Jun/2005:19:51:51 -0400] “GET /blog/print.css HTTP/1.1” 404 1122 “https://www.nikolasschiller.com/blog/index.php/archives/category/renderings/quilt/” “Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.7.8) Gecko/20050511 Firefox/1.0.4”
69.143.5.27 – – [30/Jun/2005:19:51:51 -0400] “GET /blog/index.php/archives/category/renderings/quilt/ HTTP/1.1” 200 49443 “https://www.nikolasschiller.com/blog/index.php/archives/2005/06/30/434/” “Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.7.8) Gecko/20050511 Firefox/1.0.4”
72.14.194.28 – – [30/Jun/2005:19:51:51 -0400] “GET /blog/index.php/archives/category/renderings/quilt/ HTTP/1.1” 200 49448 “https://www.nikolasschiller.com/blog/index.php/archives/2005/06/30/434/” “Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.7.8) Gecko/20050511 Firefox/1.0.4”
72.14.194.28 – – [30/Jun/2005:19:51:51 -0400] “GET /blog/wp-images/smilies/icon_smile.gif HTTP/1.1” 200 1022 “https://www.nikolasschiller.com/blog/index.php/archives/category/renderings/quilt/” “Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.7.8) Gecko/20050511 Firefox/1.0.4”
69.143.5.27 – – [30/Jun/2005:19:51:51 -0400] “GET /blog/print.css HTTP/1.1” 404 1019 “https://www.nikolasschiller.com/blog/index.php/archives/category/renderings/quilt/” “Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.7.8) Gecko/20050511 Firefox/1.0.4”
72.14.194.28 – – [30/Jun/2005:19:51:51 -0400] “GET /blog/print.css HTTP/1.1” 404 1024 “https://www.nikolasschiller.com/blog/index.php/archives/category/renderings/quilt/” “Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.7.8) Gecko/20050511 Firefox/1.0.4”
72.14.194.28 – – [30/Jun/2005:19:51:51 -0400] “GET /posters/mallquilt-cut.jpg HTTP/1.1” 200 235479 “https://www.nikolasschiller.com/blog/index.php/archives/category/renderings/quilt/” “Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.7.8) Gecko/20050511 Firefox/1.0.4”
72.14.194.28 – – [30/Jun/2005:19:51:51 -0400] “GET /posters/georgetownquilt-cut.jpg HTTP/1.1” 200 229587 “https://www.nikolasschiller.com/blog/index.php/archives/category/renderings/quilt/” “Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.7.8) Gecko/20050511 Firefox/1.0.4”
69.143.5.27 – – [30/Jun/2005:19:51:52 -0400] “GET /blog/wp-images/smilies/icon_smile.gif HTTP/1.1” 200 920 “https://www.nikolasschiller.com/blog/index.php/archives/category/renderings/quilt/” “Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.7.8) Gecko/20050511 Firefox/1.0.4”
72.14.194.28 – – [30/Jun/2005:19:51:51 -0400] “GET /posters/mallquilt-cut2.jpg HTTP/1.1” 200 230889 “https://www.nikolasschiller.com/blog/index.php/archives/category/renderings/quilt/” “Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.7.8) Gecko/20050511 Firefox/1.0.4”
72.14.194.28 – – [30/Jun/2005:19:51:51 -0400] “GET /posters/georgetownquilt.jpg HTTP/1.1” 200 268631 “https://www.nikolasschiller.com/blog/index.php/archives/category/renderings/quilt/” “Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.7.8) Gecko/20050511 Firefox/1.0.4”
72.14.194.28 – – [30/Jun/2005:19:51:51 -0400] “GET /posters/minneapolisquilt-cut.jpg HTTP/1.1” 200 257734 “https://www.nikolasschiller.com/blog/index.php/archives/category/renderings/quilt/” “Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.7.8) Gecko/20050511 Firefox/1.0.4”
72.14.194.28 – – [30/Jun/2005:19:51:51 -0400] “GET /posters/ivanmemory-cut.jpg HTTP/1.1” 200 227161 “https://www.nikolasschiller.com/blog/index.php/archives/category/renderings/quilt/” “Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.7.8) Gecko/20050511 Firefox/1.0.4”
72.14.194.28 – – [30/Jun/2005:19:51:51 -0400] “GET /posters/ivanmemory.jpg HTTP/1.1” 200 334118 “https://www.nikolasschiller.com/blog/index.php/archives/category/renderings/quilt/” “Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.7.8) Gecko/20050511 Firefox/1.0.4”
72.14.194.28 – – [30/Jun/2005:19:51:51 -0400] “GET /posters/minneapolisquilt.jpg HTTP/1.1” 200 416682 “https://www.nikolasschiller.com/blog/index.php/archives/category/renderings/quilt/” “Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.7.8) Gecko/20050511 Firefox/1.0.4”
72.14.194.28 – – [30/Jun/2005:19:51:51 -0400] “GET /posters/mallquilt.jpg HTTP/1.1” 200 328288 “https://www.nikolasschiller.com/blog/index.php/archives/category/renderings/quilt/” “Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.7.8) Gecko/20050511 Firefox/1.0.4”

A WHOIS search of the IP address gives:

Search results for: 72.14.194.28

OrgName: Google Inc.
OrgID: GOGL
Address: 1600 Amphitheatre Parkway
City: Mountain View
StateProv: CA
PostalCode: 94043
Country: US

NetRange: 72.14.192.0 – 72.14.239.255
CIDR: 72.14.192.0/19, 72.14.224.0/20
NetName: GOOGLE
NetHandle: NET-72-14-192-0-1
Parent: NET-72-0-0-0-0
NetType: Direct Allocation
NameServer: NS1.GOOGLE.COM
NameServer: NS2.GOOGLE.COM
Comment:
RegDate: 2004-11-10
Updated: 2005-07-01

TechHandle: ZG39-ARIN
TechName: Google Inc.
TechPhone: +1-650-318-0200
TechEmail: arin-contact@google.com

OrgTechHandle: ZG39-ARIN
OrgTechName: Google Inc.
OrgTechPhone: +1-650-318-0200
OrgTechEmail: arin-contact@google.com

# ARIN WHOIS database, last updated 2005-07-18 19:10
# Enter ? for additional hints on searching ARIN’s WHOIS database.

What I find the most interesting is that this is not Google’s normal spyder. Everyday my website gets at least 5 hits from a Googlebot at theses IP addresses:

66.249.71.29 – – [18/Jul/2005:11:53:29 -0400] “GET /robots.txt HTTP/1.0” 200 532 “-” “Googlebot/2.1 (+https://www.google.com/bot.html)”
66.249.64.66 – – [18/Jul/2005:12:14:11 -0400] “GET /robots.txt HTTP/1.0” 200 536 “-” “Googlebot/2.1 (+https://www.google.com/bot.html)”
66.249.71.15 – – [18/Jul/2005:23:50:53 -0400] “GET /robots.txt HTTP/1.0” 200 514 “-” “Googlebot/2.1 (+https://www.google.com/bot.html)”

… those were yesterday’s visitors….

Regardless, my website was crawled by someone using Firefox, so it couldn’t have been a Googlebot!
Thus the reply I got from Google is bogus.

remember “do no evil?”