Discussion:
Search engine question
(too old to reply)
Kathy
2005-09-13 21:23:14 UTC
Permalink
I have a question about the popular search engines.

I have a website that used to contain the word "puberty", until I found out
I was getting 20-50 hits per day from people doing internet image searches
for that word.

After looking at the sorts of images that come up as the result of such a
search, I have made some assumptions about the motives of people who do
those searches, and I would prefer that they not be happening upon the
website I made to keep my family and friends updated as to my son's medical
condition.

I removed every single instance of the word from his site. I renamed the
jpeg that used to come up in the google image search, so the image that the
google thumbnail displays doesn't exist any more (there's an explanation of
that here: http://stevenbell.blogspot.com/2005/08/have-nice-day.html )

Now when I do a google web search on the word puberty, only two pages from
my site come up, it used to be 20 or so. The two pages that come up no
longer have that word. The page that comes up in the image search is one of
those that no longer comes up in the web search, so it seems that google has
reindexed that page.

My questions:
1. Why are some of the pages on my site reindexed and others not? I
thought if google crawled a site, the entire thing would get reindexed, or
at least that's what they say.

2. If a particular page has been reindexed, why does it still show up on an
image search?

Just curious if there's anything I can do to speed up the process, this is
not a complaint.

- Kathy
Scott Lindner
2005-09-13 22:11:05 UTC
Permalink
I'm guessing you don't know about the robots.txt file, right?
http://www.searchengineworld.com/robots/robots_tutorial.htm

Here's my robots.txt file. Exactly how I want it!
User-agent: *
Disallow: /

I've attached it as well.

Scott


begin 666 robots.txt
M(R!2;V)O=',N='AT(&9I;&***@8W)E871E9"!B>2!H='1P.B\O=W=W+G=E8G1O
M;VQC96YT<F%L+F-O;0T*(R!&;W(@9&]M86EN.B!H='1P.B\O>'EZ+F-O;0T*
M#0HC($YO(')O8F]T('=I;&P@<W!I9&5R('1H92!D;VUA:6X-"E5S97(M86=E
4;G0Z("H-"D1I<V%L;&]W.B O#0H`
`
end
Kathy
2005-09-15 05:03:32 UTC
Permalink
Post by Scott Lindner
I'm guessing you don't know about the robots.txt file, right?
http://www.searchengineworld.com/robots/robots_tutorial.htm
Here's my robots.txt file. Exactly how I want it!
User-agent: *
Disallow: /
I've attached it as well.
Thanks. I'm going to do that.

- Kathy
Scott Lindner
2005-09-15 14:05:49 UTC
Permalink
Post by Kathy
Thanks. I'm going to do that.
I'm glad a simple solution is all you needed and that you found your answer
so quickly. Rarely does it work out that way with computers. :-(

Cheers,
Scott

Continue reading on narkive:
Loading...