PDA

View Full Version : Fixing banned status


learner
11-19-2005, 07:17 AM
I have a domain that looks like it was abused by the previous owner.

First, it looks banned by Google (not a single page in Google although it uses Google Sitemaps, etc.)
As far as Yahoo Web Search is concerned, it only has some old spam-like pages in its cache (probably old content from the previous owner):
http://search.yahoo.com/search?p=site%3Agoogle-info.com&prssweb=Search&ei=UTF-8&fr=sfp&fl=0&x=wrt

Microsoft search is the only major engine that indexes the site and rankings are quite okay considering that I don't have much content on the site.

Last week I first banned Yahoo bot in robots.txt to have Yahoo remove the old pages and after a few days I again allowed Slurp in robots.txt.
I don't know if this is enough to have the old pages removed and the site un-banned.

Is there anything else that I can do?

Carlos Chacón
11-19-2005, 09:20 AM
Is there anything else that I can do?
SE crawlers are dynamic. My personal opinion on your situation is:
-Delete all content you do not want on your new website
-Publish new content with appropriate “invitation” to the SE crawl

Remember all SE works in different ways of time, aspects, algorithms, etc.
Take a look on this good research on http://comparesearchengines.dogpile.com/OverlapAnalysis.pdf .

likestowatch
11-21-2005, 01:29 AM
I think the problem is that all the cached pages do a 301 redirect.

For example:
http://www.google-info.com/Metals-3.html
returns 301.

Perhaps the correct thing is to make all these old spam URLs to return 404 to convince yahoo to forget about these bad URLs.

learner
11-21-2005, 06:51 AM
Thanks.

My content mgmt software can't do proper 404 and 301 so today I disallowed Slurp in robots.txt and I plan to leave it that way for 5 weeks (unless a software update solves this problem).

I have a "fake" 404 page which actually still returns a 200 response and just redirects to a 404 page. Lame, I know. I can only wait now.

It puzzles me that the Yahoo cache hadn't expired before I setup this site (although I can't find out when, how and why it was abandoned by the previous owner).