How can I make specific content not indexed by the search engines?

[Julien]

Hi everyone,
I have a search feature in the middle of my page with a list menu that contains almost 2000 words. These non-relevant terms drastically lower my keyword density. Is there a way to make this feature not indexed by the search engines?

I don't mind my link not being index, I have others paths on my page.

Thanks everyone,

Julien Raby

[phaithful]

the easiest way is to have all that content be written in via javascript. That way it's still displayed to the users but not indexed by the engines.

[Lebowski]

There are couple of ways to do this, one of them is addding something like "id=123456789" in urls, actually there need to be more than specific amount of numbers after "id=". SE don't index pages like that, anyway that's a rude way to not get indexed. I find the one below most sophisticated.

On pages you don’t want indexed by spiders, just add this meta tag to the page:
<META NAME=”ROBOTS” CONTENT=”NOINDEX”>

And your page won't be indexed, easy as that. :)

[uTOPia]

Julien, first of all I dare to advice you not to put too much attention to keyword density

Secondly, here're some ways to avoid indexing your pages:
1) Use your robots.txt: add something like

Disallow: YOUR_URL

You may use regular expressions while specifying URLs, you may disallow either pages or folders

2) <META NAME=”ROBOTS” CONTENT=”NOINDEX”>
The problem is that you have to put this code inside every page you wish not being index

3) JavaScript (as phaithful suggests)
I have seen a page wich WAS indexed by Google though its content was written in via javascript, so I wouldn't say this method 100% works

[Marcia]

I wouldn't worry too much about keyword density if that section is a drop-down list in the middle of the page. Just have your keywords in prominent places like the page title and H1, and use in the first paragraph. And it can't hurt to include it in a brief, nicely written meta description tag just to identify the page topically.

There isn't any way to prevent indexing only part of a page, although if you make the section all Javascript that might possibly do it. It would take someone who knows Javascript to tell you how and if it will work, though.

Disallow: YOUR_URLThat's the general idea, but it's the wrong syntax.

Be very, very careful to get the exact syntax correct in a robots.txt file or you could end up having a site de-indexed altogether.

[evilgreenmonkey]

I wouldn't worry too much about keyword density if that section is a drop-down list in the middle of the page. Just have your keywords in prominent places like the page title and H1, and use in the first paragraph. And it can't hurt to include it in a brief, nicely written meta description tag just to identify the page topically.


My thoughts exactly.


There isn't any way to prevent indexing only part of a page, although if you make the section all Javascript that might possibly do it. It would take someone who knows Javascript to tell you how and if it will work, though.


You'll need something like this:

<script language="JavaScript" type="text/javascript">
var nospiders = "Add Your Content Here";
document.write(nospiders);
</script>


Remember that this won't be readable on some browsers as well though. Something like 10% of browsers don't support JS or the user turns it off - you know how stats randomly change every week though.


Be very, very careful to get the exact syntax correct in a robots.txt file or you could end up having a site de-indexed altogether.


From my experience, spiders will ignore a robots.txt if it's in the wrong format, although it could of course cause serious damage if used in the correct format but incorrectly implemented.


:cool:

Rob