Hello,

Q1.
My robot.txt is located in this directory:
http://goingegypt.com/pharaoh/robot.txt

When you go to my homepage www.goingegypt.com and view source the code of the robot.txt the meta tag is:
<meta name="robots" content="index, follow" />

Is the meta code pointing in the direction for the engines
to see the site?

Q2. When you go to my site www.goingegypt.com it gets redirected to:
http://goingegypt.com/pharaoh/sharm-el-sheikh/holiday-in-egypt-budget-car-hire-egypt.html

Will this have a problem on search engines, SEO and the engines finding robot.txt issue mentioned in Q1.?

Q3 What does this mean: User-agent: *

S.

Hi Luke :)

Q1:
the robots.txt file and the robots meta tag are two different things.
Your robots.txt file should be located directly at the root of your domain, http://goingegypt.com/robot.txt (http://goingegypt.com/pharaoh/robot.txt)

<meta name="robots" content="index, follow" /> is kind of unneccesary, robots will automatically inex and follow unless you tell them to do otherwise

Q2:
Is this a 301 redirect? If it isn't, it should be. That is, if you must. I don't think it's a good idea to redirect your home page just so you can stuff more keywords in the file names.

Q3:
* is a wildcat, it means "any". User-agent: * means any user agent. Google's uder agent for example is Googlebot.

Search engines see your site as not having a robots.txt until it is placed on the root.

Hi Luke :)

Q1:
the robots.txt file and the robots meta tag are two different things.
Your robots.txt file should be located directly at the root of your domain, http://goingegypt.com/robot.txt (http://goingegypt.com/pharaoh/robot.txt)

<meta name="robots" content="index, follow" /> is kind of unneccesary, robots will automatically inex and follow unless you tell them to do otherwise

Q2:
Is this a 301 redirect? If it isn't, it should be. That is, if you must. I don't think it's a good idea to redirect your home page just so you can stuff more keywords in the file names.

Q3:
* is a wildcat, it means "any". User-agent: * means any user agent. Google's uder agent for example is Googlebot.

Thanks for this, its very useful.

I don't understand what you mean by "301 redirect" I use a CMS software to run the site and put all the files in a folder called phoroah eg. http://goingegypt.com/pharaoh. I have now decided this isn't best hompage so now I do a redirect to: http://goingegypt.com/pharaoh/sharm-el-sheikh/holiday-in-egypt-budget-car-hire-egypt.html

Not all my best keywords are on the hompage they are scattered around the site.

I am stuck!

Q3. I have built this site for 10 months, and put the CMS software in this folder www.gojngegypt.com/pharaoh/ and all the pages are within this, what can I do about this redirect?

Q4. I have now put my robots.txt here:
http://goingegypt.com/robots.txt

The robot file looks like this:

User-agent: *
Disallow: /administrator/
Disallow: /cache/
Disallow: /components/
Disallow: /editor/
Disallow: /help/
Disallow: /images/
Disallow: /includes/
Disallow: /language/
Disallow: /mambots/
Disallow: /media/
Disallow: /modules/
Disallow: /templates/
Disallow: /installation/

But these folders administrator, cache, components etc are in these folders:

www.goingegypt.com/pharaoh/administrator/
www.goingegypt.com/pharaoh/cache/
www.goingegypt.com/pharaoh/components/

Will they be disallowed by the robots?

S.