PDA

View Full Version : Crawlers


yoyonumbers
01-10-2005, 04:41 PM
Hey guys, I have just a few short questions.

-Does the crawler after I submitted my site to a search engine like Yahoo and Google, slow down the loading of my page (or just for a short period)?

-Do I notice anything of my site being crawled, or after it's crawled?

-What are the engines (or directories) that are really a MUST to submit to?

Thanks in advance.

seobook
01-10-2005, 05:11 PM
>Does the crawler after I submitted my site to a search engine like Yahoo and Google, slow down the loading of my page (or just for a short period)?

it depends on the size of your site and your link popularity how often, hard, and deep they will crawl your site.

>Do I notice anything of my site being crawled, or after it's crawled?

many web stat programs show bot activity

>What are the engines (or directories) that are really a MUST to submit to?

the engines will just pick you up if you build link popularity. there is no link that you absolutely "must" get, but relevant on topic links are really good.

most links should help you at least get crawled (even placing a link in your profile here).

a few powerful general directories are the Yahoo! Directory ( dir.yahoo.com ) and the Open Directory Project ( www.dmoz.org )

welcome to the forums :)

yoyonumbers
01-11-2005, 10:51 AM
ah thanks for the reply!

but will I notice a slower loading of my page after it has been crawled by some crawlers?

creativecraig
01-12-2005, 08:25 AM
There should not be a reason if the page was crawled at 12:30am that if you then loaded the page at 12:35am the page should load any slower, if that is the case then check with the server administrator to see if there any other problems that could cause this to happen.