Go Back   Search Engine Watch Forums > Search Engine Marketing Strategies > Search Engine Optimization


Reply
 
Thread Tools
  #1  
Old 05-21-2009
maneetpuri maneetpuri is offline
Member
 
Join Date: Sep 2008
Posts: 71
maneetpuri is on a distinguished road
should I block robots...........?

Hi

I keep updating my website regularly with some new changes but every time I work on the backend I block robots visits on my website to prevent wrong or incomplete indexing by them in their database.

My question is should I block robots while I am working on the scripts of my website or let them do their work while I am working on source?

Can anyone help me with the correct answer?

Thanks in advace!
Reply With Quote
  #2  
Old 05-21-2009
AussieWebmaster's Avatar
AussieWebmaster AussieWebmaster is offline
Forums Editor, SearchEngineWatch
 
Join Date: Jun 2004
Location: NYC
Posts: 6,955
AussieWebmaster has a brilliant futureAussieWebmaster has a brilliant futureAussieWebmaster has a brilliant futureAussieWebmaster has a brilliant futureAussieWebmaster has a brilliant futureAussieWebmaster has a brilliant futureAussieWebmaster has a brilliant futureAussieWebmaster has a brilliant futureAussieWebmaster has a brilliant futureAussieWebmaster has a brilliant futureAussieWebmaster has a brilliant future
Re: should I block robots...........?

I would not bother blocking robots but if you are going all crazy maybe put it all in a folder and block that while working - just never like idea of blocking the robots on mass
__________________
Charity begins at home - so come to the IM Charity Party - this link updates to most current event.
Reply With Quote
  #3  
Old 05-21-2009
jag's Avatar
jag jag is offline
Forums Valuator, SEW
 
Join Date: May 2006
Location: CBE
Posts: 608
jag will become famous soon enoughjag will become famous soon enough
Re: should I block robots...........?

I go with aussie statement

Best.
__________________
Jag
Google Knol Profile
Learn Content SEO
My Blog: SEO Help
Reply With Quote
  #4  
Old 05-24-2009
ChiefLee ChiefLee is offline
Promotional Products Guru
 
Join Date: May 2009
Location: Lawrence KS
Posts: 32
ChiefLee will become famous soon enough
Re: should I block robots...........?

Use your robots.txt file to tell the robots what you want them to see. Only block what you don't want them to see.
Reply With Quote
  #5  
Old 05-24-2009
AaliyahRoma AaliyahRoma is offline
Member
 
Join Date: Apr 2009
Posts: 6
AaliyahRoma is on a distinguished road
Re: should I block robots...........?

Yes, naver or cuill like robots just make server busy.
Reply With Quote
  #6  
Old 06-19-2009
maneetpuri maneetpuri is offline
Member
 
Join Date: Sep 2008
Posts: 71
maneetpuri is on a distinguished road
Re: should I block robots...........?

Hi

Thanks to all for your helpful suggestions I will keep them in mind while I am working on backend.

BTW AliyahRoma how can I keep my server busy while I am working on my website backend? Is there any special way to do this?
Reply With Quote
Reply


Currently Active Users Viewing This Thread: 1 (0 members and 1 guests)
 
Thread Tools

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

vB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Forum Jump

Similar Threads
Thread Thread Starter Forum Replies Last Post
need clarification on the differences between robots.txt, meta robots, and nofollow thwart Search Engine Optimization 16 01-10-2008 03:02 AM
Is My Robots.txt Block Right? onedodd Google Web Search 44 12-09-2005 11:46 AM
Google Adwords Robots Handling Change? financialhost Google AdWords 1 08-19-2005 01:58 PM


All times are GMT -4. The time now is 12:01 AM.