|
#1
|
|||
|
|||
|
should I block robots...........?
Hi
I keep updating my website regularly with some new changes but every time I work on the backend I block robots visits on my website to prevent wrong or incomplete indexing by them in their database. My question is should I block robots while I am working on the scripts of my website or let them do their work while I am working on source? Can anyone help me with the correct answer? Thanks in advace! |
|
#2
|
||||
|
||||
|
Re: should I block robots...........?
I would not bother blocking robots but if you are going all crazy maybe put it all in a folder and block that while working - just never like idea of blocking the robots on mass
__________________
For quality wedding favors - marketing them can be fun too. |
|
#3
|
||||
|
||||
|
Re: should I block robots...........?
I go with aussie statement
Best. |
|
#4
|
|||
|
|||
|
Re: should I block robots...........?
Use your robots.txt file to tell the robots what you want them to see. Only block what you don't want them to see.
|
|
#5
|
|||
|
|||
|
Re: should I block robots...........?
Yes, naver or cuill like robots just make server busy.
|
|
#6
|
|||
|
|||
|
Re: should I block robots...........?
Hi
Thanks to all for your helpful suggestions I will keep them in mind while I am working on backend. BTW AliyahRoma how can I keep my server busy while I am working on my website backend? Is there any special way to do this? |
![]() |
| Currently Active Users Viewing This Thread: 1 (0 members and 1 guests) | |
| Thread Tools | |
|
|
Similar Threads
|
||||
| Thread | Thread Starter | Forum | Replies | Last Post |
| need clarification on the differences between robots.txt, meta robots, and nofollow | thwart | Search Engine Optimization | 16 | 01-10-2008 02:02 AM |
| Is My Robots.txt Block Right? | onedodd | Google Web Search | 44 | 12-09-2005 10:46 AM |
| Google Adwords Robots Handling Change? | financialhost | Google AdWords | 1 | 08-19-2005 12:58 PM |