does https:// = duplicate content?

[Onestop]

Somehow google found it's way onto a secure page of my site and started crawling. It indexed a bunch of non secure pages as https pages. I was afraid this would lead to duplicate content. I had tech support at my vendor help me block out the https in webmaster. However, once I did this it started a chain reaction that caused me to loose most of my indexed pages. Google is no longer accessing my site. Obviously there was a problem with how the file was set up. I want to delete it and open the door for google. If I do they might find the https again. Is this a problem?

[AussieWebmaster]

I have https pages in the index - it is not a big deal

[Onestop]

Originally Posted by AussieWebmaster

I have https pages in the index - it is not a big deal

I guess I should qualify. I have pages like this . . .
https:// sitepage101.com
http:// sitepage101.com

That isn't duplicate content?

[jag]

Again make sure the https files are set properly in server and the secure files are not crawled. https will go off as you block.

Best,

[Onestop]

Originally Posted by jag

Again make sure the https files are set properly in server and the secure files are not crawled. https will go off as you block.

Best,

Jag. I guess I didn't explain very well. Secure files are not crawled. However, every time my third party vendor blocks spiders from crawling https urls they screw up the entire robot file. It causes google to drop most of my pages. I am removing their block in order to allow google back on the site. Eventually google will crawl one of the https portions of the site and then apply https to every page after that creating duplicate url's. Is this a problem? In my mind I don't care about the same url showing up as https and http as long as it shows up (which it doesn't with the block on).

[deanpowel71]

I have never seen https domains either with PR or zero, but only Grey. Guess Google doesn't show any details for https sites? But, both versions are indexed separately.

[AussieWebmaster]

No they do - look at this search http://www.google.com/search?q=https...ient=firefox-a

[jag]

Onestop, if you are not so concern you can leave. Not much problem. In general it is a good practice not to have same file indexed with both http and https. Anyway it may go off on repeated crawl when it is not found useful.

As well To allow Googlebot to index all http pages but no https pages, you'd use the robots.txt files below.

For your http protocol http:// yourserver.com/robots.txt:

User-agent: *
Allow: /

For the https protocol https:// yourserver.com/robots.txt:

User-agent: *
Disallow: /

Best,