Detailed Analysis of MSN's Beta Search

[randfish]

I have completed a short but in-depth analysis of MSN's new beta search results. Sadly, they are still lagging behind both Yahoo! and Google significantly, but their beta results are promising. They could be a very successful engine in the future, especially if they can find a way to rival the size of Google's index.

Sadly the report will not fit here in its entirety, but I'd like for everyone to be able to read my results and critique my findings. I realize the study only analyzes the results for 4 queries thus far (despite taking nearly 10 total hours to compile), but I feel it is still a good look into the accuracy and methodology of MSN's search.

http://www.socengine.com/seo/guide/msn-beta-vs-yahoo-google.html

Your comments & suggestions are appreciated.

[randfish]

I'd love feedback - I realize it's a small sampling, but I'm open to expanding it - give me some ideas, search terms you'd like to see included, etc.

[rustybrick]

I'd love feedback - I realize it's a small sampling, but I'm open to expanding it - give me some ideas, search terms you'd like to see included, etc.

I would recommend you pointing out your main findings directly in the thread, in bullet list format. It will probably get a larger response that way.

[seomontreal]

I'd love feedback - I realize it's a small sampling, but I'm open to expanding it - give me some ideas, search terms you'd like to see included, etc.
Thanks for this Randfish. My boss has just asked me what I would do with an unlimited budget for SEO to get our sites in the top 10. And I really am at a loss - I am employing most of the major techniques but we are soooo far down the ranking ladder - we're down there with Lord of the Low Rankings *grin*

So I am about to embark on a similar survey as to what you have done and will eventually publish my results ;-) I think I will pretty much follow your structure for consistency! Call me a copycat *grin*

seomontreal

[Webby]

I thought it worhtwhile to mention that not only is the english langauge beta getting pulled apart for analysis, but also the German version is too.

I carried out a poll on my own German language SEM Forum (large) with the following question (translated into English)...

What is your opinion of the MSM Beta SERPS to date?

Answers:

A. Better than Google.
B. The same quality as Google.
C. Worse than Google.
D. Too early to say.
E. I don't care, I'm sticking with Google regardless.

My forum, like this one, consists of SEOs, webmarketeers and webmasters plus individuals who are generally web savvy. So this should be taken into account. The sample size is also quite small @ just 67 (enough however imo to be of some note).

The results so far are as follows (it is still ongoing).

A. Better than Google. 35% [ 24 ]
B. The same quality as Google 7% [ 5 ]
C. Worse than Google 23% [ 16 ]
D. Too early to say 26% [ 18 ]
D. I don't care, I'm sticking with Google Regardless. 5% [ 4 ]

Interestingly 5% say they wouldn't change no matter how good MSN results are. The euthoria of a new SE challenging Googles market postiton may well give bias towards MSN in the survey. All in all though, MSN Beta (.de) has come out pretty well from my forum sample. With their position and money and no doubt deep integration in future windows versions, we are going to see Googles search market share drop quite considerably imo. Another survey carried out by a forum member with a larger sample (189) with just the three options (better, worse or same) had MSN coming out top with 49% compared with Google @ 38%. Clearly the samples are in no way large enough or broad enough to be conclusive. I do believe however that this should provide food for thought at the Googleplex. Where there is smoke, there is usually fire.

MSN might well launch with a large range of webmaster features such as enhanced domain/page backward link checks and a host of other research tools which may appeal to webmasters. It was webmasters and SEOs btw. that started the ball rolling for the demise of Altavista/Yahoo! 4-5 years ago and the switch to Google. If I was MSN I'd think vary carefully about out performing Google in the webmaster tools area. A keyword database would be a good start if you are listening MSN ;-)

This is however just a Beta but if I was MSN I would be very happy with the feedback so far. I'm surprised they didnt try some viral marketing such as Gmail has done with the invitation thing, but that might yet come.

What has been mentioned before is that the MSN algo is currently highly manipulatable with far more focus on on-page optimization as off-page. Their spam filters are also virtually non-existent. Google is way ahead in spam prevention and imo if MSN do not address this, they are going to be absolutely flooded with non-content doorway page spam as soon as they launch. Link bombing isnt as effective on MSN beta as on Google which is another sign less weight is given to off page criteria. I think the majority of good SEOs already have this algo pretty much cracked if it stays as it is (or should have). Googleguy is right that this Algo is going to be like an open book very quickly indeed. It already is imo.

Anyway, I've waffled enough. Are there any surveys carried out yet for the .com Beta? I couldn't find any.

Cheers
Alan

[randfish]

Webby,
It's good to see you here - I thought you'd abandoned the forums entirely :)

I agree that MSN has a lot of work to do, but I must say I'm surprised that so many people responded to the survey saying that MSN is better than Google. I think maybe us webmasters just need a break from Google and are looking for any good alternative.

I agree with you on how MSN can suceed too - Google grew through word of mouth from webmasters & web insiders. MSN can do the same if they manage to "Wow" the same communities. I know most of my family and friends started using Google after I recommended it to them, if MSN or Yahoo! impress the webmasters & other early adopters, they can gain back a significant market share.

[AussieWebmaster]

Okay the impact of domain name is huge and they do not seem to have a problem listing doorway pages.

http://beta.search.msn.com/results.aspx?q=forex&FORM=QBHP

There are 6 doorway pages all pointing to the same place and the domains in many cases are 1forex.net, 1forex.biz, 1forex.info ....

If this stays the way it is I am going to have a field day doing the same thing - hey it may seem Black Hat - but we are given a set of parameters and all you can do is play with them.