Toll Free: 1-877-695-7388

GTA: (647) 699-2838

Search Engine People
  • SEO
  • SEM
  • CRO
  • Display
  • Blog
  • Why Us
  • Contact
  • Join Our Team
  • Get A Quote

Toll Free: 1-877-695-7388

GTA: (647) 699-2838

MSN/Live Ponies Up About The Referrer Spam

Donna Fontenot | December 4th, 2007
Tweet
Share
Share
Pin
0 Shares

About 3 weeks ago, I said it was Past Time For MSN To Pony Up To The Real Truth About Referrer Spam. Now, they have.

Since that time, I've had the opportunity to discuss some of these issues with Jeremiah Andrick, the Program Manager of Live Search Developer Tools. He and the team of Live engineers* have addressed these issues and have issued a statement, answered questions, explained what it is all about (hint: they are checking for cloaking), and noted what they've done to solve the problems created by their new spambot. They've also created ways for you to address any additional issues, problems, or concerns you have about this bot's activities.

They discuss:

  • the Adsense issues
  • high traffic from the bot distorting logs
  • inappropriate non-site-specific terms
  • and their response to all of the above

I followed up with them on some things that weren't clear to me from their response, and I wanted to pass along the answers I received. I would suggest, however, that you go read their response first and then come back here when you're done (that link will open a new tab/window for you).

1. I asked why they couldn't have just let the new bot extension crawl the cached pages they have stored on their servers. They said:

The reason we could not check for cloaking against the cached version is that only a live page can be tested for cloaking. In the case of a spammer the cached page would only show us what it showed MSNbot. We want to reiterate that not all cloaking is spam, but we don't ever recommend cloaking for any reason. To provide great results, we need to be able to identify the legitimate and illegitimate content.

2. I then said that I thought they should emphasize that blocking the new bot is effectively blocking msnbot completely, and that could result in their pages being de-indexed. They said:

We understand the issues that webmasters were experiencing that may have caused them to block the bot. However, we would ask that that they contact us with any issues through our feedback form, or through our forum before they block the bot so we have a chance to resolve them. We believe we have addressed all of the existing issues with the bot, but would like to know of any other issues that webmasters may have encountered.

3. Finally, I wanted to know if this bot follows any directives in robots.txt or does it ignore or even look at robots.txt. They said:

Yes, this robot does follow the robots.txt file. The reason you don't see it download it, is that we use a fresh copy from our index. The tool does respect the robots.txt the same way that MSNBot does with a caveat; the tool behaves like a browser and some files that a crawler would ignore will be viewed just like real user would.

I really appreciate the fact that the Live team members took our concerns seriously, and worked hard to address them.

---

* ("He and the team of Live engineers" ... as opposed to ... "He and the team of zombies"?). Sorry, that phrase, "Live engineers", just brought out the "beast" in me. Oh, go ahead and laugh. You're as geeky as I am. 😉

More Thoughts and History of This Issue:

Yell If Microsoft's Live.com Spammed You Too

Live Search Referrer Spamming

Microsoft Needs to Quit F'ing With My Adsense Scripts

WMW Thread

Tweet
Share
Share
Pin
0 Shares
Posted in Social Media Marketing

7 thoughts on “MSN/Live Ponies Up About The Referrer Spam”

  1. Sonja Ray says:
    December 4, 2007 at 8:54 pm

    I find it interesting that their response on the robots.txt question is basically, “Our bot obeys robots.txt, except when it doesn’t.”

  2. CombatWombat says:
    July 6, 2008 at 3:18 am

    I’m here because they are still doing it. Over 30% of my site traffic is this crappy bot run by the marvels that brought the world that gorgeous piece of crapware known as Vista.
    Bitter? Yup.

Comments are closed.

Recent Posts

  • The Manifest Names Search Engine People Among Toronto’s Most Reviewed SEO Companies
  • Movin’ On Up! Why Migrating to Google Analytics 4 (GA4) Should be a Priority
  • A Year in Review: The Digital Marketing Trends That Defined 2021
  • The Basics of Video Marketing
  • Just How Much Do Google Reviews Impact Your SEO Ranking?

Categories

  • Analytics & ROI Analysis
  • Company News
  • Content
  • Conversion Optimization
  • Display Advertising/RTB
  • Email Marketing
  • En Español
  • En Français
  • Inbound Marketing
  • Lead Nurture & Marketing Automation
  • Local Search
  • Marketing
  • Mobile
  • Partnership Marketing
  • PPC
  • PR
  • SEO
  • Social Media Marketing
  • Web Design

Additional Posts

Admission of Guilt Will No Longer Be Required For Google Reconsideration Request

December 2nd, 2007 | by Donna Fontenot

Less PageRank Floating Around In SEO Niche

December 2nd, 2007 | by Donna Fontenot

Things You Should’ve Read This Week But Didn’t

November 30th, 2007 | by Ruud Hein

LET'S TALK

Need more information or want to get in touch?

Get in touch!
  • SEO
  • SEM
  • Display
  • Blog
  • Why Us
  • Join Our Team
  • Contact Us
  • Local SEO
  • Small Business SEO
  • Enterprise SEO
  • International SEO

LOCATION

1305 Pickering Parkway,
5th Floor Pickering, L1V 3P2

PHONE

Toll Free: 1-877-695-7388
Greater Toronto Area: (647) 699-2838

Social

© Search Engine People Inc. 2023 – Canada’s Top Digital Agency
© SEP 2023 – A Search Engine People Company | Privacy Policy

Search Engine People