Toll Free: 1-877-695-7388

GTA: (647) 699-2838

Search Engine People
  • SEO
  • SEM
  • CRO
  • Display
  • Blog
  • Why Us
  • Contact
  • Join Our Team
  • Get A Quote

Toll Free: 1-877-695-7388

GTA: (647) 699-2838

New googlebot user agent

Donna Fontenot | September 28th, 2004
Tweet
Share
Share
Pin
0 Shares

Many people have noticed a new googlebot user agent in their log files recently. This new entry in the log will look like Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html). Way back in March, googleguy over at webmasterworld forum mentioned that they were testing this new user agent and would roll it out when they believed it make a smooth transition. Apparently, six months later, that time has come.

He discussed the purpose of this by saying: "The primary reason for this is that some web servers assume that unless a user agent is IE, Netscape/Mozilla, or maybe Opera, that your browser wont support JavaScript, frames, etc. As Googlebot gets better over time, it gets closer to a regular user and browser in our ability to handle features like that. This user-agent change would let vanilla webservers assume Googlebot is more like a regular user, while still allowing site owners to recognize that Google is visiting and still providing clear contact info in case of questions or issues. We would still respect Googlebot in robots.txt, so the overwhelming majority of webmasters wouldnt have to change anything at all... most site owners probably wouldnt even notice the difference."

So if you were wondering what this new user agent in your log files was all about, now you know!

Tweet
Share
Share
Pin
0 Shares
Posted in SEO

Recent Posts

  • Maximizing Your E-Commerce Sales:
    A CRO Audit Guide
  • Movin’ On Up! Why Migrating to Google Analytics 4 (GA4) Should be a Priority
  • A Year in Review: The Digital Marketing Trends That Defined 2021
  • The Basics of Video Marketing
  • Just How Much Do Google Reviews Impact Your SEO Ranking?

Categories

  • Analytics & ROI Analysis
  • Company News
  • Content
  • Conversion Optimization
  • CRO
  • Display Advertising/RTB
  • Email Marketing
  • En Español
  • En Français
  • Inbound Marketing
  • Lead Nurture & Marketing Automation
  • Local Search
  • Marketing
  • Mobile
  • Partnership Marketing
  • PPC
  • PR
  • SEO
  • Social Media Marketing
  • Web Design

Additional Posts

Make it easy for webmasters to link to you

September 27th, 2004 | by Donna Fontenot

Add content by soliciting testimonials

September 26th, 2004 | by Donna Fontenot

Yahoo! hiring – Search engine specialists needed

September 24th, 2004 | by Donna Fontenot

LET'S TALK

Need more information or want to get in touch?

Get in touch!
  • SEO
  • SEM
  • Display
  • Blog
  • Why Us
  • Join Our Team
  • Contact Us
  • Local SEO
  • Small Business SEO
  • Enterprise SEO
  • International SEO

LOCATION

1305 Pickering Parkway,
5th Floor Pickering, L1V 3P2

PHONE

Toll Free: 1-877-695-7388
Greater Toronto Area: (647) 699-2838

Social

© Search Engine People Inc. 2023 – Canada’s Top Digital Agency
© SEP 2023 – A Search Engine People Company | Privacy Policy

Search Engine People