Making a site less crawlable [was: Who are you working for?]

One of our tasks as SEO's is making a site crawlable; to make the site as search engine friendly as possible and to provide the spiders with the link roads and site roadmaps they need to boldly go where earlier no bot could or would.

Burning Man 2009 by Lara604

Much of how we look at a site is approached from that angle. When we see a form, a dropdown, we wonder if it can be crawled. We don't see a neat Flash animation; we see questions about crawlability and which extracted link will call up which portion of that file.

You can't blame us then when we get lost, unable to see the trees through the forest.

  • Is making any and every part of your site accessible to spiders needed?
  • Is it an advantage?
  • Why are you dealing with duplicate content issues?
  • Where does your consideration of using the rel=canonical monster come from?
  • Why is your [site:] 50 times larger than your site really is?
  • How come you're looking how to exclude parts of your site via robots.txt?

Is absolute indexability of every URL parameter on your site a must?

Whose mission do you serve by making everything accessible? Who do you work for? What's in your best interest?

How can you take people by the hand and give them the smoothest ride to destinations desired but unknown via click paths that feel as intuitive and well duh! as flipping a light switch?

What's Information Architecture?

What do you do to have the right pages indexed for the right keywords? Do you use any special tricks to force search engines hands?

To think about:

About the Author: Ruud Hein

My paid passion at Search Engine People sees me applying my passions and knowledge to a wide array of problems, ones I usually experience as challenges. People who know me know I love coffee.

Ruud Hein

Additional Posts

keyword research

3 Bare Bones SEO Techniques Small Business Sites Can’t Afford to Ignore

What is Facebook Open Graph?

In compliance with Ontario’s non-essential business closure our physical offices are closed until further notice. Fortunately our willingness to adopt work from home and the required technology over the past two years has allowed us to continue our operations without impact. For our valued clients and partners you can expect the same great level of service and execution you have become accustomed to.

Many clients/prospects have reached out to us in an effort to introduce new campaigns as quickly as possible. In an effort to help our clients pivot we have increased our campaign build capacity. We are now able to turn new campaigns over in 2-3 business days opposed to the typical 5-7 business day turnaround time. Please note that campaign launch approvals from the vendor side (Google, Bing, Facebook, Instagram etc.) may be delayed as those companies migrate to work from home.

For existing clients please reach out to your account manager with any questions you may have.

For non-clients looking for assistance with new campaigns please Contact Us

Read previous post:
keyword research
3 Bare Bones SEO Techniques Small Business Sites Can’t Afford to Ignore

I get a lot of inquiries from niche, small business, eCommerce type sites. Most of them want to know what...Read...