Site Maps: Let Search Engines Find Your Pages

With 40 million websites in existence, and more than 3 billion web pages indexed by Google at the time of this writing (July 2003), it's no wonder that more and more people are relying on search engines to find their way through the unruly world that the web has become.

Nowadays, it is crucial to get your pages indexed by the most important search engines. To maximize traffic to your site, you must make sure that all your internal pages are indexed, not just your main page (homepage).

Fortunately, you don't need to submit each of your pages manually. The most efficient way is to create a Site Map (a list of links to all the pages in your site) and link to it directly from your homepage.

How Will A Site Map Help Me?

Search engines find pages by "crawling" the web. They go through the code of all the pages in their database (also called index), following links to other pages and adding them to the database (in fact, more pages are added this way than by manual submission).

However, search engines have trouble following links from pages buried too deep within the directory structure of a site. A Site Map solves this problem by giving the engines access to the links to all your pages once they follow the Site Map link in your homepage. For more effectiveness, place your Site Map in your root directory (where your index page is).

Site Maps: Not Just for Search Engines

While some web users will find their way through your site by following navigation links or by using the search box, others will turn to your Site Map. If you design your Site Map carefully, it will not only be useful to the search engines, but to your human visitors as well.

Here are some pointers:

• The Site Map should act pretty much like the table of contents of a book.

• The Site Map must clearly show all the sections of your site, and the information contained in each of those sections.

• Every item in your Site Map must be hyperlinked to its URL.

• If it's not too long or cumbersome, use each page's TITLE as the link text, since this tends to increase the relevance of your site. Otherwise, use the word or the short phrase that best describes the content of the page.

• Make sure that you place the link to your Site Map at a visible location in your homepage (users shouldn't need a map to find your Site Map!).

• Don't get creative: simply call the link "Site Map".

• Make your Site Map a simple text link. If you use javascript the search engines will ignore it.

How can I check if my pages have been indexed?

Once you have created and uploaded your Site Map and placed a link to it in your homepage, submit both your homepage and your Site Map page to the search engines. You will then have to wait until the search engines do a web crawl. In the case of Google, the largest search engine, this happens approximately once a month.

To check if a page on your site has been picked-up and indexed by Google's, go to www.google.com and use the "allinurl" command in the search box:

allinurl:yourdomain.com/yourpage.html

Where "yourdomain.com/yourpage.html" is the URL of the page you want to check.

To get a list of all the pages in your domain that have been indexed by Google, you'll have to use the "site" command, followed by your domain name plus a word (or group of words) that you know appear in all your pages (for example, a copyright statement or some footer text):

site:yourdomain.com commonword

If after typing this command you get a list of all your pages (or at least a significant number of pages that weren't in the index before), this will be a strong indication that your Site Map has been successful.

-----

You can freely reprint this article. Just include the following resource box at the end:

About The Author

Mario Sanchez publishes The Internet Digest ( http://www.theinternetdigest.net ), an online collection of web design and Internet marketing articles and resources. You can freely reprint his weekly articles in your website, ezine, newsletter or ebook.

---

Google Page Rank Is Dead - Or Is It? - Part I

For a long time now, marketing gurus all over the... Read More

Stuck on Keywords

Keywords have turned into big business on the internet. If... Read More

10 Ways To Indirectly Get To The Top Of Search

There are millions of web sites trying to get listed... Read More

Link Horse Trading For The PR Challenged

After 105 days Google finally updated PR. And it's about... Read More

The Smart Way To Get Listed On Google!

So you want to get listed on Google? And you... Read More

The Modern Day Search Engine

The first task most netizens do when they log on... Read More

PPC v Natural Search ? A Cost Comparison Case Study

The attraction of Pay Per Click (PPC) online advertising is... Read More

Marketing to Search Engines AND Humans

When you were just a young and precocious student of... Read More

Types of Links

Internal Linking ? An introductionThe web as they call it... Read More

Its The Same Deal For Both Search Engines And Real Estate

It's all about location, location, location!In the past...back in the... Read More

How to Protect Your Search Engine Placement by Keeping Up-to-date on Industry Changes

There's no denying it: Search engines are a dominating force... Read More

What Makes The Perfect SEO Firm?

SEO companies come in all shapes and sizes. You've got... Read More

SEO and Directories

If you are a webmaster, then you've probably submitted your... Read More

Is Something Missing From Your Keywords Research? (Part 1)

As you may already know, keywords are an essential part... Read More

Search Engine Indexing - 3 Strategies Guaranteed to Skyrocket Your Success

In order to design a website that performs well with... Read More

Why Search Engine Optimization is Not Enough

OK. So you've created a nice website with lots of... Read More

What is Google Talk ?

The advent of Internet has affected lives of almost the... Read More

Were You Bamboozled by Google?

It's still happening. "Florida," "Boston," "Ginger," and "Brandy" are just... Read More

How To Measure Search Engine Marketing ROI

According to the Search Engine Marketing Professional Organization (SEMPO), advertisers... Read More

Your Website Title Could Be Costing You Money

Nothing could be simpler than the title you give to... Read More

Search Engine Marketing (SEM) - Houses on Sand

Do you depend on free search engine traffic for your... Read More

A Link From An Ugly Duckling Website With A PR=1 Could Give You 10 to 80 Times More PageRank

Whether you want to start a business and sell on... Read More

Is This A ?DMOZ Killer? In The Making?

Is building a Human-Edited Fully "Democratic" Search Directory Possible?The independent... Read More

Keyword Popularity Check

Before using keywords for your site, it is always better... Read More

Owning Your Category Online - Is Our Website Broken?

"Owning your business category online is more than just a... Read More

Common Sense Approach to Search Engine Optimization

Most web surfers start their sessions at a search engine... Read More

Keyword Targeting Strategy In Your Site

Once the keywords have been decided for the site one... Read More

Search Engine Optimization With Sitemaps

I just wanted to share a little Search Engine Optimization... Read More

Search Engine Marketing 101 For Corporate Sites

When most people want to find something on the web,... Read More

A Way for Search Engines to Improve

Wouldn't it be nice if the search engines could comprehend... Read More

What Constitutes a Complete and Effective SEO Campaign?

Unfortunately, not many Search Engine Optimization companies know what this... Read More

What All Top Google Websites Have in Common

While it is okay to admire and envy all those... Read More

Google Local Search And The Impact On Natural Optimization

With the advent of Google Local, a service that helps... Read More