An Introduction to Google Sitemaps

... and why I 'm dying to get finally in the Google SERP

Have you also experienced that getting indexed on Google, despite the Google crawler visits each day your site, is getting tougher and tougher, not to say it's apparently almost impossible in short term?! Between us, in the corridors of Google, they're talking about the notorious 'Google Sandbox' theory. According this theory, a new website is first 'sandboxed' and doesn't get a ranking when the keywords of that website are not incredibly competitive. The Google Sandbox is in fact a filter placed in March of 2004 which new websites prevents from having immediately success in the Google search engine result pages. This filter "is only intended to reduce search engine spam". The sandbox filter is not a permanent filter for your website, what means you can only wait, wait and wait until Google liberates you from this filter. In mean time, don't recline, but write original and well optimized content; write, publish and share articles, place a link on other websites etc.

An example:

I started with wallies.info this year on April 1st and submitted this URL on Google, Yahoo and MSN Search on the same day. Two months later, when I'm searching for 'http://www.wallies.info' and 'wallies.info', Google has twice 1 search result, Yahoo! twice 65 results and MSN Search 313 and 266 results. A remarkable difference, isn't it?! Anyway, Google has a huge problem and backlog to index (new) pages. But two or three times a week, I receive a Google Alert for these two searches, but they aren't encountered again in the Google search engine results pages (SERP) at all.

With the introduction of Google Sitemaps (https://www.google.com/webmasters/sitemaps/), a beta website update reporting service, on Friday 3rd of June 2, I hope this will restrict the Sandbox waiting room. With a Sitemap, crawlers are better enabled to find out recently changed pages and get immediately a list of present pages. As Google Sitemaps is released under a Creative Commons license, all search engines can make use of it. Important to know is that Google Sitemaps will not influence the calculation of your PageRank.

Sitemaps has its own variant of the XML protocol and is called the 'Sitemap Protocol'. For each URL some additional information such as the last modified date can be included.

There are several methods to create your XML Sitemap:

1. The Sitemap Generator (https://www.google.com/webmasters/sitemaps/docs/en/sitemap-generator.html) is a simple script that can be configured to automatically create Sitemaps and submit them to Google.

2. Make your own Sitemap script

3. With the Open Archives Initiative (OAI) protocol for metadata harvesting (http://www.openarchives.org/OAI/openarchivesprotocol.html)

4. With RSS 2.0 and Atom 0.3 syndication feeds

5. A simple list of URLs with one per line

In the current RSS era, it's obvious that the fourth method is the most logical and easiest. Roughly said, you need only to make a new XML template. For a working Sitemap example of the wallies.info blog, got to http://www.wallies.info/blog/gsm.php.

This XML Sitemap has to be submitted on the Google Sitemaps page ( https://www.google.com/webmasters/sitemaps/ ). When you've updated your listed pages or your Sitemap has changed, you have to resubmit your Sitemap link for re-crawling. After I've submitted the wallies.info Sitemap, it took approximately between 3 and 4 hours before Google has downloaded the file.

Please note that Sitemaps doesn't influence in no way the calculation of your PageRank, Google doesn't add every submitted Sitemap URL to the Google Index and Google doesn't guarantee anything about when or if your Sitemap pages will appear in the Google SERP.

Off course, it's easier for you to set up an automated job to submit this XML-file.

You can do this with an automated HTTP request, like this example (your sitemap has to be URL encoded, this is everything behind /ping?sitemap=):

www.google.com/webmasters/sitemaps/ping?sitemap=
http%3A%2F%2Fwww.yoursite .com%2Fsitemap.xml

What is the Sitemap Protocol?

The Sitemap Protocol informs the Google search engine which pages in your website are available for crawling. A Sitemap consists of a list of URLs and may also contain additional information about those URLs, such as when they were last modified, how frequently they change, etc.

An example of the XML Sitemap format:

-

-

http://www.wallies.info/blog/

2005-06-07T05:34:36+02:00

daily

1.0

-

http://www.wallies.info/blog/item/130/index.html

2005-06-05T10:59:22+02:00

1.0

-

...

The XML Sitemap Format uses the following XML tags:

- urlset : this tag encapsulates all other tags of this list;

- url : this tag encapsulates the changefreq, lastmod, loc and priority tags of this list;

- changefreq (optional) is how frequently the content at the URL is likely to change. Valid values are 'always', 'hourly', 'daily', 'weekly', 'monthly', 'yearly' and 'never';

- lastmod (optional) is the time the content at the URL was last modified. The timestamp has to be in a ISO 8601 format;

- loc (required) : the URL location / a URL for a page on your site (< 2.048 characters).

- priority (optional) : the priority of the page relative to other pages on the same site and is a number between 0.0 and 1.0 (default 0.5). This priority is only used to select between URLs on your site. The priority of your pages will not be compared to the priority of pages on other sites.

An urlset may contain up to 50.000 URL's and the file must not be larger than 10MB when uncompressed. Multiple Sitemaps are gathered in a Sitemap index file with a maximum of 1,000 sitemaps of the same site.

The Google Sitemaps URL: https://www.google.com/webmasters/sitemaps/

For feedback of this Sitemaps article, please feel free to visit http://www.wallies.info/blog/item/132/index. html

Walter V. is a self-employed internet entrepreneur and founder-webmaster of several websites, including wallies.info: A snappy blog about snappy blue things: blog | wiki | forum | links - http://wallies.info

mblo.gs: a snappy moblog community - http://mblo.gs

In The News:


pen paper and inkwell


cat break through


Keywords, Choose Them Wisely

By now you have likely heard that keywords and keyword... Read More

Google, Yahoo! and MSN Line up More Goodies for Internet Users

Internet users have never had it better what with Yahoo!,... Read More

SEO For Ecommerce

Ranking well under the free listings in the major search... Read More

Web Site Copy is about More Than Keywords

Let's say you are writing a web site to sell... Read More

Search Engine Optimization: What Is It?

Search Engine Optimization is the creation of a web page,... Read More

Link Exchange Tips, No Tricks

Use text links, avoid image links. Anyhow, if you... Read More

Duplicate Content Penalty - How to Lose Google Ranking Fast!

Duplicate content penalty. Ever heard of it? This penalty is... Read More

Ten Steps To A Well Optimized Website - Step 1: Keyword Selection

This is part one of ten in this search engine... Read More

Martial Arts Webmasters: Time to Optimize Your Site!

A few months ago I was looking through the search... Read More

Google PageRank Explained

1. What is PageRank? Here is what Google says:" PageRank... Read More

How Do I Submit My Site To Search Engines?

You've built up a good site, put in a lot... Read More

How to Get the Best Deal on Your SEO Project

If you own or manage a business Website, chances are... Read More

The Golden 5: Steps to Google Success

The Dream: You wake up one morning and notice your... Read More

Your Search Engine Optimization Strategy: Make Love, Not War

When it comes to search engine optimization strategy, there are... Read More

How to Boost Your Traffic and Profits with Content!

Are you aware of how vitally important and valuable CONTENT... Read More

Link Popularity --- Its Role and Importance In Getting Top Search Engine Rankings

Introduction"Link Popularity" ? these words may have caught your attention... Read More

How Search Engines Work

Before anyone can start optimizing a web site, you must... Read More

Google has an Achilles Heal - Will Their Competitors Notice?

Even though Google Revenues continue to soar, the hidden problem... Read More

How To Conceal Your Website?s ?Fingerprint? From The Search Engines

The internet marketing industry is now flooded with various page... Read More

Googles New SEO Rules

Google has recently made some pretty significant changes in its... Read More

Search Engine Musical Chairs

News broke this week that Yahoo has purchased the Inktomi... Read More

High Google Rankings: Frequency vs. Positioning

There's an assumption that the higher a ranking or positioning... Read More

A Classified Way To Drive Business To Your Web Site

There are more than 105 million of them in the... Read More

Keyword Ownership: What It Is And Where Its Headed

Have you ever got one of those silly emails that... Read More

Goofy Mistakes that Hurt Your Search Engine Rankings

One thing is for sure, you don't want to spend... Read More

Increase Page Rank with Search Engine Optimization

Utilizing effective search engine optimization techniques will improve the page... Read More

Playing in Googlebots Sandbox with Slurp, Teoma, & MSNbot - Spiders Display Differing Personalities

There has been endless webmaster speculation and worry about the... Read More

Dont Submit Your Website To Any Search Engines

We all want to get our websites high up in... Read More

A Three Day Marketing Plan for Better Google Rankings

If you're reading this article, you've probably discovered that simply... Read More

King + Queen = Royal Success

Ever wonder how or why your competitor gets better search... Read More

How to Increase Alexa Ranking of Your Website

Alexa toolbar also useful to Browse expired websites database. Many... Read More

A Link From An Ugly Duckling Website With A PR=1 Could Give You 10 to 80 Times More PageRank

Whether you want to start a business and sell on... Read More

How To Write Effective And Unique Articles That Are Optimized for the Search Engines

It is a well known fact that writing, distributing and... Read More