An Introduction to Google Sitemaps

... and why I 'm dying to get finally in the Google SERP

Have you also experienced that getting indexed on Google, despite the Google crawler visits each day your site, is getting tougher and tougher, not to say it's apparently almost impossible in short term?! Between us, in the corridors of Google, they're talking about the notorious 'Google Sandbox' theory. According this theory, a new website is first 'sandboxed' and doesn't get a ranking when the keywords of that website are not incredibly competitive. The Google Sandbox is in fact a filter placed in March of 2004 which new websites prevents from having immediately success in the Google search engine result pages. This filter "is only intended to reduce search engine spam". The sandbox filter is not a permanent filter for your website, what means you can only wait, wait and wait until Google liberates you from this filter. In mean time, don't recline, but write original and well optimized content; write, publish and share articles, place a link on other websites etc.

An example:

I started with wallies.info this year on April 1st and submitted this URL on Google, Yahoo and MSN Search on the same day. Two months later, when I'm searching for 'http://www.wallies.info' and 'wallies.info', Google has twice 1 search result, Yahoo! twice 65 results and MSN Search 313 and 266 results. A remarkable difference, isn't it?! Anyway, Google has a huge problem and backlog to index (new) pages. But two or three times a week, I receive a Google Alert for these two searches, but they aren't encountered again in the Google search engine results pages (SERP) at all.

With the introduction of Google Sitemaps (https://www.google.com/webmasters/sitemaps/), a beta website update reporting service, on Friday 3rd of June 2, I hope this will restrict the Sandbox waiting room. With a Sitemap, crawlers are better enabled to find out recently changed pages and get immediately a list of present pages. As Google Sitemaps is released under a Creative Commons license, all search engines can make use of it. Important to know is that Google Sitemaps will not influence the calculation of your PageRank.

Sitemaps has its own variant of the XML protocol and is called the 'Sitemap Protocol'. For each URL some additional information such as the last modified date can be included.

There are several methods to create your XML Sitemap:

1. The Sitemap Generator (https://www.google.com/webmasters/sitemaps/docs/en/sitemap-generator.html) is a simple script that can be configured to automatically create Sitemaps and submit them to Google.

2. Make your own Sitemap script

3. With the Open Archives Initiative (OAI) protocol for metadata harvesting (http://www.openarchives.org/OAI/openarchivesprotocol.html)

4. With RSS 2.0 and Atom 0.3 syndication feeds

5. A simple list of URLs with one per line

In the current RSS era, it's obvious that the fourth method is the most logical and easiest. Roughly said, you need only to make a new XML template. For a working Sitemap example of the wallies.info blog, got to http://www.wallies.info/blog/gsm.php.

This XML Sitemap has to be submitted on the Google Sitemaps page ( https://www.google.com/webmasters/sitemaps/ ). When you've updated your listed pages or your Sitemap has changed, you have to resubmit your Sitemap link for re-crawling. After I've submitted the wallies.info Sitemap, it took approximately between 3 and 4 hours before Google has downloaded the file.

Please note that Sitemaps doesn't influence in no way the calculation of your PageRank, Google doesn't add every submitted Sitemap URL to the Google Index and Google doesn't guarantee anything about when or if your Sitemap pages will appear in the Google SERP.

Off course, it's easier for you to set up an automated job to submit this XML-file.

You can do this with an automated HTTP request, like this example (your sitemap has to be URL encoded, this is everything behind /ping?sitemap=):

www.google.com/webmasters/sitemaps/ping?sitemap=
http%3A%2F%2Fwww.yoursite .com%2Fsitemap.xml

What is the Sitemap Protocol?

The Sitemap Protocol informs the Google search engine which pages in your website are available for crawling. A Sitemap consists of a list of URLs and may also contain additional information about those URLs, such as when they were last modified, how frequently they change, etc.

An example of the XML Sitemap format:

-

-

http://www.wallies.info/blog/

2005-06-07T05:34:36+02:00

daily

1.0

-

http://www.wallies.info/blog/item/130/index.html

2005-06-05T10:59:22+02:00

1.0

-

...

The XML Sitemap Format uses the following XML tags:

- urlset : this tag encapsulates all other tags of this list;

- url : this tag encapsulates the changefreq, lastmod, loc and priority tags of this list;

- changefreq (optional) is how frequently the content at the URL is likely to change. Valid values are 'always', 'hourly', 'daily', 'weekly', 'monthly', 'yearly' and 'never';

- lastmod (optional) is the time the content at the URL was last modified. The timestamp has to be in a ISO 8601 format;

- loc (required) : the URL location / a URL for a page on your site (< 2.048 characters).

- priority (optional) : the priority of the page relative to other pages on the same site and is a number between 0.0 and 1.0 (default 0.5). This priority is only used to select between URLs on your site. The priority of your pages will not be compared to the priority of pages on other sites.

An urlset may contain up to 50.000 URL's and the file must not be larger than 10MB when uncompressed. Multiple Sitemaps are gathered in a Sitemap index file with a maximum of 1,000 sitemaps of the same site.

The Google Sitemaps URL: https://www.google.com/webmasters/sitemaps/

For feedback of this Sitemaps article, please feel free to visit http://www.wallies.info/blog/item/132/index. html

Walter V. is a self-employed internet entrepreneur and founder-webmaster of several websites, including wallies.info: A snappy blog about snappy blue things: blog | wiki | forum | links - http://wallies.info

mblo.gs: a snappy moblog community - http://mblo.gs

---

When Google PR Tool Bar is Down!

Where is the need to worry? Who needs a PR... Read More

How To Measure Search Engine Marketing ROI

According to the Search Engine Marketing Professional Organization (SEMPO), advertisers... Read More

How To Make Your Website More Successful? (Part II)

In part I of our series of how to make... Read More

The Myth of Rankings - Beyond Search Engine Optimization

What follows is a condensed version of a conversation that... Read More

Submitting to the Search Engines and WebCrawlers

When you want your brand new site to be indexed... Read More

Search Engine Saturation Tool ? A Must Have SEO Tool

Search Engines have become the soul of the Internet. They... Read More

Ten Steps To A Well Optimized Website - Step 1: Keyword Selection

This is part one of ten in this search engine... Read More

Submit All Of Your Pages And Watch Your Traffic Grow

Everyone is looking for "secrets" about how to get more... Read More

SEO #4: Off-page Optimization

Yesterday you should have read the third course out of... Read More

THREE Secrets to High Search Engine Rankings the Easy Way!

Let me guess, you've read article after article on how... Read More

Search Engine Optimization: What Is It?

Search Engine Optimization is the creation of a web page,... Read More

Everything You Wanted To Know About Google -- But Were Afraid To Search For!

(A Reflective look at the little search engine that soared!)All... Read More

Complete Web-Site Optimization For Search Engines (Part 1)

SEO or search engine optimization strategy now becomes widely popular... Read More

Does The Number Of Links On A Page Affect Ranking?

Lots of research has focused on inbound links to a... Read More

The Best 7 Steps To Get A Top Google Ranking Guaranteed

Google returns more search results then any other search engine.... Read More

Playing in Googlebots Sandbox with Slurp, Teoma, & MSNbot - Spiders Display Differing Personalities

There has been endless webmaster speculation and worry about the... Read More

A Simple 4 Step Approach To Have Google Crawl Your Site Today Guaranteed!

Extra, Extra Google Now Gives you feedback. By Creating a... Read More

Search Engine Optimization, Positioning: Is Chasing Google Algorithms Worth It?

Google is the undisputed heavyweight champion of search engines. Most... Read More

Your Online Home-Based Business Can Lead To Search Engine Stress

As a member of several search engine optimization forums, I... Read More

Every Search Engine Robot Needs Validation

Your website is ready. Your content is in place, you... Read More

Determining the Value of Your SEO Service

Every once in a while--and probably more often than we... Read More

Search Engine Robots - How They Work, What They Do (Part II)

If your site isn't found in the search engines, it... Read More

All You Need to Know About Your Website Traffic is Contained in 5 Key Stats

You built that content rich web page optimized for your... Read More

Meta Tag Tactics - Give Your Website Traffic a Boost with the Meta Tag Basics

Getting your site noticed by the search engines and rewarded... Read More

Goofy Mistakes that Hurt Your Search Engine Rankings

One thing is for sure, you don't want to spend... Read More

SEO - Get Your Site Out of the Google Sandbox Fast!

Is your new site sitting in the infamous Google "sandbox"?... Read More

Get Better Search Engine Rankings with RSS

RSS is the latest craze in online publishing. But what... Read More

Optimze Your Web Site on a Shoe String Budget

Let me start off by saying I'm not a marketing... Read More

Optimizing For Visitors Not Search Engines

Most people feel that optimizing is to target the search... Read More

What Did We Learn from the Great Search Engine Experiment!

Last Week I did a Search engine Experiment. I wanted... Read More

Why SEO Will Make or Break You, Part 1

Today's article is about the wonders of SEO. SEO is... Read More

SEO Expert Guide - Proposition Development (part 2/10)

It is literally amazing how many people start their online... Read More

Basic Search Engine Promotion

I can't tell you how many times people have asked... Read More