Googlebot Wont Go Home

I have 'Googlebot' crawl my site every day like a dispossessed spirit that can't leave.

It was not always like this, I would go for a month or more before he came to my site and then would only crawl a few pages and leave again.

This has been going on now for two months or more, I've been watching the stats on my server everyday seeing just where he goes. He will crawl a few pages one day, and the next some other pages, and then finally leave until the morrow. After just three or four weeks, I noticed I got an infestation of lesser bots calling as well, some I have never heard of before, they seem to follow 'Googlebot' as though he is the Pied Piper of Hamelin.

What caused this infestation of bots?

Well, I got interested in rss feeds, I thought "What a good tool for drawing traffic to my site."

So I studied up on rss feeds until I understood what was involved. Now I am no 'techie', and the most programming I do is html in 'Notepad', making my own web pages.

Rss feeds use a similar language called xml, so it was easy to understand for me, and I was able to quickly make up an rss feed page in 'Notepad', placed it on my server, downloaded a 'feed reader' software, opened it up, placed the address of my feed in the 'feed reader', and up came my rss feed in the reader. It was so easy I wrote an ebook to tell everyone how to do it, it's called "Really Simple RSS".

There are many rss directories and syndication services that I submitted the address of my rss feed to, so other people can look at the feed in their 'feed reader' and see what articles I am posting.

Some of the 'subscribers' to the feed actually come and visit my site to see what it's all about, which happened almost straight away after I submitted my feed.

In less than 36 hours, 'Googlebot' found my feed!

In a little over two days later Yahoo's 'Slurp' bot found my feed, and from there on they have both been crawling my site with the lesser bots every single day.

They crawl everything, they crawl all my pdf ebooks, they look at a few pages in 'Webmasters Corner', they even look at my 'Bonus Reports', and even descend the staircase into my 'Secret Vault'!

When will they go home and stop prying into my little secrets?

I know I encourage them like leaving cheese for a mouse, by putting more pdf files, software and ebooks on my site every day, so I suppose the poor bots can't ever keep up!

I found out that like mice like cheese, that 'Googlebot' likes my pdf files, he has been fitted with digital spectacles so he is now able to actually read keyword rich pdf files all the way through to the end! So he likes pdf files.

So I have obliged him!

I put 85 pdf files up on my server one night just to keep him happily reading! I have put many more up on the server since, and will continue to create more pdf files of classic authors for free download, just to keep him calling with his 'friends'.

Isn't this a laugh?

It's like taking in a stray dog, feeding him, housing him, and the dog loosing the ability to wander off again and finding you have got a lodger for life.

My site's ranking has risen considerably both in Yahoo and Google, but for some reason that escapes me for the time being, my ranking rose more quickly in Yahoo and they rank it much higher than Google. I may well find the reason for this before long and put it in another article.

So if you are a web site owner struggling to get noticed by the web bots, don't put it off much longer, put up an rss feed with articles about your products or service and not only will 'Googlebot' call with his 'friends', but actual live people will call too.

About The Author

Tony Dean runs a web site selling ebooks and software at:- http://www.ebook-sales.com

Subscribe to his ezine just send a blank email to:- ebook-sales@aweber.com

---

3 Deadly Search Engine Marketing Sins

My inbox this week provided glaring examples of three all... Read More

Its All in the Title

Unfortunately, we don't live in a perfect world. You may... Read More

Keyword Targeting Strategy In Your Site

Once the keywords have been decided for the site one... Read More

The Smart Way To Get Listed On Google!

So you want to get listed on Google? And you... Read More

Google Rankings ? Achieving a Top 10 Position in Google ? Part 2

Achieving a top ranking position in Google is every webmasters... Read More

Googles Back Door... Get Your Website Indexed Quicker!

It's the buzz word's going across the internet marketing guru's... Read More

Using Blogs for SEO

Why Start A Blog?I knew about blogging and blogs for... Read More

Keyword Popularity Check

Before using keywords for your site, it is always better... Read More

Designing a Better System for Search Engines

Designing a Better System for Search Engines and Information Distribution,... Read More

Do It Yourself SEO

Internet surfers use search engines more than any other tool... Read More

Google, Adsense, SEO, and How It All Works

Google uses an algorithm to determine the search engine results... Read More

Straight Talk on Search Engine Optimization

To get your website listed well in the major search... Read More

Why is Search Engine Optimisation Expensive?

Many of our customers (http://www.internet-marketing-australia.com) find search engine... Read More

Boost Your Website Rankings with Expert Content

The chase for a high web ranking is constantly on... Read More

Are Your SEO Efforts Going To Waste?

Search engine optimization (SEO) is a long and complicated process... Read More

An SEO Checklist

Search engine optimization is on every webmaster's mind these days.... Read More

Over Optimization and the OOP - Does a Penalty Exist?

If you have questions about whether or not the Over-Optimization... Read More

Optimize Your Site Pt2

6: The hidden benefits to having the right links. Every... Read More

The Myth of Search Engine Submission

Contrary to what most people think, it is not necessary... Read More

What is PageRank?

Chances are you have been on the Internet and have... Read More

Internet Marketing and SEO

Have you ever seen any email offers of getting you... Read More

Getting Honest With The Search Engines

Getting Honest With The Search EnginesI spend a lot of... Read More

Website Ranking With an Internet Marketing Specialist

On the internet, competition is stronger than ever. There was... Read More

The Search Doesnt End at Your Homepage

In a recent report for a new client, I wrote:... Read More

How My Page Rank Went From 0 to 5 In One Update - How Yours Can Too

Increase Your Google Page Rank!Page Rank. We all know what... Read More

Writing Search Engine Friendly Webpages

In order to tap the huge stream of targeted traffic... Read More

Speed Indexing - 3 Steps to Getting Your Website Listed in Google Quickly

Getting your website listed in Google quickly simply requires that... Read More

How To Get Your Web Site Banned ? or Search Engine Promotion, How Not to do it!

Search engines constantly strive to advance their technology and algorithms... Read More

Duplicate the Exact Steps Used to Get a Number 1 Yahoo Ranking in Less than 30 Days

If you have ever been into a McDonalds you will... Read More

Five FAQ About Google PageRank

Five FAQ about Google PageRank1. What is PageRank and why... Read More

10 Ways to Make Sure Your SEO Goes Out of Its Way for You

If they want to have success, companies should do everything... Read More

Great Site Ranking in Google The Secrets Out

How many years did you register your domain name for?... Read More

.com Not Listed in Regional Yahoo? Don?t Despair!

If you're a non-American business with a .com web address,... Read More