Design A Spider Friendly Site

To be successful in the search engines it's important to design your web site with the spiders in mind. Using the latest in web page design is not generally the best way to go. Spiders don't view web pages like humans do, they must read the HTML in the page to see what it's about. Below you will find tips on how to best design your web site with search engines in mind.

Do not use frames at all. Some search engines cannot spider web pages with frames at all. For the other search engines that can, they can have problems spidering it and sometimes they too can't index the web page. Do not only use image's to link out. You should always use text links to link out to important content on your web site. Spiders can follow image links, but like text links more though.

Use external JavaScript files instead of using Java Script code in the HTML document, using Java Script in the HTML document will make the page size much larger. Using an external Java Script file to do the job will reduce page size and make it easier for both spiders and browsers to download the page. Using Cascading Style Sheets can reduce page size and making the download time much faster in most cases. It will allow the spider to index your web page faster and can help your ranking.

Avoid using web page creators such as FrontPage, Dreamweaver or a WYSIWYG editor. Software such as that will often times add scripting code that is not needed, making the page larger than it needed to be and making it harder to crawl. It will also add code that can't be read by the search engines, causing the spider not to index the page or not index the whole web page. It is better to use standard HTML. Adding code that they can't read or have a hard time to read can lead to major problems with your ranking.

Try not to use Flash when possible. Flash cannot be read by the search engines to date and will cause download time to slow a bit. If you do decide to use Flash anyway, make sure you add text to the web page, so the search engines have something to read and find out what your web page is about. It will also allow your visitors to have something to read while the Flash file loads. Also don't use Flash as a way of navigation, as I said before spiders cannot read Flash.

It's important to add a site map to your web site. Not only will this make it easier for internet surfers to get around your web site, but it will also allow spiders to find your site's content easier and index your web page sooner. The site map should contain text links and not image links.

I highly suggest that you look at your web page with a Lynx browser because this is similar to how search engines will view your web page. There are other tools on the internet that will allow you to view your web page without a Lynx browser, but see a web page just like it, so you may want to check those out as well.

Matt Colyer is the owner of Superior Webmaster. He also is a php, CGI, and ASP developer.

In The News:


pen paper and inkwell


cat break through


How To Get Number 1 Spot In Google, Every Time, Guaranteed

Woaah! Wait a minute. Before I exclusively reveal these insider... Read More

New Free Online Tool for Keyword Research

I came across a new website the other day and... Read More

Search Engine Spiders Lost Without Guidance - Post This Sign!

The robots.txt file is an exclusion standard required by all... Read More

The Top 3 Mistakes That Can Ruin Your Websites Search Engine Rankings- and How to Fix Them!

Getting your website up and running is hard enough. After... Read More

Submitting Your Site to Search Engines and Directories

Regardless of which type of business you currently have, you... Read More

Increase Your Link Popularity for Free

Among the many things you need to worry about for... Read More

Search Engine Optimization: What Is It?

Search Engine Optimization is the creation of a web page,... Read More

The Search Doesnt End at Your Homepage

In a recent report for a new client, I wrote:... Read More

You Cannot Hide From the Public Record Search Engines

As a search engine optimization specialist, I often run across... Read More

How To Find Good Keywords

Good keywords are frequently searched for (high demand) but not... Read More

Cracking the Google Code: Under the GoogleScope

Google's sweeping changes confirm the search giant has launched a... Read More

Submit Your Website to Search Engines

Some search engine submissions are free and some pay for... Read More

Companies Cash In on Your Search Engine Ignorance

This article will cause many companies to stir, but it's... Read More

No Cost Search Engine Marketing

As a matter of fact, I recommend NOT wasting money... Read More

Five Simple Steps to Getting Links to Your Site

Today if you want your site to survive in the... Read More

The 3 Essential Components of a Search Engine Optimization Campaign

Everyday, the Search Engines average 300 MILLION searches. In a... Read More

Here Today Gone Tomorrow

Its a matter of here today, gone tomorrow at the... Read More

The Secret To Getting Indexed In Yahoo

Getting indexed in Yahoo has become very difficult in the... Read More

Google Loosing Fan Base?

"Nothing last forever but the Earth and sky." - from... Read More

Search Engine Success & The Google-Vision Secret

Want to know the secret to great search engine listings?... Read More

Internet Directory Submission Tips

Internet Directories and their ImportanceThere are two very pertinent reason... Read More

The Importance of Search Engine Optimization

Search Engine Optimization is a key to any successful internet... Read More

Effective Keyword Optimization and Analysis Techniques

Keyword optimization involves vital keyword selection and placement strategy depends... Read More

Get More Cosmetic Surgery Patients From The Web

It's no surprise that dominant cosmetic surgery practices also have... Read More

Onpage Optimization: Essential for Effective Offpage Optimization

Onpage optimization is the process by which various elements on... Read More

What To Look For When Shopping For A SEO Specialist

When, shopping for a Search Engine Optimization (SEO) company/specialist you... Read More

3.5 Tips To Help You Avoid Becoming The Next Search Engine Outlaw

Tip 1 - Hide And SeekDo not use hidden text... Read More

SEO Training - Avoid Making this Costly Mistake!

SEO training can be overwhelming. There are literally hundreds of... Read More

The 7 Points of Do-It-Yourself SEO

Ever felt intimidated at the convoluted, jargon-ridden information about Internet... Read More

The 7 Best Stealth Techniques to Improve Your Google Rankings

Stealth as in Spying. But Knowing What your Top Competitors... Read More

Keyword Selection- The Dark Horse of Search Engines Optimization

Below are what I call the "10 Commandments" for Keywords.To... Read More

Do Not Ever Link to a Site Without Doing This First!

Links are a crucial part of attaining high search rankings,... Read More

Adding City Names At The End Of Your Keywords Can Bring You More Profits

In recent times, I have been closely studying keywords that... Read More