Setting up a robots.txt to Control Search Engine Spiders
Way back in the day, when I published my very first website, I never thought that I would ever need to know about setting up a robots.txt to control search engine spiders. As a new webmaster, you are only to happy to have the search engine spiders crawling and indexing your website. Today, all the websites I develop have a robots.txt in the root directory.
Read more about Setting up a robots.txt to Control Search Engine Spiders

In addition to the information contained in my article,
If you have done any reading on
It is imperative that the search engines index all of your webpages, so that they are aware of each pages content and are in a position to serve them in the search engines results pages. If you own one of the many websites where only certain pages have been discovered, then this Joomla SEO article will help you get the major search engines to index all of your webpages.
I am often asked the question,
Although Joomla does have some SEO tools included in the core application, they are turned off by default and even after these have been activated, the webpages are still not truely search engine ready, this is not the only issue though, there are other
In recent times
Over the years we have had numerous enquiries from webmasters and website administrators, asking