A simple definition of Cloaking is: Delivering one version of a webpage to one visitor, and a different webpage version to another visitor.
If you’ve ever wondered about how to use cloaking for SEO, keep reading:
A cloaked webpage is really a CGI script which reads the IP address of any one requesting the webpage. Then, it compares the IP address of the entity requesting the webpage, to a list of IP addresses that belong to search engine spiders. If a match is found, then the requesting entity is identified as a search engine spider. If no match is found, then the entity requesting the webpage is identified as a human.
Then, the CGI script can selectively serve different content based on the identity of the requesting entity. If the requesting entity is human, it can serve the home page of the domain, or some other web page that is not highly optimized. If the requesting entity is a search engine spider, the CGI script can serve a highly optimized web page.
The objective of cloaking is that highly optimized web pages are served to search engine spiders, and humans get a different (more usable) web page… all from the same URL.
Cloaking is risky business. The search engines have publically stated that they frown on cloaking, and any websites they catch doing it can be penalized or banned from their index.
To minimize your risks, there are 3 strategies you can implement:
1. Use a different domain for your cloaked webpage than your primary website.
2. Maintain a current list of all the IP addresses for the search engine robots.
3. Try to keep your cloaked webpages out of the search engine cache.
Many search engines offer a cached copy of a webpage they have indexed. The cached copy defeats the purpose of cloaking by showing anyone the highly optimized version of your cloaked page. To prevent this from happening, make sure you use the ROBOTS NOARCHIVE meta tag on your optimized version of the cloaked pages and exlude any search engines that do not follow this convention.
Now, there is another caution to be aware of. Google has stated that any website using a ROBOTS NO ARCHIVE meta tag is suspect to be cloaking. So, if they ever throw out a net to catch everyone using this tag, you could be caught.
The question remains…should you do it? There is an ethical consideration, and a practical one.
Some people might think cloaking is sneaky and unethical. Those people claim that you are lying to the search engines about your website content in an effort to get better rankings you don’t deserve. And the people who argue that it is good claim that cloaked web pages are only providing relevant results to the search engines.
Finally, there is the issue of whether cloaking is practical for your business, or not. How much time is it going to take you to set up and maintain a cloaking system? Will it payoff? Will it make an ROI that make it worth all the costs of the software, programming, and new domain / hosting?
For a list of Spiders and Robots: IAB website