Finding Duplicate Content with Free Tools
6th July 2009
|
Checking for duplicate content is part of the process of analyzing a website. The most common types of duplicate content to look for is in Title tags, Meta descriptions, product descriptions, dynamic URLs, and Canonicalization. Many ecommerce sites resell products from manufacturers will often use the product descriptions provided by the manufacturer. Hence, an abundance of duplicate content. Top 6 Duplicate Content Mistakes: There are various ways to check for Duplicate Content. You can do a manual check, and/or use tools to check for dupe content. There are a ton of fee-based SEO tools out there that bundle a duplicate content tool into their suite of tools. However for this post, I’m just going to stick with just the free tools. Free ToolsCopyscape will check to see if any other site contains the same text as your page. This is great to see all the other ecommerce sites that have the same product description. Yahoo Explorer is a great free tool to find duplicate content. Make sure you see the results for Pages. Then, Export results to TSV. Open in Excel. The spreadsheet will contain the TITLE tag, URL, SIZE, and FORMAT. Sort the data by descending or ascending for the Title tag. This will enable you to quickly scan the document for batches of duplicate content. Xenu Link Sleuth is a popular free tool. This is an application download. Besides providing the same data as Yahoo Explorer, the Xenu Link Sleuth can detect broken links. Then, export to Excel. Sort data as needed. Google Webmaster Tools. Go to Diagnostics, HTML suggestions, Duplicate title tags - next screen is a list, with a hyperlink to “Download this table”. Additional Reading: Photo credit: kajojak Related posts: |

















July 7th, 2009 at
I always use CopyScape, but here`s an interesting little factoid for you. One client of mine has a e commerce website with multiple product pages. At one point all of his pages were ranking well (both PR and in the SERPs) except for one page. We couldn`t figure it out! I ran the page through CopyScape and it came back with dup content. I asked him to rewrite the content, explaining it was the reason for the penalty. He explained to me that the content came directly from the product manufacturer and it was a requirement to include in order to sell the product. Long story short, he had to contact the manufacturer to request to use unique content, but as soon as he changes it, tah dah! The page was ranking within weeks. Something to keep in mind with reseller clients! My client never even thought twice about the manufacturer`s product description reading as dup content for the search engines!
September 4th, 2009 at
I prefer to use PlagiarismDetect when checking plagiarism.
September 6th, 2009 at
I am very careful about duplicate content. Quite interesting about the commerce store above. Wouldn’t that be indicative of most e-commerce sites then…meaning the description of the products?
December 16th, 2009 at
I really watch out on creating a tag, I sometimes tend to forget that I already used them, or duplicate content. i’m careful now.