SEO Consultant, and PPC Consultant
  • Subscribe

    • 1 RSS Feed Icon

  • Friend Me on Facebook

    Follow Me on Twitter

    How smart is your Theme?  How good is your support? Check out ThesisTheme for WordPress.

    Bluehost Web Hosting

    Email Marketing

    Go Daddy $7.49 .com Sale 125x125

    Click Here to Advertise



  • WWW.FLICKR.COM

  • Favorites

  • Contributing Authors

  • Friends


  • Download Your Competitor's Keywords

  • Meta

Finding Duplicate Content with Free Tools

6th July 2009

Checking for duplicate content is part of the process of analyzing a website. The most common types of duplicate content to look for is in Title tags, Meta descriptions, product descriptions, dynamic URLs, and Canonicalization.
Fighting off the multi-headed monster of duplicate content
Many websites reuse the same Title tag for their entire site. That’s duplicate content.

Many ecommerce sites resell products from manufacturers will often use the product descriptions provided by the manufacturer. Hence, an abundance of duplicate content.

Top 6 Duplicate Content Mistakes:
1. Circular Navigation - multiple paths though a website.
2. Print-Friendly Pages - Fix: block search engine’s from printer friendly pages.
3. Inconsistent Linking
4. Product Only Pages - with nothing differentiating them from other pages.
5. Transparent Serving
6. Bad Cloaking

There are various ways to check for Duplicate Content. You can do a manual check, and/or use tools to check for dupe content. There are a ton of fee-based SEO tools out there that bundle a duplicate content tool into their suite of tools. However for this post, I’m just going to stick with just the free tools.

Free Tools

Copyscape will check to see if any other site contains the same text as your page. This is great to see all the other ecommerce sites that have the same product description.

Yahoo Explorer is a great free tool to find duplicate content. Make sure you see the results for Pages. Then, Export results to TSV. Open in Excel.

The spreadsheet will contain the TITLE tag, URL, SIZE, and FORMAT. Sort the data by descending or ascending for the Title tag. This will enable you to quickly scan the document for batches of duplicate content.

Xenu Link Sleuth is a popular free tool. This is an application download. Besides providing the same data as Yahoo Explorer, the Xenu Link Sleuth can detect broken links. Then, export to Excel. Sort data as needed.

Google Webmaster Tools. Go to Diagnostics, HTML suggestions, Duplicate title tags - next screen is a list, with a hyperlink to “Download this table”.

Additional Reading:
How to find your website Duplicate Content Issues
How to Remedy Duplicate Content
Google Dupe Content
Site Explorer is a First Step
Duplicate Content Issues

Photo credit: kajojak

Share and Enjoy:
  • StumbleUpon
  • Sphinn
  • del.icio.us
  • Reddit
  • Facebook
  • Propeller
  • TwitThis

Related posts:

  1. How Much Work Should You Giveaway in a SEO Proposal
  2. 10 Tactics for Video Optimization
  3. Making jQuery SEO Friendly

4 Responses to “Finding Duplicate Content with Free Tools”

  1. Jenny Stradling Says:

    I always use CopyScape, but here`s an interesting little factoid for you. One client of mine has a e commerce website with multiple product pages. At one point all of his pages were ranking well (both PR and in the SERPs) except for one page. We couldn`t figure it out! I ran the page through CopyScape and it came back with dup content. I asked him to rewrite the content, explaining it was the reason for the penalty. He explained to me that the content came directly from the product manufacturer and it was a requirement to include in order to sell the product. Long story short, he had to contact the manufacturer to request to use unique content, but as soon as he changes it, tah dah! The page was ranking within weeks. Something to keep in mind with reseller clients! My client never even thought twice about the manufacturer`s product description reading as dup content for the search engines!

  2. Sarah Says:

    I prefer to use PlagiarismDetect when checking plagiarism.

  3. billyberue Says:

    I am very careful about duplicate content. Quite interesting about the commerce store above. Wouldn’t that be indicative of most e-commerce sites then…meaning the description of the products?

  4. SEO Link Company Says:

    I really watch out on creating a tag, I sometimes tend to forget that I already used them, or duplicate content. i’m careful now.

Leave a Reply

XHTML: You can use these tags: <a href="" title=""> <abbr title=""> <acronym title=""> <b> <blockquote cite=""> <cite> <code> <del datetime=""> <em> <i> <q cite=""> <strike> <strong>

Powered by WP Hashcash