This section contains sets of duplicate and near-duplicate pages for testing. Some search engine indexers are more aggresive than others in deleting duplicates, even when the pages aren't actually exactly the same. Using the pages in this section will let us identify the indexers which catch true duplicates, and present partial duplicates.
This page tests to see whether a search engine can recognize that a directory URL <http://www.domain.com/foo/> is the same as an index file in that directory <http://www.domain.com/foo/index.html>. To test this, search for the code below.
Search Code: RTest, RTest180, RTestGood, RTestGood180
For more tests, see the Duplicate Detection Tests and the List of Search Indexing and Robot Tests.