Home
Guide
Tools List
News
Search
About Us



SearchTools.com

Testing Search Indexing Robots : URL Directory Depth


This section is testing how many directory entries in a URL the robot indexing spider will accept. Some systems put a limit on this because there are rogue servers which can snarl the robot in a never-ending loop of links that just get longer and longer. We have twenty levels of depth in this test, which should let us know which spiders can go very deep in the sites, and which draw back.

For more information on the test suite, see the Search Indexing Test List.

Numbered Test - a convenient test with level numbers in the directory name

Same-Name Test - another test using the same name ("depth") in all directory names, simulating a server problem


Home
Guide
Tools Listing
News
Search
About Us

SearchTools.com
Copyright © 1998-2003
Search Tools Consulting