Local File System Indexers get data from designated folders

• simple, fast, easy to update

• can only index mounted server folders

• will index files, even if they are not linked

• not limited by server access controls

Robot Spider Indexers crawl from URLs

• can access multiple remote servers

• use server security

• get database and dynamic pages

• slower than local file indexing

• will miss unlinked files

• may have problems with complex URLs

  • image maps, frames & JavaScript

  • webwide search engine spiders have the same problems

  • improve links for Web Accessibility as well

Previous | Next | Contents