EIP Search Indexing: keeping current

• Update constantly for newest data

• OS notification of file system changes

• Database triggering of index on change

• Robots

• Check server modification accuracy - some lie!

• Robots use Conditional Get (If-Modified-Since)

• Dublin Core DC.date.modified tag, very useful

• Try to index frequent changes first

• Use mirrors if the search engine can't update while searchable

Start | Prev | Next

Internet Librarian 2001
November 8, Pasadena, CA

Avi Rappoport, Search Tools Consulting
www.searchtools.com