Earlier this week Google announced that Caffeine, its new web search indexing system, now provides search results for all Google search users. Google has been testing Caffeine with trial audiences since August 2009. Caffeine indexes hundreds of thousands of gigabytes daily by continuously crawling the web to process newly published content. This enables Google searches to return pages without delay after they are published to provide the most relevant results possible. A rapidly evolving indexing system will better support new search features like Google's recently launched Twitter search.
To learn more about how Caffeine indexes web content, read the Google blog here.