Pages typically prevented from being crawled include login-specific pages such as shopping carts and user-specific content such as search results from internal searches. In March 2007, De zoekmachines warned webmasters that they should prevent indexing ofwel internal search results because those pag