User-agent: * Disallow: # allows searching of everything by every robot