user-agent: * disallow: /cgi-bin/ disallow: /profiles/ disallow: /software/ disallow: /*.pdf$