User-agent: Yandex Disallow: /scripts/ #Disallow: / #User-agent: gsa-crawler #Allow: /news/ #User-agent: Googlebot #Allow: /news/ User-agent: AhrefsBot Crawl-Delay: 10 User-agent: * Disallow: /cgi-bin/ Disallow: /scripts/ Disallow: /webcal/ Disallow: /webDB/ Disallow: /search/ Disallow: /scripts/php_include/pdfconvert.php Disallow: /scripts/mrbs_flowcyto/ Disallow: /research/facilities/cal_2p/ Disallow: /research/facilities/cal_behavioral/ Disallow: /research/facilities/cal_cdbequip/ Disallow: /research/facilities/cal_centrifuge/ Disallow: /research/facilities/cal_chemidoc/ Disallow: /research/facilities/cal_cryostat/ Disallow: /research/facilities/cal_imagexpress/ Disallow: /research/facilities/cal_leica/ Disallow: /research/facilities/cal_licor/ Disallow: /research/facilities/cal_lsm510/ Disallow: /research/facilities/cal_lsm780/ Disallow: /research/facilities/cal_pcr/ Disallow: /research/facilities/cal_superres/ Disallow: /research/facilities/e-calendar/ Disallow: /gch/patients-families/memory-tree/ Disallow: /hr/intra/directory/ Disallow: /pdl/intra/register/ Disallow: /pathology/healthcare/orders.php Disallow: /roomcal/ Disallow: /clintrials/intra/ User-agent: swiftbot Disallow: /cgi-bin/ Disallow: /webcal/ Disallow: /webDB/ Disallow: /search/ Disallow: /intra/search/ Disallow: /scripts/php_include/pdfconvert.php Disallow: /scripts/mrbs_flowcyto/ Disallow: /research/facilities/cal_2p/ Disallow: /research/facilities/cal_behavioral/ Disallow: /research/facilities/cal_cdbequip/ Disallow: /research/facilities/cal_centrifuge/ Disallow: /research/facilities/cal_chemidoc/ Disallow: /research/facilities/cal_cryostat/ Disallow: /research/facilities/cal_imagexpress/ Disallow: /research/facilities/cal_leica/ Disallow: /research/facilities/cal_licor/ Disallow: /research/facilities/cal_lsm510/ Disallow: /research/facilities/cal_lsm780/ Disallow: /research/facilities/cal_pcr/ Disallow: /research/facilities/cal_superres/ Disallow: /research/facilities/e-calendar/ Disallow: /gch/patients-families/memory-tree/ Disallow: /pdl/intra/register/ Disallow: /pathology/healthcare/orders.php Disallow: /roomcal/ Disallow: /clintrials/intra/