User-agent: * Disallow: /pool/ Disallow: /dists/ Disallow: /data/ Disallow: /incoming/ Disallow: /conf/ Disallow: /db/ Allow: /setup.sh Allow: /public.key Allow: /robots.txt