User-agent: * Disallow: /api/ Disallow: /admin/ Disallow: /media/ Disallow: /cron/ Disallow: /scripts/ Disallow: /*rss/$ Disallow: /sign-up Disallow: /sign-in Disallow: /sign-out Disallow: /submit Disallow: /settings Disallow: /search