User-agent: * Disallow: /api Disallow: /admin Disallow: /auth Disallow: /app Disallow: /*/api Disallow: /*/admin Disallow: /*/auth Disallow: /*/app