User-agent: * Disallow: /files/ Disallow: /files/* Disallow: /*.php$ Disallow: /check_proxy.php Disallow: /youtube_proxy_api.php Disallow: /download_proxies.php Disallow: /get_proxies.php Disallow: /assets/ Disallow: /api/ Disallow: /admin/ Disallow: /login/