User-agent: * Disallow: /cdn-cgi/ Disallow: /wp-admin* Disallow: /wp-includes* Allow: /wp-includes/js* Allow: /wp-admin/admin-ajax.php