Google Drive

drive.google.com is 404 now.

has a proper robots.txt file!

drive.google.com/robots.txt

User-agent: *
Crawl-delay: 1
Allow: /$
Allow: /support/
Allow: /a/
Allow: /Doc
Allow: /View
Allow: /ViewDoc
Allow: /present/view
Allow: /present/embed
Allow: /Present
Allow: /TeamPresent
Allow: /EmbedSlideshow
Allow: /templates
Allow: /previewtemplate
Allow: /fileview
Allow: /gview
Disallow: /templateabuse
Disallow: /
 
Back