Acquia crawl Drupal sites?

Today I discovered this gem in my OSSEC logs:

** Alert 1413960981.9519534: - web,accesslog,
2014 Oct 22 17:56:21 (gambit) 11.22.33.44->/var/log/nginx/access-example.com.log
Rule: 31101 (level 5) -> 'Web server 400 error code.'
Src IP: 192.99.9.164
192.99.9.164 - - [22/Oct/2014:17:56:43 +1100] "GET /core/CHANGELOG.txt HTTP/1.1" 403 564 "-" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_8_4) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/27.0.1453.110 Safari/537.36"

The IP 192.99.9.164 resolves to crawler.acquia.com (and vice versa).

I find the obviously-fake user-agent of Mac OS X pretty interesting.. and on an OVH server. Why not link to a crawler page explaining the purpose of this bot?

So I hit http://crawler.acquia.com and am redirected to https://crawler.acquia.com - which fails, because the SSL certificate is invalid.

I ignore the warning, and am redirected to a Google Apps https://accounts.google.com sign-in page.

Why?

Tags: