Google is your friend, but sometimes their crawler can be a little bit aggressive consuming resources from your webservers (and sometimes even crashing it). With static sites or at least sites that are using a decent cache, this shouldn’t be
Google is your friend, but sometimes their crawler can be a little bit aggressive consuming resources from your webservers (and sometimes even crashing it). With static sites or at least sites that are using a decent cache, this shouldn’t be