Development Update 6

Sometimes you want your site to be blocked from being crawled or indexed by search engines - this can now be specified for the robots meta tag and robots http header checks. No more getting notifications for something that is actually the way you want it to be!