We added some settings that give you more control over the HTTP-header and HTML parser of our crawler. The new settings can be used to fine tune how our robot handles robots-directives. This can be used to simulate how your site would look with different robots-directives. The feature was developed for ottogroup and it is used to test and optimize a new project before it's going live.
As you might know you can use "Shares" to let other users view your crawls or mange your account. As of today you can additionally grant others the right to create orders and change the payment information of an account.
When we started with Audisto we wanted to make it as easy as possible to start and also stop using the service. To make this even more convenient, we now added subscriptions. If you want to subscribe you can do that as part of your next order. You always can cancel a subscription at any time by editing your account.
With a growing number of crawls we decided to do some big changes to improve our infrastructure. Some weeks ago we started syncing all completed crawls to multiple servers. This results in a better reliability of the service, faster crawls and a better performance of crawl reports.
Some of you asked us to send out more notification mails as a reminder to use the service more often. So from now on we send out reminders 7 days after your last crawl. We totally agree that some of you could and should use Audisto much more often and our infrastructure is ready for your new crawls! ;-)