Changes in this version:

• workarounds for some bugs in HTML
• server caching by IP address

We published a report analyzing the impact of the COVID-19 pandemic on the .cz domain and its registry.

Version 1.4.2 of DNS crawler is out!

New features:

• added an option to save binary content if the webserver returns it for root (or redirects to it)
• added a max_ips_per_domain…

Version 1.4.1 of DNS crawler was published. The changes include better handling of CNAME records and workarounds for broken web pages.