DNS crawler 1.4.7
Changes in this version:
- workarounds for some bugs in HTML
- server caching by IP address
COVID-19 in the .cz domain
We published a report analyzing the impact of the COVID-19 pandemic on the .cz domain and its registry.
DNS crawler 1.4.2
Version 1.4.2 of DNS crawler is out!
New features:
- added an option to save binary content if the webserver returns it for root (or redirects to it)
- added a
max_ips_per_domain…
DNS crawler 1.4.1
Version 1.4.1 of DNS crawler was published. The changes include better handling of CNAME records and workarounds for broken web pages.