Skip to content

Add crawler for Hagezi blocklist and corresponding forward dns data - #245

Closed
romain-fontugne wants to merge 3 commits into
InternetHealthReport:mainfrom
romain-fontugne:main
Closed

romain-fontugne wants to merge 3 commits into
InternetHealthReport:mainfrom
romain-fontugne:main

Conversation

@romain-fontugne

Copy link
Copy Markdown
Member

This pull request adds Hagezi DNS blocklists, as resolved and published by IHR. Maybe the PR is a bit premature as we are just starting collecting this dataset but anyways it is ready.

Hagezi DNS Blocklists Integration:

  • Added a new crawler in iyp/crawlers/hagezi/blocklists_forward_dns.py to fetch, parse, and import Hagezi DNS blocklists and their DNS resolution results.
  • Added corresponding readme iyp/crawlers/hagezi/README.md
  • Updated documentation/data-sources.md to include Hagezi as a new data source with details and links.
  • Added an entry for the new crawler in config.json.example so it can be enabled and configured.
  • Updated ACKNOWLEDGMENTS.md

How Has This Been Tested?

Locally tested on an old snapshot of IYP.

Types of changes

  • Bug fix (non-breaking change which fixes an issue)
  • New feature (non-breaking change which adds functionality)
  • Breaking change (fix or feature that would cause existing functionality to change)

Checklist:

  • My code follows the code style of this project.
  • My change requires a change to the documentation.
  • I have updated the documentation accordingly.

@m-appel

m-appel commented Sep 22, 2026

Copy link
Copy Markdown
Member

Merged in ffead13.

@m-appel m-appel closed this Sep 22, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants