Skip to content

Add Korean machine learning research seed - #214

Merged
thunderpoot merged 1 commit into
commoncrawl:mainfrom
aogavrilov:agent/add-korean-research-seed
Jul 31, 2026
Merged

Add Korean machine learning research seed#214
thunderpoot merged 1 commit into
commoncrawl:mainfrom
aogavrilov:agent/add-korean-research-seed

Conversation

@aogavrilov

Copy link
Copy Markdown
Contributor

What

Add the maintained Korean-language academic research index at https://aogavrilov.com/ko/ to the Korean seed list.

Why

The same site already has merged Russian and Mandarin entries. This completes the corresponding Korean language seed coverage with a static, crawlable localization.

Impact

This makes the Korean localization eligible for the Web Languages seed process. It does not claim that a crawl or index inclusion has already occurred.

Checks

  • URL returns HTTP 200
  • HTML declares lang=ko and Content-Language: ko
  • robots.txt explicitly allows CCBot
  • code/extract_links.py smoke-test completed successfully
  • Diff is one line in living/korean.md

@aogavrilov
aogavrilov marked this pull request as ready for review July 31, 2026 21:12
Copilot AI review requested due to automatic review settings July 31, 2026 21:12

Copilot AI left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Copilot was unable to review this pull request because the user who requested the review has reached their quota limit.

@thunderpoot thunderpoot left a comment

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thank you!

@thunderpoot
thunderpoot merged commit 59ee9a1 into commoncrawl:main Jul 31, 2026
1 check passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants