Skip to content

Latest commit

 

History

History
9 lines (5 loc) · 469 Bytes

README.md

File metadata and controls

9 lines (5 loc) · 469 Bytes

content-extractor

Extract article content from given URL

This project is hosted on a free Heroku dyno and you can test it for free: https://contentextractor.yan.dev.br/

It supports javascript rendered website using Chrome and Selenium, but most websites can be crawled using requests.

It is built to get information from articles with at least 1 heading and 2 paragraphs. This application will not work if you're trying to crawl an ecommerce or a social network.