v0.4.11

[D4Vinci]

A solid update bringing the first platform spider template, a faster parser, and important fixes 🎉

Note

Follow us on X for daily tips and tricks

🚀 New Stuff and quality of life changes

• Added ShopifySpider, the first platform spider template! Extract every product from any Shopify-powered store through its JSON API without touching the website's HTML. Subclass it, set the store's domain, and you are done (Check the docs)

  from scrapling.spiders import ShopifySpider
  
  class MyStore(ShopifySpider):
      target_website = "example.com"
  
  result = MyStore().start()

• Added --executable-path to the CLI browser commands. Both scrapling extract fetch and scrapling extract stealthy-fetch now accept a custom Chromium-compatible browser executable, and fall back to the SCRAPLING_EXECUTABLE_PATH environment variable when the option isn't passed, bringing full parity with the MCP server (Solves #371)

  scrapling extract fetch "https://example.com" page.html --executable-path "/path/to/chromium"

🤖 Quality of life changes

• Made find_by_text and find_by_regex up to ~2x faster when first_match is enabled (the default) by wrapping elements lazily so the search stops at the first match, by @yetval in #370
• Updated the benchmarks with the new numbers against the latest versions of all libraries.
• Updated contribution rules

🐛 Bug Fixes

• Fixed the MCP server's fetch tools crashing on pages containing control characters with the error All strings must be XML compatible, by @yetval in #368 (Fixes #366)

🙏 Special thanks to the community for all the continuous testing and feedback

---

Big shoutout to our Platinum Sponsors: