Home Projects crawlee-python
crawlee-python

crawlee-python

by apify · GitHub

Crawlee—A web scraping and browser automation library for Python to build reliable crawlers. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Parsel, BeautifulSoup, Playwright, and raw HTTP. Both

# apify# automation# beautifulsoup# crawler
View on GitHub
⭐ Stars
9.3k
🍴 Forks
777
🔥 Trending
+38 this week
📜 License
Apache-2.0
Commercial use OK
📅 Created
2024
🔄 Last commit
today
🏷️ Category
apify
💻 Language
You maintain this project?

Claim its page: indexed whatever its rank, translated into six languages, and enriched with what you write yourself.

Claim this page →
crawlee-python — GitHub preview card
📈 Star history
9.34k9.30k
2026-07-122026-07-21
📄 About

Crawlee—A web scraping and browser automation library for Python to build reliable crawlers. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Parsel, BeautifulSoup, Playwright, and raw HTTP. Both

Frequently asked questions

What is crawlee-python?

Crawlee—A web scraping and browser automation library for Python to build reliable crawlers. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Parsel, BeautifulSoup, Playwright, and raw HTTP. Both

Is crawlee-python open source?

crawlee-python is an open-source project. It is released under the Apache-2.0 license.

Is crawlee-python free?

Yes. crawlee-python is free and open source — you can use, modify and self-host it.

🏅 Maintainer of this project?
OpenSourceAI badge — crawlee-python

Add this live badge to your README — your GitHub stars and directory rank, refreshed daily.

[![OpenSourceAI](https://opensourceai.tech/badge.php?tool=apify-crawlee-python)](https://opensourceai.tech/project/apify-crawlee-python.html)
More badge options →
🧬 Shares DNA with🧬 View the DNA map →

Measured from GitHub topics shared by both projects, weighted by how rare each topic is.