Skip to content

Add Norconex Crawler to Web Crawling #1313

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
essiembre wants to merge 1 commit into
base: main
Choose a base branch
from
Open

Add Norconex Crawler to Web Crawling #1313

Changes from all commits
Commits
Show all changes
1 commit
Select commit
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
1 change: 1 addition & 0 deletions README_SOURCE.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -1242,6 +1242,7 @@ _Libraries that analyze the content of websites._
- [Apache Nutch](https://github.com/apache/nutch) - Highly extensible, highly scalable web crawler for production environments.
- [crawlberg](https://github.com/xberg-io/crawlberg) - Crawls and scrapes websites through a Java binding with Markdown conversion and optional browser rendering.
- [jsoup](https://github.com/jhy/jsoup) - Scrapes, parses, manipulates and cleans HTML.
- [Norconex Crawler](https://github.com/Norconex/crawler) - Modular web and file-system crawler with official Docker images and a browser-based configurator.
- [StormCrawler](https://github.com/apache/stormcrawler) - SDK for building low-latency and scalable web crawlers.
- [webmagic](https://github.com/code4craft/webmagic) - Scalable crawler with downloading, url management, content extraction and persistent.

Expand Down
Loading