Skip to content

Add Norconex Crawler to Web Crawling - #1313

Open
essiembre wants to merge 1 commit into
akullpp:mainfrom
essiembre:add-norconex-crawler
Open

Add Norconex Crawler to Web Crawling#1313
essiembre wants to merge 1 commit into
akullpp:mainfrom
essiembre:add-norconex-crawler

Conversation

@essiembre

@essiembre essiembre commented Sep 2, 2026

Copy link
Copy Markdown

Norconex Crawler is an open-source, modular web and file-system crawler for Java, with official Docker images and a browser-based visual configurator for building crawl configurations.

Suggestion type

  • Project
  • Resource

Checklist

  • I searched the list and existing issues for duplicates.
  • I changed README_SOURCE.md, not the generated README.md.
  • This pull request contains one suggestion.
  • The suggestion is relevant to Java or the JVM and fits its chosen category.
  • I used the canonical project or resource link.
  • The suggestion is current and maintained.
  • The concise, neutral description explains its distinguishing value and ends with punctuation.
  • Licensing is clear and any restrictive terms are disclosed where applicable.

Summary by cubic

Adds Norconex Crawler to the Web Crawling section of README_SOURCE.md as a new project suggestion.

Written for commit 8674da6. Summary will update on new commits.

Review in cubic

Signed-off-by: Pascal Essiembre <pascal.essiembre@gmail.com>
Copilot AI lite review requested due to automatic review settings September 2, 2026 01:39

Copilot AI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🟢 Approval recommended

The change is a single well-formed README_SOURCE entry that matches the section’s formatting and scope.

Pull request overview

Adds Norconex Crawler as a new project entry under the “Web Crawling” section in README_SOURCE.md, expanding the curated list of JVM web-crawling libraries/tools.

Changes:

  • Added a new bullet for Norconex Crawler with the canonical GitHub link.
  • Included a concise, neutral description highlighting modularity, Docker images, and the browser-based configurator.
File summaries
File Description
README_SOURCE.md Adds Norconex Crawler to the Web Crawling list with a short descriptive tagline.
Review details
  • Files reviewed: 1/1 changed files
  • Comments generated: 0
  • Review effort level: Lite

💡 Add a code-review agent skill or configure MCP servers for context-aware, tailored reviews. Learn more in the docs.

@cubic-dev-ai cubic-dev-ai Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

No issues found across 1 file

Re-trigger cubic

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants