Issues

• Add a method to generate records for Unit tests based on real data

  commoncrawl/nutch#49 · Filter by author lfoppiano opened on Mar 1, 2026

• WARC writer: review deduplication

  commoncrawl/nutch#47 · Filter by author sebastian-nagel opened on Feb 26, 2026

• Evaluate performance of Amazon Corretto Crypto Provider

  commoncrawl/nutch#23 · Filter by author tfmorris opened on Jul 15, 2023

• Evaluate zlib-cloudflare for 15% performance speedup of WarcRecordWriter

  commoncrawl/nutch#22 · Filter by author tfmorris opened on Jul 14, 2023
  4

• WARC writer: unit tests for conversion of URLs to URIs

  enhancement
  commoncrawl/nutch#21 · Filter by author sebastian-nagel opened on Jul 12, 2023

• Improvements in Hadoop's s3a output committers obsolete class S3FileOutputFormat

  commoncrawl/nutch#16 · Filter by author sebastian-nagel opened on Nov 22, 2019
  1

• More detailed marking of truncated records due to "network disconnect"

  enhancement
  commoncrawl/nutch#13 · Filter by author sebastian-nagel opened on Aug 30, 2019

• WarcRecordWriter to write and index WAT/WET files

  enhancementhelp wanted
  commoncrawl/nutch#9 · Filter by author sebastian-nagel opened on Jul 4, 2019