Issues

• Tracking: 600 pages/min on one machine

  compscidr/ipfs_indexer#254 · Filter by author compscidr opened on Oct 13, 2026

• Skip duplicate content across mirrors

  compscidr/ipfs_indexer#253 · Filter by author compscidr opened on Oct 13, 2026

• OR (union) queries

  compscidr/ipfs_indexer#252 · Filter by author compscidr opened on Oct 13, 2026

• BM25 scoring

  compscidr/ipfs_indexer#251 · Filter by author compscidr opened on Oct 13, 2026

• Benchmark against Lucene/Tantivy with search-benchmark-game

  compscidr/ipfs_indexer#250 · Filter by author compscidr opened on Oct 13, 2026

• Takedowns must erase pages from segment files

  compscidr/ipfs_indexer#249 · Filter by author compscidr opened on Oct 13, 2026

• Top-K search with max-score pruning

  compscidr/ipfs_indexer#248 · Filter by author compscidr opened on Oct 13, 2026

• Segmented inverted index (our own LSM-style postings)

  compscidr/ipfs_indexer#247 · Filter by author compscidr opened on Oct 13, 2026

• Configurable crawl worker count

  compscidr/ipfs_indexer#246 · Filter by author compscidr opened on Oct 13, 2026

• Batch store writes through a single writer thread

  compscidr/ipfs_indexer#245 · Filter by author compscidr opened on Oct 13, 2026

• Store terms as integer ids in postings

  compscidr/ipfs_indexer#244 · Filter by author compscidr opened on Oct 13, 2026

• Cap memory: configurable in-memory budget, SQLite for the rest

  compscidr/ipfs_indexer#231 · Filter by author compscidr opened on Oct 13, 2026

• Discover content from the IPFS network, not just by following links

  compscidr/ipfs_indexer#213 · Filter by author compscidr opened on Oct 12, 2026

• enable multiple indexers which may or may not be online all the time.

  compscidr/ipfs_indexer#210 · Filter by author compscidr opened on Oct 11, 2026

• Keep track of locations within the documents of the terms as well.

  compscidr/ipfs_indexer#128 · Filter by author compscidr opened on Nov 11, 2024
  1

• Dependency Dashboard

  compscidr/ipfs_indexer#5 · Filter by author renovate opened on Oct 18, 2021