Skip to content

Performance: Batched / pipelined indexer writes and bulk upserts #798

Description

@joelpeace48-cell

Context

If the indexer writes one row per event, high-throughput ledgers will bottleneck on per-row writes.

Scope

  • Batch events into bulk upserts within a transaction; tune batch size.
  • Pipeline RPC fetch and DB write; measure events/sec.

Acceptance criteria

  • Indexer sustains target events/sec via batched writes without falling behind.

Verification

  • Replay a high-event range and assert throughput + no lag growth.

Metadata

Metadata

Assignees

No one assigned

    Labels

    area: backendBackend API (Node/Express)difficulty: mediumModerate complexityindexerOn-chain event indexingjavascriptPull requests that update javascript codeperformancePerf and scalability

    Type

    No type

    Fields

    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions