Skip to content

Batch writes#76

Open
arminsabouri wants to merge 2 commits intomasterfrom
batch-writes
Open

Batch writes#76
arminsabouri wants to merge 2 commits intomasterfrom
batch-writes

Conversation

@arminsabouri
Copy link
Copy Markdown
Collaborator

@arminsabouri arminsabouri commented Apr 27, 2026

Buffer index writes. Partially fixes #71 . There are some other copies I want to eliminate during serialization.

Base automatically changed from mmap-index-files to master April 29, 2026 14:51
@arminsabouri arminsabouri force-pushed the batch-writes branch 2 times, most recently from 111b95e to 2836726 Compare May 5, 2026 20:01
@arminsabouri arminsabouri marked this pull request as ready for review May 6, 2026 12:50
return Err(io::Error::new(io::ErrorKind::InvalidData, len_error));
}
let len = len_bytes / (N as u64);
file.seek(SeekFrom::End(0))?;
Copy link
Copy Markdown
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This might break when we do incremental index building

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Keep graph traversal indecies (tx_out_end / tx_in_end) in memory during build

1 participant