Skip to content

feat: Adds edge centered payload and embedding structure during ingestion (cognify) (WIP) #1853

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Draft
hajdul88 wants to merge 82 commits into
base: dev
Choose a base branch
from
Draft

feat: Adds edge centered payload and embedding structure during ingestion (cognify) (WIP) #1853

hajdul88 wants to merge 82 commits into from

Conversation

@hajdul88
Copy link
Collaborator

@hajdul88 hajdul88 commented Dec 1, 2025

Description

Type of Change

  • Bug fix (non-breaking change that fixes an issue)
  • New feature (non-breaking change that adds functionality)
  • Breaking change (fix or feature that would cause existing functionality to change)
  • Documentation update
  • Code refactoring
  • Performance improvement
  • Other (please specify):

Screenshots/Videos (if applicable)

Pre-submission Checklist

  • I have tested my changes thoroughly before submitting this PR
  • This PR contains minimal changes necessary to address the issue/feature
  • My code follows the project's coding standards and style guidelines
  • I have added tests that prove my fix is effective or that my feature works
  • I have added necessary documentation (if applicable)
  • All new and existing tests pass
  • I have searched existing PRs to ensure this change hasn't been submitted already
  • I have linked any relevant issues in the description
  • My commits have clear and descriptive messages

DCO Affirmation

I affirm that all code in every commit of this pull request conforms to the terms of the Topoteretes Developer Certificate of Origin.

@hajdul88
feat: adds triplet datapoint
001e539
@hajdul88
feat: adds get triplet batches adapter level method
1e3c304
@hajdul88
feat: adds initial get_triplet_datapoints
e6b6e82
@hajdul88
feat: adds first version of get_triplet_datapoints task
0b393a7
@hajdul88
ruff format
a512e1d
@hajdul88
Update get_triplet_datapoints.py
01921d6
@hajdul88
Update get_triplet_datapoints.py
df88fac
@hajdul88
Merge branch 'dev' into feature/cog-3326-2triplet-embedding-via-memify
de4aa73
@hajdul88
feat: adds logging to get_triplet_datapoints
855eb1f
@hajdul88
ruff
acc370c
@hajdul88
removes indexing from get_triplet datapoints
64f81a5
@hajdul88
feat: introduces memify wrapping
207fe58
@hajdul88
fix: fixes batching and pipeline yielding logic
717cc69
@hajdul88
ruff format
2472174
@hajdul88
fix: fixing user issue with new memify pipeline
72f4533
@hajdul88
uc and poetry fix for lancedb
b7cd326
@hajdul88
Revert "uc and poetry fix for lancedb"
09ad8ea 
This reverts commit b7cd326.
@hajdul88
fix: fixes logging
565ed40
@hajdul88
fix: fixes embedded text by adding separators
36162f5
@hajdul88
feat: adds triplet completion to search types
8cc7530
@hajdul88
feat: adds triplet retriever and connects it to search type tools
16e9e76
@hajdul88
ruff fix
2a447e0
@hajdul88
fix: lancedb fix in order to be able to run CI (TO REVERT)
232c761
@hajdul88
fix: fixes no triplet embedding error (thats why you should never cop…
77dd332 
…y paste)
@hajdul88
feat: adds memify triplet embedding example
1ecbcff
@hajdul88
feat: adds get_triplet_datapoints unit test
5e8b53f
@hajdul88
feat: adds integration test for get_triplet_datapoints
dcf43be
@hajdul88
ruff format
4d062df
@hajdul88
Update test_get_triplet_datapoints.py
c00814b
@hajdul88
Update test_get_triplet_datapoints.py
df7018e
Base automatically changed from feature/cog-3326-2triplet-embedding-via-memify to dev December 2, 2025 17:27
hajdul88 added 24 commits December 4, 2025 13:57
@hajdul88
feat: adds centralized custom edge handling and changes triplet skip …
1f3ebc7 
…logic
@hajdul88
ruff format
77f8039
@hajdul88
chore: cleaning up add datapoints
f15398e
@hajdul88
Update test_cognee_server_start.py
f4d63a4
@hajdul88
Revert "Update test_cognee_server_start.py"
b21b804 
This reverts commit f4d63a4.
@hajdul88
test: removes custom edge addition
c2c689d
@hajdul88
removes stdout and std err pipe
54ab706
@hajdul88
Revert "test: removes custom edge addition"
6e3f716 
This reverts commit c2c689d.
@hajdul88
debug: adds logging
efb8a04
@hajdul88
Update add_data_points.py
9545994
@hajdul88
Update add_data_points.py
83bb5ad
@hajdul88
Update add_data_points.py
09de312
@hajdul88
changes back integrate chunk graphs to original
56911bf
@hajdul88
fix: changes concatenation order in add datapoints due to ontology edges
c7c674f
@hajdul88
chore: deletes custom edge addition in integrate chunk graphs
847fc8c
@hajdul88
fixes custom edges statement
684f710
@hajdul88
extends custom edges only if they exist
85d40e3
@hajdul88
chore: empty list handling
9f28a11
@hajdul88
chore: adds relationship_name needed to edge embedding option
2c3d844
@hajdul88
Merge branch 'dev' into feature/cog-3327-3edge-centered-payload-and-e…
3aab11f 
…mbedding-structure-during
@hajdul88
feat: adds edge centered payload e2e tests for ontology and non-ontol…
710ab86 
…ogy use cases
@hajdul88
Merge branch 'dev' into feature/cog-3327-3edge-centered-payload-and-e…
8673ba8 
…mbedding-structure-during
@hajdul88
chore: updates edge centered payload e2e test
873e0a0
@hajdul88
feat: adds deduplication to Triplet datapoint creation
801fcb5
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

@hajdul88 hajdul88

Labels

core-team

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

2 participants

@hajdul88