Skip to content

Update bpe.py - #153

Open
ydasgupt-123 wants to merge 1 commit into
karpathy:masterfrom
ydasgupt-123:patch-1
Open

Update bpe.py#153
ydasgupt-123 wants to merge 1 commit into
karpathy:masterfrom
ydasgupt-123:patch-1

Conversation

@ydasgupt-123

Copy link
Copy Markdown

Requesting an update from the repository: Adding Rotational Positional Encoders to improve the way the model will be able to respond to positions of words not just the embedding from the dict.

@letmestudy

letmestudy commented Jan 20, 2026 via email

Copy link
Copy Markdown

@ydasgupt-123

Copy link
Copy Markdown
Author

Adding a positional embedding class for taking the position of the word embeddings into consideration, not just the token_ids

@CYzhr

CYzhr commented Mar 17, 2026

Copy link
Copy Markdown

AI dev? Save 20-30% on LLM costs → paypal.com/paypalme/Cyzhr

@letmestudy

letmestudy commented Mar 17, 2026 via email

Copy link
Copy Markdown

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants