Skip to content

Latest commit

 

History

History

TextClassifier

Folders and files

NameName
Last commit message
Last commit date

parent directory

..
 
 
 
 
 
 

README.md

TextClassifier

Char-level sentiment classification using a PreNormTransformerBlock.

Run

dotnet run --project examples/TextClassifier

Concepts

  • Embedding + PreNormTransformerBlock + mean pooling + Linear head
  • MultiHeadAttention with scaled dot-product attention
  • Loss.crossEntropy for multi-class classification
  • Inference on unseen words with Toro.noGrad