heimawz / gpt2-mini Goto Github PK
View Code? Open in Web Editor NEWThis repository primarily aims to replicate GPT-2, including multi-head self-attention mechanisms, attention masking, data preprocessing, and inference. Ultimately, it achieves the effect of text generation