andy20071846 / awesome-knowledge-distillation-of-llms Goto Github PK
View Code? Open in Web Editor NEWThis project forked from tebmer/awesome-knowledge-distillation-of-llms
This repository collects papers for "A Survey on Knowledge Distillation of Large Language Models". We break down KD into Knowledge Elicitation and Distillation Algorithms, and explore the Skill & Vertical Distillation of LLMs.