Exploring Umass Cs685 F21 Advanced Nlp Knowledge Distillation
Exploring Umass Cs685 F21 Advanced Nlp Knowledge Distillation reveals several interesting facts.
- language models, ngram models, perplexity slides: https://people.cs.
- distillation
- REALM, k-NN LM, do LMs use retrievals? slides: https://people.cs.
- bertology, probe tasks, control probes slides: course schedule: https://people.cs.
- representing images, multimodal transfer learning, visual question answering, image captioning, multimodal pretraining (VilBERT, ...
In-Depth Information on Umass Cs685 F21 Advanced Nlp Knowledge Distillation
Knowledge distillation course introduction, demos of multilingual language models, many-to-many machine translation, multilingual datasets, zero-shot transfer for low-resource ... neural language models, simple composition functions, recurrent neural networks slides: ...
Introduction to
Stay tuned for more updates related to Umass Cs685 F21 Advanced Nlp Knowledge Distillation.
