Subject
2 entries
Sagemaker
Bookmarks
Task-Specific Knowledge Distillation for BERT
A tutorial on task-specific knowledge distillation for BERT using Hugging Face Transformers and Amazon SageMaker — compressing a 109M-parameter BERT-base into a 4M-parameter student with 90%+ performance retention. Demonstrates that you don't need a massive model in production if you can distill task knowledge from one.
Financial Text Summarization with Hugging Face and Keras
A tutorial on fine-tuning distilled BART for financial news summarization using Hugging Face Transformers with Keras and Amazon SageMaker — generating headline-length summaries from longer articles. A practical demonstration of seq2seq fine-tuning on domain-specific data.