NLPExplorer
Papers
Venues
Authors
Authors Timeline
Field of Study
URLs
ACL N-gram Stats
TweeNLP
API
Team
On the Analysis and Distillation of Emergent Outlier Properties in Pre-trained Language Models
Tianyang Zhao
|
Kunwar Yashraj Singh
|
Srikar Appalaraju
|
Peng Tang
|
Ying Nian Wu
|
Li Erran Li
|
Paper Details:
Month: April
Year: 2025
Location: Albuquerque, New Mexico
Venue:
NAACL |
Citations
URL
No Citations Yet
https://github.com/huawei-noah/Pretrained-Language-
https://github.com/huggingface/transformers/
http://www.apache.org/licenses/;
https://github.com/openai/gpt-
https://gluebenchmark.com/faq
https://huggingface.co/google-
https://github.com/huggingface/transformers/blob/main/examples/pytorch/text-classification/run_glue.py
https://huggingface.co/gchhablani/bert-base-cased-finetuned-stsb
https://huggingface.co/huawei-noah/TinyBERT_General_6L_768D
https://huggingface.co/huawei-noah/TinyBERT_General_4L_312D
https://huggingface.co/openai-community/gpt2-medium
https://github.com/huggingface/transformers/blob/main/examples/pytorch/text-classification/run_glue.py
https://github.com/huggingface/transformers/blob/main/examples/pytorch/text-
https://huggingface.co/openai-community/gpt2
https://huggingface.co/google-t5/t5-base
https://github.com/huggingface/transformers/blob/main/examples/pytorch/text-classification/run_glue.py
https://github.com/huggingface/transformers/blob/main/examples/pytorch/text-
https://huggingface.co/google-t5/t5-small
Field Of Study