KAWIN ETHAYARAJH
Toronto, Canadafirstname@stanford.edu
Blog
Google Scholar
Github
CV (out-of-date)
I'm a PhD student, NSERC PGS-D Scholar, and Facebook Fellow at Stanford NLP, where I'm working with Dan Jurafsky. I was previously a BMO National Scholar and John H. Moss Scholar at the University of Toronto, where I worked with Graeme Hirst and David Duvenaud.
My research interests are in representation learning (e.g., word embeddings, additive compositionality) and evaluation (i.e., how good is your NLP model really?).
Recent Work
-
Information-Theoretic Measures of Dataset Difficulty.
Kawin Ethayarajh, Yejin Choi, and Swabha Swayamdipta.
preprint.
paper -
Conditional probing: measuring usable information beyond a baseline.
John Hewitt, Kawin Ethayarajh, Percy Liang, and Christopher D. Manning.
EMNLP 2021 (poster).
paper blog -
On the Opportunities and Risks of Foundation Models.
Rishi Bommasani, ..., John Etchemendy, Kawin Ethayarajh, Fei-Fei Li, ..., Percy Liang.
whitepaper
paper -
Dynaboard: An Evaluation-As-A-Service Platform for Holistic Next-Generation Benchmarking
Zhiyi Ma*, Kawin Ethayarajh*, Tristan Thrush*, Somya Jain, Ledell Wu, Robin Jia, Christopher Potts, Adina Williams, Douwe Kiela
NeurIPS 2021 (poster).
paper -
Attention Flows are Shapley Value Explanations.
Kawin Ethayarajh and Dan Jurafsky.
ACL 2021 (oral).
paper slides bib -
Utility is in the Eye of the User: A Critique of NLP Leaderboards.
Kawin Ethayarajh and Dan Jurafsky.
EMNLP 2020 (poster).
paper slides bib -
Is Your Classifier Actually Biased? Measuring Fairness under Uncertainty with Bernstein Bounds.
Kawin Ethayarajh.
ACL 2020 (virtual).
paper blog slides screencast bib -
How Contextual are Contextualized Word Representations? Comparing the Geometry of BERT, ELMo, and GPT-2 Embeddings.
Kawin Ethayarajh.
EMNLP 2019 (oral).
paper blog code slides bib -
Rotate King to get Queen: Word Relationships as Orthogonal Transformations in Embedding Space.
Kawin Ethayarajh.
EMNLP 2019 (poster).
paper poster bib -
Understanding Undesirable Word Embedding Associations.
Kawin Ethayarajh, David Duvenaud, and Graeme Hirst.
ACL 2019 (oral).
paper blog slides bib -
Towards Understanding Linear Word Analogies.
Kawin Ethayarajh, David Duvenaud, and Graeme Hirst.
ACL 2019 (poster).
paper addendum blog bib -
Unsupervised Random Walk Sentence Embeddings: A Strong but Simple Baseline.
Kawin Ethayarajh.
ACL 2018 - Repl4NLP (best paper).
paper code poster slides screencast bib
2021
2020
2019
2018
Misc
-
BLEU Neighbors: A Reference-less Approach to Automatic Evaluation.
Kawin Ethayarajh and Dorsa Sadigh.
EMNLP 2020 - Eval4NLP.
paper slides bib -
A Rose by Any Other Name: Understanding Judicial Decisions that Do Not Cite Precedent.
Kawin Ethayarajh, Andrew Green, and Albert Yoon.
Journal of Empirical Legal Studies. 15(3): 563-596.
paper -
The Effect of Photoperiod on the Mood of Reddit Users.
Kawin Ethayarajh and Frank Rudzicz.
Cyberpsychology, Behavior, and Social Networking. 20(4): 238-245.
paper press