I'm a PhD student at Stanford NLP, where I'm working with Dan Jurafsky. I was previously a BMO National Scholar and John H. Moss Scholar at the University of Toronto, where I worked with Graeme Hirst and David Duvenaud.
My research interests are in representation learning (e.g., word embeddings, additive compositionality) and evaluation (i.e., how good is your NLP model really?). While at Google, I also worked on graph representation learning and information extraction.
Updates
- (11/14/2020) "Utility is in the Eye of the User: A Critique of NLP Leaderboards" will be presented at EMNLP 2020. Slides are up!
- (11/14/2020) "BLEU Neighbors: A Reference-less Approach to Automatic Evaluation" will be presented at the Eval4NLP workshop at EMNLP 2020. Slides are up!
Publications
-
Utility is in the Eye of the User: A Critique of NLP Leaderboards.
Kawin Ethayarajh and Dan Jurafsky.
EMNLP 2020 (poster).
paper slides bib -
BLEU Neighbors: A Reference-less Approach to Automatic Evaluation.
Kawin Ethayarajh and Dorsa Sadigh.
EMNLP 2020 - Eval4NLP.
paper slides bib -
Is Your Classifier Actually Biased? Measuring Fairness under Uncertainty with Bernstein Bounds.
Kawin Ethayarajh.
ACL 2020 (oral).
paper blog slides screencast bib -
How Contextual are Contextualized Word Representations? Comparing the Geometry of BERT, ELMo, and GPT-2 Embeddings.
Kawin Ethayarajh.
EMNLP 2019 (oral).
paper blog code slides bib -
Rotate King to get Queen: Word Relationships as Orthogonal Transformations in Embedding Space.
Kawin Ethayarajh.
EMNLP 2019 (poster).
paper poster bib -
Understanding Undesirable Word Embedding Associations.
Kawin Ethayarajh, David Duvenaud, and Graeme Hirst.
ACL 2019 (oral).
paper blog slides bib -
Towards Understanding Linear Word Analogies.
Kawin Ethayarajh, David Duvenaud, and Graeme Hirst.
ACL 2019 (poster).
paper addendum blog bib -
Unsupervised Random Walk Sentence Embeddings: A Strong but Simple Baseline.
Kawin Ethayarajh.
ACL 2018 - Repl4NLP (best paper).
paper code poster slides screencast bib -
A Rose by Any Other Name: Understanding Judicial Decisions that Do Not Cite Precedent.
Kawin Ethayarajh, Andrew Green, and Albert Yoon.
Journal of Empirical Legal Studies. 15(3): 563-596.
paper -
The Effect of Photoperiod on the Mood of Reddit Users.
Kawin Ethayarajh and Frank Rudzicz.
Cyberpsychology, Behavior, and Social Networking. 20(4): 238-245.
paper press