I'm an Assistant Professor of Applied AI and Kathryn and Grant Swick Faculty Scholar at UChicago Booth, where I work on behavior-bound machine learning.
Machine learning is not a sterile industrial process; much in the way that it is hardware-bound and software-bound, it is also bound by the behavior of real-world actors such as workers, firms, and states.
I create machines that are compatible with actual actors, not just idealized ones, with research across post-training, evaluation, and AI governance.
My work has received an ICML 2022 Outstanding Paper award, a Facebook Fellowship, and an NSERC PGS-D.
Prior to UChicago, I graduated with a PhD in Computer Science from Stanford University, where I was advised by Dan Jurafsky.
Notable work:
-
-
How Contextual are Contextualized Word Representations? Comparing the Geometry of BERT, ELMo, and GPT-2 Embeddings.
Kawin Ethayarajh.
EMNLP 2019.
paper
tweet
code
Contextual representations in LLMs are anisotropic: they occupy a narrow cone in vector space instead of being uniformly distributed.
This paper identified and named the phenomenon, which has since become a foundational concept in AI—cited as core motivation for contrastive learning approaches like SimCSE, embedding post-processing methods like whitening, and a broad literature on representations.
-
-
Understanding Dataset Difficulty with V-Usable Information.
Kawin Ethayarajh, Yejin Choi, and Swabha Swayamdipta.
ICML 2022 (outstanding paper - top 10 of 5,630 submissions).
paper
tweet 1
tweet 2
code
dataset 1
dataset 2
We propose framing dataset difficulty as the lack of V-usable information.
This led to the development of Stanford Human Preferences (SHP), the first large-scale dataset of human preferences over natural text, based on data from Reddit.
SHP was the only dataset from academia used to post-train Llama-2, one of the first open-weight models to be preference-tuned and one of the most downloaded LLMs ever.
Within a year of SHP's release, Reddit started licensing its data for AI training in deals valued at 200M+ USD.
-
-
Model Alignment as Prospect Theoretic Optimization.
Kawin Ethayarajh, Winnie Xu, Niklas Muennighoff, Dan Jurafsky, and Douwe Kiela.
ICML 2024 (spotlight - top 335 of 9,473 submissions).
paper
tweet
code
press
We prove that the top post-training objectives (PPO, DPO) capture perceptual biases in how humans see random variables.
Surprisingly, these biases—like loss aversion—make post-training more efficient and performant than it otherwise would be.
By more intentionally integrating these biases, we create Kahneman-Tversky Optimization (KTO), a widely-used post-training algorithm..
-
-
Mecha-nudges for Machines.
Giulio Frey and Kawin Ethayarajh.
Technical AI Governance Workshop (TAIGR) @ ICML 2026 (outstanding paper - top 6 of 174 submissions).
Game Theory and Mechanism Design Workshop @ EC 2026 (spotlight)
paper
tweet
code
As AI agents make decisions in the same environments as humans, the environments themselves will change to influence them.
We formalize these as mecha-nudges and provide the first large-scale evidence that systematic mecha-nudging is already happening in the wild, by studying the Etsy marketplace.