Kunal Handa

dblp:336/6747 · DBLP profile ↗
← Back
3ranked-venue papers
1as first author
3since 2021 · last 2023
—ORCID · none

Domains — the database's venue-derived domains; a paper can count in several

Artificial intelligence and machine learning · 3 · 1 first-author · 3 since 2021

Expertise — from the expertise taxonomy: the topics of the expert's papers under the CCF categories. A weight counts papers with recency: 1 for a paper about the topic, 0.3 when the topic is its context, halved every five years.

Artificial intelligence
3 papers
Language models and text generation · 50% Representation and self-supervised learning · 25% Reinforcement learning · 25%
Human-computer interaction and pervasive computing
2 papers
Learning and educational technologies · 62% Human-AI interaction · 38%

Topics — the 3 heaviest of 7, each with the papers that count most for it

TopicWeightPapersLastEvidence papers
Machine learning › Reinforcement learning › function approximation › representation learning for reinforcement learning
state representation
0.712023
Emergence of Abstract State Representations in Embodied Sequence Modeling · EMNLP 2023
Machine learning › Representation and self-supervised learning › representation learning › latent representation learning
state representation learning
0.712023
Emergence of Abstract State Representations in Embodied Sequence Modeling · EMNLP 2023
Natural language and speech › Language models and text generation
task ambiguity
0.712023
Task Ambiguity in Humans and Language Models · ICLR 2023

Methods — techniques the papers use, named apart from their topics

prompt framework · 1.3LLM · 1.3transformer sequence modeling · 0.7probing · 0.7
YearPublicationVenuePosition
2023 "Mistakes Help Us Grow": Facilitating and Evaluating Growth Mindset Supportive Language in Classrooms
abstract
Teachers' growth mindset supportive language (GMSL)-rhetoric emphasizing that one's skills can be improved over time-has been shown to significantly reduce disparities in academic achievement and enhance students' learning outcomes.Although teachers espouse growth mindset principles, most find it difficult to adopt GMSL in their practice due the lack of effective coaching in this area.We explore whether large language models (LLMs) can provide automated, personalized coaching to support teachers' use of GMSL.We establish an effective coaching tool to reframe unsupportive utterances to GMSL by developing (i) a parallel dataset containing GMSL-trained teacher reframings of unsupportive statements with an accompanying annotation guide, (ii) a GMSL prompt framework to revise teachers' unsupportive language, and (iii) an evaluation framework grounded in psychological theory for evaluating GMSL with the help of students and teachers.1 We conduct a large-scale evaluation involving 174 teachers and 1,006 students, finding that both teachers and students perceive GMSL-trained teacher and model reframings as more effective in fostering a growth mindset and promoting challenge-seeking behavior, among other benefits.We also find that model-generated reframings outperform those from the GMSL-trained teachers.These results show promise for harnessing LLMs to provide automated GMSL feedback for teachers and, more broadly, LLMs' potentiality for supporting students' learning in the classroom.Our findings also demonstrate the benefit of largescale human evaluations when applying LLMs in educational domains.
Kunal Handa, Margaret Clapper, Jessica Boyle, Rose E. Wang, Diyi Yang, David S. Yeager, Dorottya Demszky
EMNLP1
2023 Emergence of Abstract State Representations in Embodied Sequence Modeling
abstract
Decision making via sequence modeling aims to mimic the success of language models, where actions taken by an embodied agent are modeled as tokens to predict.Despite their promising performance, it remains unclear if embodied sequence modeling leads to the emergence of internal representations that represent the environmental state information.A model that lacks abstract state representations would be liable to make decisions based on surface statistics which fail to generalize.We take the BabyAI environment, a grid world in which language-conditioned navigation tasks are performed, and build a sequence modeling Transformer, which takes a language instruction, a sequence of actions, and environmental observations as its inputs.In order to investigate the emergence of abstract state representations, we design a "blindfolded" navigation task, where only the initial environmental layout, the language instruction, and the action sequence to complete the task are available for training.Our probing results show that intermediate environmental layouts can be reasonably reconstructed from the internal activations of a trained model, and that language instructions play a role in the reconstruction accuracy.Our results suggest that many key features of state representations can emerge via embodied sequence modeling, supporting an optimistic outlook for applications of sequence modeling objectives to more complex embodied decision-making domains.1
Tian Yun 0001, Zilai Zeng, Kunal Handa, Ashish V. Thapliyal, Bo Pang 0001, Ellie Pavlick, Chen Sun 0002
EMNLP3
2023 Task Ambiguity in Humans and Language Models
Alex Tamkin, Kunal Handa, Avash Shrestha, Noah D. Goodman
ICLR2