Conversational grounding, vital for building effective dialogue between people and between people and dialogue systems, involves ensuring a mutual understanding of shared information.Despite its importance, there has been limited research on this aspect of conversation in recent years, especially after the advent of Large Language Models (LLMs).Previous studies have highlighted the shortcomings of some pre-trained language models in conversational grounding.However, most testing for conversational grounding capabilities involves human evaluations that are costly and time-consuming.This has led to a lack of testing across multiple models of varying sizes, a critical need given the rapid rate of new model releases.This gap in research becomes more significant considering recent advances in language models, which have led to new emergent capabilities.In this paper, we evaluate the performance of LLMs in various aspects of conversational grounding and analyze why some models perform better than others.We demonstrate a direct correlation between the size of the pre-training dataset, size of the model and conversational grounding abilities, suggesting that they have independently acquired some pragmatic capabilities from larger pre-training datasets.Finally, we propose ways to enhance the capabilities of the models that lag in our tests.

A law practitioner has to go through numerous lengthy legal case proceedings for their practices of various categories, such as land dispute, corruption, etc. Hence, it is important to summarize these documents, and ensure that summaries contain phrases with intent matching the category of the case. To the best of our knowledge, there is no evaluation metric that evaluates a summary based on its intent. We propose an automated intent-based summarization metric, which shows a better agreement with human evaluation as compared to other automated metrics like BLEU, ROUGE-L etc. in terms of human satisfaction. We also curate a dataset by annotating intent phrases in legal documents, and show a proof of concept as to how this system can be automated.