Previous pre-neural work on structured prediction has produced very effective supervised clustering algorithms using linear classifiers, e.g., structured SVM or perceptron.However, these cannot exploit the representation learning ability of neural networks, which would make supervised clustering even more powerful, i.e., general clustering patterns can be learned automatically.In this paper, we design neural networks based on latent structured prediction loss and Transformer models to approach supervised clustering.We tested our methods on the task of automatically recreating categories of intents from publicly available question intent corpora.The results show that our approach delivers 95.65% of F1, outperforming the state of the art by 17.24%.

Modern automated dialog systems require complex dialog managers able to deal with user intent triggered by high-level semantic questions.In this paper, we propose a model for automatically clustering questions into user intents to help the design tasks.Since questions are short texts, uncovering their semantics to group them together can be very challenging.We approach the problem by using powerful semantic classifiers from question duplicate/matching research along with a novel idea of supervised clustering methods based on structured output.We test our approach on two intent clustering corpora, showing an impressive improvement over previous methods for two languages/domains.

An assential aspect of structured prediction is the evaluation of an output structure against the gold standard.Especially in the loss-augmented setting, the need of finding the max-violating constraint has severely limited the expressivity of effective loss functions.In this paper, we trade off exact computation for enabling the use of more complex loss functions for coreference resolution (CR).Most noteworthily, we show that such functions can be (i) automatically learned also from controversial but commonly accepted CR measures, e.g., MELA, and (ii) successfully used in learning algorithms.The accurate model comparison on the standard CoNLL-2012 setting shows the benefit of more expressive loss for Arabic and English data.