The strong capability of large language models (LLMs) has been applied to information extraction (IE) through either retrieval augmented prompting or instruction tuning (IT). However, the best way to incorporate information with LLMs for IE remains an open question. In this paper, we explore Retrieval Augmented Instruction Tuning (RA-IT) for IE, focusing on the task of open named entity recognition (NER). Specifically, for each training sample, we retrieve semantically similar examples from the training dataset as the context and prepend them to the input of the original instruction. To evaluate our RA-IT approach more thoroughly, we construct a Chinese IT dataset for open NER and evaluate RA-IT in both English and Chinese scenarios. Experimental results verify the effectiveness of RA-IT across various data sizes and in both English and Chinese scenarios. We also conduct thorough studies to explore the impacts of various retrieval strategies in the proposed RA-IT framework.

Nested NER tasks have some challenges in specific domains, such as biomedical and industrial fields, particularly due to low resource and class imbalance, which impede its wide application. In this study, we design a novel loss EIoU-EMC, by enhancing the implement of Intersection over Union loss and Multi-class loss. Our proposed method specially leverages the information of entity boundary and entity classification, thereby enhancing the model's capacity to learn from a limited number of data samples. To validate the performance of this innovative method in enhancing NER task, we conducted experiments on three distinct biomedical NER datasets and one dataset constructed by ourselves from industrial complex equipment maintenance documents. Comparing to strong baselines, our method demonstrates the competitive performance across all datasets. During the experimental analysis, our proposed method exhibits significant advancements in entity boundary recognition and entity classification. Our code and data are available at https://github.com/luminous11/EIoU-EMC/

Large language models (LLMs) exhibited powerful capability in various natural language processing tasks.This work focuses on exploring LLM performance on zero-shot information extraction, with a focus on the ChatGPT and named entity recognition (NER) task.Inspired by the remarkable reasoning capability of LLM on symbolic and arithmetic reasoning, we adapt the prevalent reasoning methods to NER and propose reasoning strategies tailored for NER.First, we explore a decomposed question-answering paradigm by breaking down the NER task into simpler subproblems by labels.Second, we propose syntactic augmentation to stimulate the model's intermediate thinking in two ways: syntactic prompting, which encourages the model to analyze the syntactic structure itself, and tool augmentation, which provides the model with the syntactic information generated by a parsing tool.Besides, we adapt self-consistency to NER by proposing a two-stage majority voting strategy, which first votes for the most consistent mentions, then the most consistent types.The proposed methods achieve remarkable improvements for zero-shot NER across seven benchmarks, including Chinese and English datasets, and on both domainspecific and general-domain scenarios.In addition, we present a comprehensive analysis of the error types with suggestions for optimization directions.We also verify the effectiveness of the proposed methods on the few-shot setting and other LLMs. 1 * Corresponding authors. 1 Code available at: https://github.com/Emma1066/ Zero-Shot-NER-with-ChatGPT Input Text: The player who temporarily ranks second is German athlete Bao Lizzo, with a total score of 355.02 points, slightly lower than Lanwei.Gold Label: {"German":"Geo-Political Entity", "Lanwei": "Person", "BaoꞏLizzo": "Person"} Vanilla Ans: {"German athlete Bao Lizzo": "Person", "Lanwei": "Person"} TS-SC Ans: {"BaoꞏLizzo": "Person": "Person", "Lanwei": "Person", "German": "Geo-Political Entity"} ----------------------------------

Intelligent fault diagnosis is essential to guarantee the safe operation of industrial processes. And an important issue is how to develop a method to tackle the dilemma where we can only collect limited fault samples. In this paper, we propose a two-stage method based on supervised contrastive learning for imbalanced fault diagnosis tasks. We utilize the supervised contrastive learning technique as it has shown a powerful representation learning ability in previous works. The computational experiments on the Tennessee Eastman dataset show that our proposed two-stage method can achieve improved performance when compared to existing methods.

The maintenance of power plants highly relies upon precious knowledge and experience of handling faults, which is often stored in reports such as the event report. Simple string matching is the traditional means of retrieving relevant reports, and there is a failure of such methods in understanding the user's search intention properly. With a focus on improving the accuracy of information feedback, this work aims to develop a system of knowledge base question answering. Specifically, natural language processing is employed to improve question comprehension and information retrieval. The BiLSTM-CRF model and the fine-tuned BERT model are used to capture named entities and relations in the query. And the BM25 algorithm and the fine-tuned BERT model are combined to develop a scheme for better information retrieval. On this basis, the application interface of knowledge base question answering towards intelligent power plant maintenance is developed. With this question answering system, power plant operators can have better interaction with the knowledge base and improve collaboration.