Although large language models have significantly advanced natural language generation, their potential in low-resource machine translation has not yet been fully explored, especially for languages that translation models have not been trained on. In this study, we provide a detailed demonstration of how to efficiently expand low-resource languages for large language models and significantly enhance the model’s translation ability, using Uyghur as an example. The process involves four stages: collecting and pre-processing monolingual data, conducting continuous pre-training with extensive monolingual data, fine-tuning with less parallel corpora using translation supervision, and proposing a direct preference optimization based on translation self-evolution (DPOSE) on this basis. Extensive experiments have shown that our strategy effectively expands the low-resource languages supported by large language models and significantly enhances the model’s translation ability in Uyghur with less parallel data. Our research provides detailed insights for expanding other low-resource languages into large language models.

Event forecasting requires modeling historical event data to predict future events, and achieving accurate predictions depends on effectively capturing the relevant historical information that aids forecasting.Most existing methods focus on entities and structural dependencies to capture historical clues but often overlook implicitly relevant information.This limitation arises from overlooking event semantics and deeper factual associations that are not explicitly connected in the graph structure but are nonetheless critical for accurate forecasting.To address this, we propose a dual-criteria constraint strategy that leverages event semantics for relevance modeling and incorporates a self-supervised semantic filter based on factual event associations to capture implicitly relevant historical information.Building on this strategy, our method, termed ITHI (Integrating Three types of Historical Information), combines sequential event information, periodically repeated event information, and relevant historical information to achieve context-aware event forecasting.We evaluated the proposed ITHI method on three public benchmark datasets, achieving state-of-the-art performance and significantly outperforming existing approaches.Additionally, we validated its effectiveness on two structured temporal knowledge graph forecasting dataset 1 .

Active reading is crucial for the acquisition of information and the comprehension of literature. However, existing digital media still encounter several challenges in facilitating active reading, such as the limited contextual space caused by constrained screen size, which hinders effective information integration. Furthermore, the rationality of the layout of various types of literature resources also significantly influences the coherence of the reading experience. To address these challenges, we propose DocVision, a seamless, cross-device immersive active reading framework. To reduce the difficulty of information integration, DocVision incorporates a lightweight resource acquisition framework, which seamlessly integrates resources such as diagrams and literature references into the mixed reality (MR) environment. Furthermore, we propose a dynamic layout method for MR to improve reading continuity in multi-resource contexts. Experimental results demonstrate that DocVision substantially enhances the coherence of readers' reading experience and significantly alleviates cognitive load, offering valuable insights for developing future active reading approaches based on digital media.

As a method of bare-hand selection, MultiFingerBubble partially addresses the challenges of selecting tiny targets in dense virtual reality (VR) environments. However, due to the Heisenberg Effect and finger flexibility limitations, MultiFingerBubble exhibits constraints such as last-second change of colors and unfriendly gestures. In this paper, we propose Single-Hand Frozen Gestures (SHFG), which stabilizes targets by clenching the fist before selecting, thus preventing the last-second change of colors. To test our design concepts, we develop two user-friendly selection gestures based on SHFG – LiftFinger and PianoFinger. We conduct a user study involving 16 participants and conduct four comparative experiments. Our results suggest that compared with MultiFingerBubble, LiftFinger + SHFG (LiftFrozenFinger) and PianoFinger + SHFG (PianoFrozenFinger) improve accuracy of selection and reduce hand fatigue. Additionally, we apply the two selection methods to select molecular ball-and-stick models to validate their usability. These two techniques could be suitable for other dense virtual reality environments as well.

Ordinal tabular data, with advantages of structured knowledge representation in tabular data and the characteristic of inter-class ranks, has drawn increasing attention. However, existing retrieval-based tabular deep learning methods designed primarily for classical tabular data pay less attention to ordinal tabular data. Ordinal knowledge of ordinal tabular data provides a more explicit objective for tabular ordinal classification by considering both classification and regression properties. Furthermore, these approaches overlook the significance of intra-class group features which can balance the retrieved probability of various sample size groups and capture shared knowledge among multiple samples within same group. In this work, we propose the Intra-Class Groups Retrieval and Inter-Class Ordinal Knowledge Augmented Network (TabCGOK) model for ordinal tabular data prediction, equipped with Intra-Class Groups Retrieval (CG) module and Inter-Class Ordinal Knowledge Augmented (OK) module. The CG module provides intra-class group features candidate set for subsequent retrieval operation. It divides each class into several groups, then extracts the representation of each group as intra-class group features. And the intra-class group features candidate set consists of all intra-class group features from each class. The OK module is designed to capture inter-class ordinal knowledge. It estimates the ordinal distances by calculating inter-class feature distances, which could correspond to the inter-class non-isometric nature of ordinal knowledge, and then aggregates the previous ordinal distances to clarify the containment relationship of ordinal knowledge. OK module utilizes the attention mechanism for fusing the captured ordinal knowledge to retrieved intra-class group features. Finally, TabCGOK integrates fused intra-class group features with sample level features for ordinal tabular data prediction. Extensive experiments on several ordinal tabular datasets demonstrate the effectiveness of our method. The source code is available at https://github.com/luozhengdong/TabCGOK.

Few-shot slot tagging is an important task in dialogue systems and attracts much attention of researchers. Most previous few-shot slot tagging methods utilize meta-learning procedure for training and strive to construct a large number of different meta tasks to simulate the testing situation of insufficient data. However, there is a widespread phenomenon of overlap slot between two domains in slot tagging. Traditional meta tasks ignore this special phenomenon and cannot simulate such realistic few-shot slot tagging scenarios. It violates the basic principle of meta-learning which the meta task is consistent with the real testing task, leading to historical information forgetting problem. In this paper, we introduce a novel domain-transfer meta task design paradigm to tackle this problem. We distribute a basic domain to each target domain based on the coincidence degree of slot labels between these two domains. Unlike classic meta tasks which only rely on small samples of target domain, our meta tasks aim to correctly infer the class of target domain query samples based on both abundant data in basic domain and scarce data in target domain. To accomplish our meta task, we propose a Task Adaptation Network to effectively transfer the historical information from the basic domain to the target domain. We carry out sufficient experiments on the benchmark slot tagging dataset SNIPS and the name entity recognition dataset NER. Results demonstrate that our proposed model outperforms previous methods and achieves the state-of-the-art performance.

There are a large number of candidate values shared among slots in multi-domain dialogue state tracking (DST). The existing span prediction-based DST methods generally adopt slot-independent value extraction architecture, which ignore the value sharing. Besides, the slot-independent design leads to poor scalability. In this paper, we propose a Slot-shared Span Prediction based Network (SSNet) with a general value extraction module for all slots to tackle these problems. To ensure that the value extraction module is able to distinguish different slots, we introduce a Dynamic Fusion Mechanism (DFM) to extract different slot-aware features. DFM plays the routing role, highlighting different dialogue context tokens for different slots. Specifically, DFM firstly calculates similarity matrixes between the dialogue context and different slots, and then determines important dialogue context token with respect to each slot. Experimental results demonstrate that SSNet outperforms the existing start-of-the-art models on both MultiWOZ 2.1 and MultiWOZ 2.2 datasets.

Few-shot Intent Detection (FSID) is a challenging task in dialogue systems due to the scarcity of available annotated utterances. Although existing few-shot learning approaches have made remarkable progress, they fall short in adapting to the Generalized Few-shot Intent Detection (GFSID) task where both seen and unseen classes are present. A core problem of the simultaneous existence of these two tasks is that limited training samples fail to cover the diversity of user expressions. In this paper, we propose an effective Diversity Features Enhanced Prototypical Network (DFEPN) to enhance diversity features for novel intents by fully exploiting the diversity of known intent samples. Specially, DFEPN generates diversity features of samples in the hidden space via a diversity feature generator module and then fuses these features with original support vectors to get a more suitable prototype vector of each class. To evaluate the effectiveness of our model on both FSID and GFSID tasks, we carry out sufficient experiments on two benchmark intent detection datasets. Results demonstrate that our proposed model outperforms existing state-of-the-art methods and keeps stable performance on both two tasks.

Massive multiple-input multiple-output (MIMO) system, in which base stations are equipped with a large number of antennas in a two-dimensional (2D) antenna array, is one of the most promising technologies to improve the spectral efficiency of cellular networks. Since there is no channel reciprocity, the frequency-division duplexing (FDD) massive MIMO system has to obtain channel state information (CSI) with the help of uplink feedback. However, in practice, there are several challenges for the implementation of FDD massive MIMO system, such as feedback overhead and delay. In this paper, we begin with the virtual sectorization using CSI- Reference Signal (RS) beamforming scheme to illustrate the implementation of FDD massive MIMO in the standard transparent manner, and then we describe the potential performance degradation caused by feedback delay. To cope with this issue, we propose a historical precoding matrix indicator (PMI) based multi-user scheduling algorithm to enhance the system performance. By utilizing system-level simulator, we further present the effectiveness of the proposed algorithms.

Previous work has reported that vertical sectorization can efficiently improve the capacity of LTE network using Active Antenna System (AAS) based on simulation results, however, its performance in real-world scenario still needs to be evaluated and verified for future deployment. Thus, this study conducts an evaluation of vertical sectorization in LTE field trial with single user. The field trial results show that the average downlink throughput of the single user is reduced compared to the one of traditional network, which results in the deterioration of user experience. Furthermore, we examine field data and antenna parameters, and verify that the co-frequency interference between the inner and outer cells is the main reason for average downlink throughput decrease in field trial. Obviously, without proper interference suppression or can-celation mechanisms, the vertical sectorization can not improve the user experience. Therefore, some practical suggestions on the deployment of vertical sectorization in LTE network are proposed.

Heterogenous network is currently under intensive discussion within 3GPP as an effective solution to improve network coverage and capacity for long term evolution (LTE)Advanced system, which consists of a mix of high-power macro base stations and a diverse set of low-power nodes, i.e., pico, femto and relay nodes. In this paper, we will particularly focus on the mixed deployment of macro and pico cells. Co-channel deployment is typically assumed for heterogenous network to make the best use of spectrum resource; therefore, a critical issue for heterogenous network is co-channel interference between macro and pico cells, which, if not properly addressed, may significantly degrade the performance of heterogenous network. Furthermore, other deployment options, e.g., the number and the positions of pi co nodes will also affect system performance greatly. In this paper, we will carry out extensive simulation campaigns to evaluate the downlink and uplink performance of co-channel macro-pico heterogeneous network. Results show that huge performance benefit can be obtained if heterogenous network is well designed and parameterized.