In cross-modal music processing, translation between visual, auditory, and semantic content opens up new possibilities as well as challenges. The construction of such a transformative scheme depends upon a benchmark corpus with a comprehensive data infrastructure. In particular, the assembly of a large-scale cross-modal dataset presents major challenges. In this paper, we present the MOSA (Music mOtion with Semantic Annotation) dataset, which contains high quality 3-D motion capture data, aligned audio recordings, and note-by-note semantic annotations of pitch, beat, phrase, dynamic, articulation, and harmony for 742 professional music performances by 23 professional musicians, comprising more than 30 hours and 570 K notes of data. To our knowledge, this is the largest cross-modal music dataset with note-level annotations to date. To demonstrate the usage of the MOSA dataset, we present several innovative cross-modal music information retrieval (MIR) and musical content generation tasks, including the detection of beats, downbeats, phrases, and expressive contents from audio, video and motion data, and the generation of musicians' body motion from given music audio. The dataset and codes are available alongside this publication (https://github.com/yufenhuang/MOSA-Music-mOtion-and-Semantic-Annotation-dataset).

Generating body movements based on given music audio recordings is an emerging research topic. This problem remains challenging particularly for string instruments, considering the fact that the relationship between the musical note sequences and the body movement sequences in string instruments does not have an one-to-one correspondence and is highly context-dependent. In this paper, we take a divide-and-rule approach to tackle the multifaceted characteristics of musical movement, and propose a framework for generating violinists' body movements. Both objective and subjective evaluations show that the proposed framework improves the stability as well as the perceptual quality of the generation outputs by using the task-specific models for bowing and expressive movement. To the best of our knowledge, this work represents the first attempt to generate violinists' body movements considering music expression.

With the information of drug, disease phenotype and protein interactions accumulating rapidly, to investigate the relationships between drugs and diseases is a critical importance issue. Until recently, few studies attempt to discover drug-disease associations on a network basis. We integrate drug and phenotype information and protein interaction network together and apply a network propagation approach to infer and evaluate the likelihood of the probability between drug and disease based on gene expression profile. In the experiments, we adopt prostate cancer as our test data. We validate our results to the manually curated associations in Comparative Toxicogenomics Database. Our experimental studies show that our proposed method obtains high specificity and sensitivity (AUC=0.98) and clearly outperforms previous existing methods. Our proposed method discovers potential drug-disease associations that drew the attention of biologists and provides a new perspective for toxicogenomics and drug reposition evaluation.