In this paper, we touch on the problem of markerless multi-modal human motion capture especially for string performance capture which involves inherently subtle hand-string contacts and intricate movements. To fulfill this goal, we first collect a dataset, named String Performance Dataset (SPD), featuring cello and violin performances. The dataset includes videos captured from up to 23 different views, audio signals, and detailed 3D motion annotations of the body, hands, instrument, and bow. Moreover, to acquire the detailed motion annotations, we propose an audio-guided multi-modal motion capture framework that explicitly incorporates hand-string contacts detected from the audio signals for solving detailed hand poses. This framework serves as a baseline for string performance capture in a completely markerless manner without imposing any external devices on performers, eliminating the potential of introducing distortion in such delicate movements. We argue that the movements of performers, particularly the sound-producing gestures, contain subtle information often elusive to visual methods but can be inferred and retrieved from audio cues. Consequently, we refine the vision-based motion capture results through our innovative audio-guided approach, simultaneously clarifying the contact relationship between the performer and the instrument, as deduced from the audio. We validate the proposed framework and conduct ablation studies to demonstrate its efficacy. Our results outperform current state-of-the-art vision-based algorithms, underscoring the feasibility of augmenting visual motion capture with audio modality. To the best of our knowledge, SPD is the first dataset for musical instrument performance, covering fine-grained hand motion details in a multi-modal, large-scale collection. It holds significant implications and guidance for string instrument pedagogy, animation, and virtual concerts, as well as for both musical performance analysis and generation. Our code and SPD dataset are available at https://github.com/Yitongishere/string_performance.

Due to complicated manufacturing processes and inherent dispersions of constituents, uncertainty is unavoidably existing in mechanical properties, including strength, of composite laminates which can be described as random or interval variables. Considering the multivariable and hybrid uncertainty, the hybrid reliability evaluation of composite laminates is quite an important problem. The objective of this paper is to construct a reliability evaluation method to evaluate hybrid reliability of composite laminates accurately and efficiently. The existence of interval variables produced a limit-state strip formed by minimum and maximum limit state function (LSF). Combining first-order reliability method (FORM) and univariate method, the paper developed a strategy to search the most probable point (MPP) of minimum and maximum LSF. In the process of MPP searching, the univariate function of interval variables is constructed by Legendre orthogonal polynomials and the least-square fitting method. Then, the minimum and maximum LSF are constructed at MPP in a similar way with interval variables which can ensure the accuracy of LSF approximation. Furthermore, Monte-Carlo simulation can be utilized to calculate interval of failure probability. Finally, the results of examples verified the accuracy and efficiency of the constructed model.

By combining the nonprobabilistic reliability theory with optimization design approach, this paper proposes a mixed reliability-based optimization method for the heat transfer system design with both fuzzy and interval parameters in material property, external load, and boundary condition. Fuzzy variables are used to represent subjective uncertainties associated with expert opinions; whereas, interval variables are adopted to quantify objective uncertainties with limited information. Based on the level-cut strategy, the mixed uncertain problem is transformed into a pure interval problem first. Then, a modified reliability analysis method using an interval ranking strategy and integral operation is presented to precisely assess the system safety possibility. Subsequently, a mixed reliability-based optimization model with fuzzy and interval parameters is established, which is a nested optimization problem with huge computational cost. A subinterval perturbation method is eventually presented for temperature field prediction, which can replace the inner loop optimization and improve the computational efficiency. A transient heat conduction example about a three-layer thermal structure verifies the superiority of the proposed model and method for mixed reliability analysis and optimization in practical engineering.