The digitization of clinical data via electronic health records (EHRs) shows great promise for data-based decisionmaking, particularly through the analysis of unstructured clinical notes. While large language models (LLMs) offer tools for interpreting these narratives, their vast size and general-purpose design can pose difficulties in real-world healthcare settings. More specialized LLMs, tailored to healthcare contexts, are an alternative solution, although their integration into resourceconstrained environments is often problematic due to their dimensions. In this work, we present MedESM, a lightweight 1B parameter medical LLM specifically fine-tuned for structured summarization of clinical notes across twelve clinically relevant categories. Within our knowledge, MedESM is the only model at the 1B parameter scale capable of performing this task. Trained on over 40,000 real and synthetic clinical notes from the MIMIC-IV-NOTE and Asclepius datasets, MedESM leverages targeted instruction-based summarization and careful prompt design to ensure stable performance on long and complex inputs. Results show that MedESM achieves competitive quality with significantly reduced computational demands, offering a practical solution for structured documentation support in clinical settings.

This paper proposes a Machine Learning (ML) approach to perform an Ahead-of-Time (AoT) prediction of decorated particle-board production disruptions and defects. We worked with a Portuguese company that is adopting the Industry 4.0 concept aiming to improve their decorated particleboard production planning (e.g., reducing production time and waste of materials). This company’s business needs are addressed in terms of two nontrivial binary Classification tasks (production disruptions and defects). The AoT prediction is achieved by using only input attributes available before the execution of the production process. To reduce the modeling effort, we focus on Automated ML (AutoML) methods, under two main approaches: Single-Target Classification (STC) and Multi-Target Classification (MTC). The former is achieved by adopting the popular H2O AutoML tool, while the latter adopts a deep learning neural network automatically tuned by using a Bayesian search. The computational experiments adopted a realistic rolling window evaluation over recently collected industrial data (comprising 14 months). Overall, interesting predictive results were achieved by both AutoML approaches, outperforming a baseline Decision Tree method. In addition, an eXplainable Artificial Intelligence (XAI) method based on a Sensitivity Analysis (SA) was adopted, allowing the identification of the most relevant inputs, which is valuable knowledge to support the decorated particleboard production planning.

In this paper, we propose a proactive method to prevent Work-related MusculoSkeletal Disorders (WMSDs) in manufacturing industries. The integrated method includes a Motion Capture System (MCS) for data collection, a Time Series Forecasting (TSF) module using Machine Learning (ML) algorithms, a WMSD risk assessment module based on ergonomic standards, and a safety mechanism (e.g., alarm sound). We evaluated the method by analyzing shoulder abduction, rotation, and flexion movements of 12 participants working with textile machines. The computational experiments included a comparison of four ML algorithms and a baseline Naive method using a 12-fold participant cross-validation approach. Overall, the best Ahead-of-Time (AoT) TSF and WMSD risk detection empirical results were obtained by a Support Vector Machine (SVM), which required a reasonable training computational effort and provides an interesting performance for AoT TSF and high risk WMSD detection. • A proactive method is proposed to prevent Work-related MusculoSkeletal Disorders (WMSDs). • Machine Learning (ML) was used to forecast Ahead-of-Time (AoT) angular movements. • Standard ergonomics were adopted to detect upper limb high risk WMSD of 12 textile workers. • Best empirical results provided by a Support Vector Machine (SVM).

Abstract In this paper, we propose an Intelligent Decision Support System (IDSS) for the design of new textile fabrics. The IDSS uses predictive analytics to estimate fabric properties (e.g., elasticity) and composition values (% cotton) and then prescriptive techniques to optimize the fabric design inputs that feed the predictive models (e.g., types of yarns used). Using thousands of data records from a Portuguese textile company, we compared two distinct Machine Learning (ML) predictive approaches: Single-Target Regression (STR), via an Automated ML (AutoML) tool, and Multi-target Regression, via a deep learning Artificial Neural Network. For the prescriptive analytics, we compared two Evolutionary Multi-objective Optimization (EMO) methods (NSGA-II and R-NSGA-II) when optimizing 100 new fabrics, aiming to simultaneously minimize the physical property predictive error and the distance of the optimized values when compared with the learned input space. The two EMO methods were applied to design of 100 new fabrics. Overall, the STR approach provided the best results for both prediction tasks, with Normalized Mean Absolute Error values that range from 4% (weft elasticity) to 11% (pilling) in terms of the fabric properties and a textile composition classification accuracy of 87% when adopting a small tolerance of 0.01 for predicting the percentages of six types of fibers (e.g., cotton). As for the prescriptive results, they favored the R-NSGA-II EMO method, which tends to select Pareto curves that are associated with an average 11% predictive error and 16% distance.

Under the Industry 4.0 concept, there is increased usage of data-driven analytics to enhance the production process. In particular, equipment maintenance is a key industrial area that can benefit from using Machine Learning (ML) models. In this paper, we propose a novel Remaining Useful Life (RUL) ML-based spare part prediction that considers maintenance historical records, which are commonly available in several industries and thus more easy to collect when compared with specific equipment measurement data. As a case study, we consider 18,355 RUL records from an automotive multimedia assembly company, where each RUL value is defined as the full amount of units produced within two consecutive corrective maintenance actions. Under regression modeling, two categorical input transforms and eight ML algorithms were explored by considering a realistic rolling window evaluation. The best prediction model, which adopts an Inverse Document Frequency (IDF) data transformation and the Random Forest (RF) algorithm, produced high-quality RUL prediction results under a reasonable computational effort. Moreover, we have executed an eXplainable Artificial Intelligence (XAI) approach, based on the SHapley Additive exPlanations (SHAP) method, over the selected RF model, showing its potential value to extract useful explanatory knowledge for the maintenance domain.

Nowadays, manufacturing industries still face difficulties applying traditional Work-related MusculoSkeletal Disorders (WMSDs) risk assessment methods due to the high effort required by a continuous data collection when using observational methods. An interesting solution is to adopt Inertial Measurement Units (IMUs) to automate the data collection, thus supporting occupational health professionals. In this paper, we propose a deep learning approach to predict human motion based on IMU data with the goal of preventing industrial worker problematic movements that can arise during repetitive actions. The proposed system includes an initial Madgwick filter to merge the raw inertial tri-axis sensor data into a single angle orientation time series. Then, a Machine Learning (ML) algorithm is trained with the obtained time series, allowing to build a forecasting model. The effectiveness of the developed system was validated by using an open-source dataset composed of different motions for the upper body collected in a laboratory environment, aiming to monitor the abduction/adduction angle of the arm. Firstly, distinct ML algorithms were compared for a single angle orientation time series prediction, including: three Long Short-Term Memory (LSTM) methods - a one layer, a stacked layer and a Sequence to Sequence (Seq2Seq) model; and three non deep learning methods - a Multiple Linear Regression, a Random Forest and a Support Vector Machine. The best results were provided by the Seq2Seq LSTM model, which was further evaluated for WMSD prevention by considering 11 human subject datasets and two evaluation procedures (single person and multiple person training and testing). Overall, interesting results were achieved, particularly for multiple person evaluation, where the proposed Seq2Seq LSTM has shown an excellent capability to anticipate problematic movements.

In this paper, we propose a Machine Learning (ML) approach to predict faults that may occur during the production of fabrics and that often cause production downtime delays. We worked with a textile company that produces fabrics under the Industry 4.0 concept. In particular, we deal with a client customization requisite that impacts on production planning and scheduling, where there is a crucial need of limiting machine stoppage. Thus, the prediction of machine stops enables the manufacturer to react to such situation. If a specific loom is expected to have more breaks, several measures can be taken: slower loom speed, special attention by the operator, change in the used yarn, stronger sizing recipe, etc. The goal is to model three regression tasks related with the number of weft breaks, warp breaks, and yarn bursts. To reduce the modeling effort, we adopt several Automated Machine Learning (AutoML) tools (H2O, AutoGluon, AutoKeras), allowing us to compare distinct ML approaches: using a single (one model per task) and Multi-Target Regression (MTR); and using the direct output target or a logarithm transformed one. Several experiments were held by considering Internet of Things (IoT) historical data from a Portuguese textile company. Overall, the best results for the three tasks were obtained by the single-target approach with the H2O tool using logarithm transformed data, achieving an R2 of 0.73 for weft breaks. Furthermore, a Sensitivity Analysis eXplainable Artificial Intelligence (SA XAI) approach was executed over the selected H2OAutoML model, showing its potential value to extract useful explanatory knowledge for the analyzed textile domain.

This paper presents a benchmark of supervised Automated Machine Learning (AutoML) tools. Firstly, we analyze the characteristics of eight recent open-source AutoML tools (Auto-Keras, Auto-PyTorch, Auto-Sklearn, AutoGluon, H2O AutoML, rminer, TPOT and TransmogrifAI) and describe twelve popular OpenML datasets that were used in the benchmark (divided into regression, binary and multi-class classification tasks). Then, we perform a comparison study with hundreds of computational experiments based on three scenarios: General Machine Learning (GML), Deep Learning (DL) and XGBoost (XGB). To select the best tool, we used a lexicographic approach, considering first the average prediction score for each task and then the computational effort. The best predictive results were achieved for GML, which were further compared with the best OpenML public results. Overall, the best GML AutoML tools obtained competitive results, outperforming the best OpenML models in five datasets. These results confirm the potential of the general-purpose AutoML tools to fully automate the Machine Learning (ML) algorithm selection and tuning.

Current developments on self-driving cars have increased the interest on autonomous shared taxicabs. While most self-driving technologies focus on the outside environment, there is also a need to provide in-vehicle intelligence (e.g., detect health and safety issues related with the car occupants). Set within an R&D project focused on in-vehicle cockpit intelligence, the research presented in this paper addresses an unsupervised Acoustic Anomaly Detection (AAD) task. Since data is nonexistent in this domain, we first design an in-vehicle sound event data simulator that can realistically mix background audios (recorded from car driving trips) with normal (e.g., people talking, radio on) and abnormal (e.g., people arguing, cough) event sounds, allowing the generation of three synthetic in-vehicle sound datasets. Then, we explore two main sound feature extraction methods (based on a combination of three audio features and mel frequency energy coefficients) and propose a novel Long Short-Term Memory Autoencoder (LSTM-AE) deep learning architecture for in-vehicle sound anomaly detection. Competitive results were achieved by the proposed LSTM-AE when compared with two state-of-the-art methods, namely a dense Autoencoder (AE) and a two-stage clustering.

Abstract Recently, the term “Industry 4.0” has emerged to characterize several Information Technology and Communication (ICT) adoptions in production processes (e.g., Internet‐of‐Things, implementation of digital production support information technologies). Business Analytics is often used within the Industry 4.0, thus incorporating its data intelligence (e.g., statistical analysis, predictive modelling, optimization) expert system component. In this paper, we perform a Systematic Literature Review (SLR) on the usage of Business Analytics within the Industry 4.0 concept, covering a selection of 169 papers obtained from six major scientific publication sources from 2010 to March 2020. The selected papers were first classified in three major types, namely, Practical Application, Reviews and Framework Proposal. Then, we analysed with more detail the practical application studies which were further divided into three main categories of the Gartner analytical maturity model, Descriptive Analytics, Predictive Analytics and Prescriptive Analytics. In particular, we characterized the distinct analytics studies in terms of the industry application and data context used, impact (in terms of their Technology Readiness Level) and selected data modelling method. Our SLR analysis provides a mapping of how data‐based Industry 4.0 expert systems are currently used, disclosing also research gaps and future research opportunities.

Automation and scalability are currently two of the main challenges of Machine Learning. This paper proposes an automated and distributed ML framework that automatically trains a supervised learning model and produces predictions independently of the dataset and with minimum human input. The framework was designed for the domain of telecommunications risk management, which often requires supervised learning models that need to be quickly updated by non-ML-experts and trained on vast amounts of data. Thus, the architecture assumes a distributed environment, in order to deal with big data, and Automated Machine Learning (AutoML), to select and tune the ML models. The framework includes several modules: task detection (to detect if classification or regression), data preprocessing, feature selection, model training, and deployment. In this paper, we detail the model training module. In order to select the computational technologies to be used in this module, we first analyzed the capabilities of an initial set of five modern AutoML tools: Auto-Keras, Auto-Sklearn, Auto-Weka, H2O AutoML, and TransmogrifAI. Then, we performed a benchmarking of the only two tools that address distributed ML (H2O AutoML and TransmogrifAI). Several comparison experiments were held using three real-world datasets from the telecommunications domain (churn, event forecasting, and fraud detection), allowing us to measure the computational effort and predictive capability of the AutoML tools.

Software libraries allow developers to create software projects upon basic functions already implemented. In this way, it is possible to focus on more complex activities to achieve the software solution aims. Software libraries features and availability on the Internet are the reason for these valuable project resources are widely used. However, there may be some issues in software projects that integrate several libraries, since they are independent projects that must work together. This paper presents LibViews, an information visualization application to create visual representations over libraries metrics and usage on software projects. LibViews was developed to provide a better understanding of libraries versions and their role in software projects, helping in the maintenance of these projects identifying previously unknown information. As use case, LibViews was applied in an university corporate software project, pointing out as a useful tool to understand the relationship between software project and its third-party libraries.