Most organizations still face the common challenge of clearly establishing measurement and evaluation (ME) approaches for quality assurance programs. They could be successful if the resulting measurements and evaluations were well specified to ensure more consistent analysis and decision-making. A well-established ME approach might rely on sound conceptual bases. This paper discusses the main concepts, relationships, and axioms for the Measurement and Evaluation Top-Domain Ontology (MEvalTDO), which is located at the high-domain level in the context of a five-level ontological architecture. The scope of MEvalTDO is primarily intended to represent extensible concepts and relationships for ME activities, methods, and work products useful for carrying out evaluation projects and strategies. To illustrate the applicability of the MEvalTDO conceptualization, the reuse of its terms in specifications of activities, methods, artifacts, and outcomes included in evaluation strategies is shown. Reference is made to a set of evaluation strategies that can help achieve different goal purposes in projects already implemented.

This paper discusses the main concepts and relationships for the Non-Functional Requirements (NFRs) domain ontology, which is placed at the top-domain level in the framework of a five-level ontological architecture. In this (ontological) context, the term Non-Functional Requirement (NFR) does not model a particular thing (concrete entity), but rather a quality-, constraint-related assertion of a certain aspect of the thing to be evaluated. Also, an NFR as a human assertion can deal with a thing category as a universal abstraction. Thus, the quality aspect attributed, for example, to a particular thing (as a class or its individuals) can refer to its parts, such as the properties and/or capabilities of the entity, or the entity as a whole. To better understand the concepts and relationships of NFRs, a basic background in the semantics of the foundational concepts such as Thing, Thing Category, and Assertion is needed. Furthermore, to validate the applicability of the ontological conceptualization of NFRs, a set of typical cases for different practical situations is showcased.

In 2014, Rey Juan Carlos University (from Spain) has implemented the Service Science, Management and Engineering career. From the study conducted in 2016, the formulated hypothesis that the students' evidenced performance in the different modules of the career (i.e., Fundamentals, Technology, Personal Skills, Services and Companies) is affected by the secondary school modality of provenance. Aimed at monitoring the performance of first-year students of this career, in the present work we propose the use of a Holistic Evaluation Approach for Quality. This approach has a family of integrated evaluation strategies which allows achieving goals for diverse purposes such as to understand, compare, monitor, among others. In a nutshell, a strategy integrates a conceptual base with process and method specifications, which ensures that evaluation projects' results are consistent and comparable over time. Particularly, in this work, we use the monitoring strategy for understanding the performance of students, in the first year of the abovementioned career, from 2014 to 2017 period of time. The yielded outcomes will serve as a basis for the development of a predictive model. This will allow to the University to propose instruments aimed at improving the performance of students regarding the predominant modality of provenance.

Companies commonly establish and pursue business goals for different purposes. Many purposes, such as to understand, improve, compare, monitor and control, among others, may be driven by measurement, evaluation and analysis activities. Different strategies can be used to help achieving goal purposes. A strategy defines a set of activities and methods related to nonfunctional requirements, measurement, evaluation, analysis and eventually change. The analysis activity can use qualitative and quantitative data and information yielded by measurement and evaluation tasks. Regarding the intended purpose, a strategy should be tuned, particularly for the analysis activity in order to be useful as information need support for the given business goal. In this paper, we discuss the analysis activity for strategies regarding different evaluation purposes. Specifically, we illustrate the comparing and adopting strategy applied to four social network mobile apps. In addition, we highlight the particularities of its analysis activity in contrast to the one embraced in the monitoring and controlling strategy.

All organizations, both public and private should set goals or objectives at different organizational levels. So higher education institutions should not be the exception. A holistic evaluation approach can be useful for analyzing whether the pursued strategic or tactical objectives are achieved regarding different information needs at operational level. While teachers may aim at facilitating the learning process of all their students, department directors may need to understand the students' performance with the objective of planning extracurricular courses for helping them to improve their skills in specific areas. This paper illustrates a systematic strategy for evaluation and analysis which includes activities and methods for understanding the current situation of an entity in order to foster better decision making. Particularly, it is used to understand and analyze the students' performance in the Service Science, Management and Engineering career of a Spanish university considering the profile of provenance, i.e., the secondary school modality.

Each organization devoted to developing software/web applications should have as one of its ultimate goals to improve the quality in use of its products. In order to accomplish this, first it has to understand the quality of the current product version and then make appropriate changes to increase the quality of the new version if improvement actions were needed. For this purpose, we have developed a specific strategy called SIQinU (Strategy for understanding and Improving Quality in Use), which allows recognizing problems of quality in use through evaluation and proposes product improvements by understanding and making changes on product attributes. Hence by re-evaluating quality in use of the new version, improvement gains can be gauged. SIQinU is in alignment with GOCAME (Goal-Oriented Context-Aware Measurement and Evaluation), a multi-purpose generic strategy previously developed for measurement and evaluation which relies on: a conceptual framework (with ontological base), a process, and methods and tools. Since the process aspect is paramount in defining SIQinU - given the amount of phases and activities - in this paper we model the functional and behavioral process views illustrating them with excerpts of a real case study.