Applying Software Quality in Use Standards to Improve Scientific Software Selection

Yvette D. Hastings; Ann Marie Reinhold

Authors

Yvette D. Hastings Gianforte School of Computing, Montana State University
Ann Marie Reinhold Gianforte School of Computing, Montana State University

Keywords:

ISO 25010: Quality in Use Model, software quality, soil process models, CLM, DSSAT, HYDRUS-1D

Abstract

Across scientific domains, researchers are challenged by the process of selecting suitable modeling software. These challenges are particularly numerous in the earth sciences, arising from selecting software based on a few of the myriad complex earth system processes and wide availability of modeling software. Earth scientists lack a framework to guide scientific software selection. In this paper, we operationalize a framework based on the Quality in Use Model, as codified by the International Organization for Standardization (ISO) 25010 standard, to identify and create metrics to assess software that is used to simulate a subset of earth science processes known as soil processes. We applied this framework to assess software for three highly cited soil process models: Community Land Model (CLM), Decision Support System for Agrotechnology Transfer (DSSAT), and HYDRUS-1D. DSSAT scored the highest for the Quality in Use Model metrics, followed by HYDRUS-1D and CLM. This study is the first of its kind to apply the ISO 25010 Product Quality Model to a class of modeling software in the earth sciences, and its application shows promise for streamlining software selection.

References

L. Li et al., “Expanding the role of reactive transport models in critical zone processes,” Earth-Science Reviews, vol. 165. Elsevier B.V., pp. 280–301, Feb. 01, 2017. doi: 10.1016/j.earscirev.2016.09.001.

C. I. Steefel, D. J. DePaolo, and P. C. Lichtner, “Reactive transport modeling: An essential tool and a new research approach for the Earth sciences,” Earth Planet Sci Lett, vol. 240, no. 3–4, pp. 539–558, Dec. 2005, doi: 10.1016/j.epsl.2005.09.017.

H. Vereecken et al., “Modeling Soil Processes: Review, Key Challenges, and New Perspectives,” Vadose Zone Journal, vol. 15, no. 5, p. vzj2015.09.0131, May 2016, doi: 10.2136/vzj2015.09.0131.

J. Carrera, M. W. Saaltink, J. Soler-Sagarra, W. Jingjing, and C. Valhondo, “Reactive Transport: A Review of Basic Concepts with Emphasis on Biochemical Processes,” Energies (Basel), vol. 15, no. 3, Feb. 2022, doi: 10.3390/en15030925.

C. I. Steefel, S. B. Yabusaki, and K. U. Mayer, “Reactive transport benchmarks for subsurface environmental simulation,” Computational Geosciences, vol. 19, no. 3. Kluwer Academic Publishers, pp. 439–443, Jun. 27, 2015. doi: 10.1007/s10596-015-9499-2.

D. Wang et al., “A scientific function test framework for modular environmental model development: Application to the community land model,” in Proceedings - 2015 International Workshop on Software Engineering for High Performance Computing in Science, SE4HPCS 2015, Institute of Electrical and Electronics Engineers Inc., Jul. 2015, pp. 16–23. doi: 10.1109/SE4HPCS.2015.10.

F. J. R. Meysman, J. J. Middelburg, P. M. J. Herman, and C. H. R. Heip, “Reactive transport in surface sediments. I. Model complexity and software quality,” Comput Geosci, vol. 29, no. 3, pp. 291–300, 2003, doi: 10.1016/S0098-3004(03)00006-2.

“How to choose reactive transport modeling software.” ResearchGate.net. https://www.researchgate.net/post/How_to_choose_Reactive_Transport_Modeling_software (accessed May 05, 2023).

Systems and software engineering-Systems and software Quality Requirements and Evaluation (SQuaRE)-System and software quality models, ISO/IEC FDIS 25010:2010(E), International Organization for Standardization, Geneva, CH, 2010.

National Center for Atmospheric Research. “CESM Quickstart Guide (CESM2.1).” CESM2. https://escomp.github.io/CESM/versions/cesm2.1/html/ (accessed Jun. 04, 2023).

CESM. (v2.1.3), National Center for Atmospheric Research. Accessed: June 8, 2023. [Online]. Available: https://www.cesm.ucar.edu/models

National Center for Atmospheric Research. “Welcome to the CESM Tutorial.” https://ncar.github.io/CESM-Tutorial/README.html (accessed Jun. 25, 2023).

J. W. Jones et al., “DSSAT Cropping System Model,” European Journal of Agronomy, vol. 18, pp. 235–265, 2003, doi: 10.1016/S1161-0301(02)00107-7.

G. Hoogenboom et al., “Advances in crop modeling for a sustainable agriculture,” The DSSAT crop modeling ecosystem, pp. 173–216, 2019, doi: 10.19103/AS.2019.0061.10.

G. Hoogenboom et al., “Decision Support System for Agrotechnology Transfer (DSSAT) Version 4.8,” 2021. DSSAT.net

DSSAT. (v4.8.0.0), DSSAT Foundation, Inc. Accessed: June 8, 2023. [Online]. Available: dssat.net

HYDRUS-1D. (v4.17.0140), PC-Progress s.r.o. Accessed: May 31, 2023. [Online]. Available: https://www.pc-progress.com/en/Default.aspx?H1d-downloads

“Hydrus-1D Tutorial Book.” PC-Progress. https://www.pc-progress.com/en/Default.aspx?h1d-tutorials (accessed May 31, 2023).

“CLM Google Scholar Results.” Internet Archive WaybackMachine. https://web.archive.org/web/20230523152409/https://scholar.google.com/scholar?hl=en&as_sdt=0%2C27&q=Community+Land+Model+%28CLM%29&btnG= (accessed May 23, 2023).

“DSSAT Google Scholar Results.” Internet Archive WaybackMachine. https://web.archive.org/web/20230523151936/https://scholar.google.com/scholar?hl=en&as_sdt=0%2C27&q=%22DSSAT%22&btnG= (accessed May 23, 2023).

“HYDRUS 1D Google Scholar Results.” Internet Archive WaybackMachine. . https://web.archive.org/web/20230523153823/https://scholar.google.com/scholar?hl=en&as_sdt=0%2C27&q=%22HYDRUS+1D%22&btnG= (accessed May 23, 2023).

P. D. Alderman, “A comprehensive R interface for the DSSAT Cropping Systems Model,” Comput Electron Agric, vol. 172, May 2020, doi: 10.1016/j.compag.2020.105325.

Applying Software Quality in Use Standards to Improve Scientific Software Selection

Authors

Keywords:

Abstract

References

Downloads

Published

Issue

Section

License