Tool-based Support for the FAIR Principles for Control Theoretic Results: The 'Automatic Control Knowledge Repository'

Carsten Knoll; Robert Heedt

doi:10.52846/stccj.2021.1.1.11

Authors

Carsten Knoll TU Dresden
Robert Heedt

DOI:

https://doi.org/10.52846/stccj.2021.1.1.11

Keywords:

computational methods in control theory, test driven development, semantic technology, computational ontology, reproducibility, FAIR principles

Abstract

In 2016 a collection of guiding principles for the management of scientific data was proposed by a consortium of scientists and organizations under the acronym FAIR (Findability, Accessibility, Interoperability, Reusability). As many other disciplines, control theory also is affected by the (mostly unintended) disregard of these principles and to some degree also suffers from a reproducibility crisis. The specific situation for that discipline, however, is more related to software, than to classical numerical data. In particular, since computational methods like simulation, numeric approximation or computer algebra play an important role, the reproducibility of results relies on implementation details, which are typically out of scope for written papers.
While some publications do reference the source code of the respective software, this is by far not standard in industry and academia. Additionally, having access to the source code does not imply reproducibility due to dependency issues w. r. t. hardware and software components. This paper proposes a tool based approach consisting of four components to mitigate the problem: a) an open repository with a suitable data structure to publish formal problem specifications and problem solutions (each represented as source code) along with descriptive metadata, b) a web service that automatically checks the solution methods against the problem specifications and auxiliary software for local testing, c) a computational ontology which allows for semantic tagging and sophisticated querying the entities in the repo and d) a peer-oriented process scheme to organize both the contribution process to that repository and formal quality assurance.

References

J. F. Claerbout and M. Karrenbach. “Electronic Documents Give Reproducible Research a New Meaning”. In: SEG Technical Program Expanded Abstracts 1992. Society of Exploration Geophysicists, 1992, pp. 601–604.

D. L. Donoho, A. Maleki, I. U. Rahman, M. Shahram, and V. Stodden. “Reproducible Research in Computational Harmonic Analysis”. In: Computing in Science Engineering Vol. 11 (2009), pp. 8–18.

R. R. Downs, W. C. Lenhardt, E. Robinson, E. Davis, and N. Weber. “Community Recommendations for Sustainable Scientific Software”. In: Journal of Open Research Software Vol. 3 (2015), e11.

“Devil in the Details (Editorial)”. In: Nature Vol. 470 (2011), pp. 305–306.

Z. Merali. “Computational Science: ...Error”. In: Nature Vol. 467 (2010), pp. 775–777.

A. Morin et al. “Shining Light into Black Boxes”. In: Science Vol. 336 (2012), pp. 159–160.

N. P. Rougier et al. “Sustainable Computational Science: The ReScience Initiative”. In: PeerJ Computer Science Vol. 3 (2017), e142.

J. C. Molloy. “The Open Knowledge Foundation: Open Data Means Better Science”. In: PLOS Biology Vol. 9 (2011), e1001195.

O. J. Reichman, M. B. Jones, and M. P. Schildhauer. “Challenges and Opportunities of Open Data in Ecology”. In: Science Vol. 331 (2011), pp. 703–705.

V. Gewin. “Data Sharing: An Open Mind on Open Data”. In: Nature Vol. 529 (2016), pp. 117–119.

G. Boulton, M. Rawlins, P. Vallance, and M. Walport. “Science as a Public Enterprise: The Case for Open Data”. In: The Lancet Vol. 377 (2011), pp. 1633–1635.

B. Hanson, A. Sugden, and B. Alberts. “Making Data Maximally Available”. In: Science Vol. 331 (2011), pp. 649–649.

V. Stodden. “Trust Your Science?: Open You Data and Code”. In: AMSTAT news: the membership magazine of the American Statistical Association (2011), pp. 21–22.

D. C. Ince, L. Hatton, and J. Graham-Cumming. “The Case for Open Computer Programs”. In: Nature Vol. 482 (2012), pp. 485–488.

D. Bailey, J. Borwein, and V. Stodden. “Set the Default to ”Open””. In: Notices of the Ams, Accepted March (2013), p. 2013.

S. M. Easterbrook. “Open Code for Open Science?” In: Nature Geoscience Vol. 7 (11 2014), pp. 779–781.

L. A. Barba. “Praxis of reproducible computational science”. In: Computing in Science & Engineering Vol. 21.1 (2019), pp. 73–78.

F. Chirigati, R. Rampin, D. Shasha, and J. Freire. “ReproZip: Computational Reproducibility With Ease”. In: Proceedings of the 2016 International Conference on Management of Data. SIGMOD ’16. San Francisco, California, USA: Association for Computing Machinery, 2016, pp. 2085–2088.

T. Crick, B. Hall, and S. Ishtiaq. “Reproducibility in Research: Systems, Infrastructure, Culture”. In: Journal of Open Research Software Vol. 5 (1 2017), p. 32.

M. Krafczyk, A. Shi, A. Bhaskar, D. Marinov, and V. Stodden. “Scientific Tests and Continuous Integration Strategies to Enhance Reproducibility in the Scientific Software Context”. In: Proceedings of the 2nd International Workshop on Practical Reproducible Evaluation of Computer Systems. P-RECS ’19. Phoenix, AZ, USA: Association for Computing Machinery, 2019, pp. 23–28.

M. D. Wilkinson et al. “The FAIR Guiding Principles for scientific data management and stewardship”. In: Scientific data Vol. 3.1 (2016), pp. 1–9.

ACKRep Testing Instance. URL: http://testing.ackrep.org/.

C. Knoll and R. Heedt. “Automatic Control Knowledge Repository — A Computational Approach for Simpler and More Robust Reproducibility of Results in Control Theory”. In: Proc. of the 24th International Conference on System Theory, Control and Computing. IEEE. Sinaia, 2020.

R. C. Merkle. “Method of Providing Digital Signatures”. U.S. pat. Leland Stanford Junior University. 1982.

G. Fraser and J. M. Rojas. “Software Testing”. In: Handbook of Software Engineering. Ed. by S. Cha, R. N. Taylor, and K. Kang. Cham: Springer International Publishing, 2019.

N. Guarino, D. Oberle, and S. Staab. “What is an ontology?” In: Handbook on ontologies. Springer Berlin, 2009, pp. 1–17.

C. Dessimoz and N. ˇSkunca, eds. The Gene Ontology Handbook. Springer New York, 2017.

M. K. Bergman. Knowledge Representation Practionary. Springer, 2018.

M. Keet. An introduction to ontology engineering, v1.5. College Publications, 2020.

F. Baader, D. Calvanese, D. McGuinness, P. Patel- Schneider, D. Nardi, et al. The description logic handbook: Theory, implementation and applications. Cambridge university press, 2003.

M. Kr¨otzsch, M. Marx, A. Ozaki, and V. Thost. “Attributed description logics: Ontologies for knowledge graphs”. In: International Semantic Web Conference. Springer. 2017, pp. 418–435.

D. Vrandeˇci´c and M. Kr¨otzsch. “Wikidata: a free collaborative knowledgebase”. In: Communications of the ACM Vol. 57.10 (2014), pp. 78–85.

T. Berners-Lee, J. Hendler, and O. Lassila. “The semantic web”. In: Scientific american Vol. 284.5 (2001), pp. 34–43.

A. Patel and S. Jain. “Present and future of semantic web technologies: a research statement”. In: International Journal of Computers and Applications (2019), pp. 1–10.

C. Benavides, I. Garc´ıa, H. Alaiz, and L. Quesada. “An ontology-based approach to knowledge representation for Computer-Aided Control System Design”. In: Data & Knowledge Engineering Vol. 118 (2018), pp. 107–125.

R. Heedt, C. Knoll, and K. R¨obenack. “Formal Semantic Representation of Methods in Automatic Control”. In: Tagungsband VDI Mechatroniktagung. (in German). 2021.

C. Knoll and R. Heedt. ACKRep Data Repository on GitHub. URL: https://github.com/cknoll/ackrep data.

C. Lange. “Ontologies and languages for representing mathematical knowledge on the semantic web”. In: Semantic Web Vol. 4.2 (2013), pp. 119–158.

M. Kohlhase, T. Koprucki, D. M¨uller, and K. Tabelow. “Mathematical Models as Research Data via Flexiformal Theory Graphs”. In: Intelligent Computer Mathematics. Ed. by H. Geuvers, M. England, O. Hasan, F. Rabe, and O. Teschke. Cham: Springer International Publishing, 2017, pp. 224–238.

C. Knoll. yamlpyowl – a Python based YAML-to-OWLconverter. URL: https://github.com/cknoll/yamlpyowl.

J.-B. Lamy. “Owlready: Ontology-oriented programming in Python with automatic classification and high level constructs for biomedical ontologies”. In: Artificial intelligence in medicine Vol. 80 (2017), pp. 11–28.

C. Knoll, X. Jia, and R. Heedt. “Trajectory Planning for Closed Kinematic Chains Applied to Cooperative Motions in Health Care”. In: PAMM Vol. 20.1 (2021).