Mathematical Foundations

As the language of natural-scientific modeling, mathematics is also the language of probabilistic data science in psychology. In this role, mathematics mediates between intuitive scientific language and the variety of programming languages used to implement data-scientific analyses. Mathematical concept formation makes it possible to grasp concepts very precisely and in a generally understandable way, and to communicate them independently of the imprecision of everyday scientific language or the idiosyncrasies of different programming languages. Of course, mathematical language cannot assume this role detached from scientific-language intuition or practical application. In probabilistic data analysis, mathematics is therefore never an end in itself, but must always be understood as applied mathematics.

In this part, after some thoughts on the fundamental concepts of mathematics (1  Language and Logic), we present sets and functions (2  Sets and 4  Functions), the two pillars of modern mathematics, in compressed form. We supplement this presentation with some notational aspects in 3  Sums, Products, Powers. Closely interwoven with the concept of a function are differential calculus and integral calculus. Here, too, the aim is not an exhaustive presentation, but in particular an explanation of some foundations that are central to the data-scientific concepts of optimization and to working with probability functions. We supplement these sections with some introductory thoughts on the analytical foundations of differential and integral calculus. In dealing with the large data sets of contemporary science, matrix notation has proved useful. We first consider this subfield of linear algebra for single-column matrices and then for matrices in detail, again with the aim of providing notational and computational foundations for later sections.

Overall, this part therefore primarily serves as a brief introduction to foundations that will be taken up again in other parts, and in particular also as the introduction of a unified notation. Depending on need and interest, more in-depth self-study of the various contents is of course advisable. In the following literature notes, we provide an overview of sources and reading recommendations for the contents considered here.

Literature Notes

Bärwolff (2017) and Arens et al. (2018) form the primary basis for many of the topics presented here and offer an excellent and comprehensive entry point into the material covered. At the international level, Spivak (2008) and Strang (2009) provide very readable introductions to differential calculus and linear algebra, respectively. A deeper understanding, especially of analytical concepts, is provided, for example, by Abbott (2015) and Chiossi (2021). Searle (1982) offers a compact presentation of those aspects of matrix calculus and linear algebra that are used mainly in probabilistic data analysis. Deisenroth et al. (2020) provides an overview of many of the topics treated here under the moniker of machine learning.

Abbott, S. (2015). Understanding Analysis. Springer New York. https://doi.org/10.1007/978-1-4939-2712-8
Arens, T., Hettlich, F., Karpfinger, C., Kockelkorn, U., Lichtenegger, K., & Stachel, H. (2018). Mathematik. Springer Berlin Heidelberg. https://doi.org/10.1007/978-3-662-56741-8
Bärwolff, G. (2017). Höhere Mathematik für Naturwissenschaftler und Ingenieure. Springer Berlin Heidelberg. https://doi.org/10.1007/978-3-662-55022-9
Chiossi, S. G. (2021). Essential Mathematics for Undergraduates: A Guided Approach to Algebra, Geometry, Topology and Analysis. Springer International Publishing. https://doi.org/10.1007/978-3-030-87174-1
Deisenroth, M. P., Faisal, A. A., & Ong, C. S. (2020). Mathematics for Machine Learning (1st ed.). Cambridge University Press. https://doi.org/10.1017/9781108679930
Searle, S. (1982). Matrix Algebra Useful for Statistics. Wiley-Interscience.
Spivak, M. (2008). Calculus (4th ed.). Publish or Perish, Inc.
Strang, G. (2009). Introduction to Linear Algebra. Cambridge University Press.