Exact solutions in log-concave maximum likelihood estimation

Alexandros Grosdos, Alexander Heaton, Kaie Kubjas*, Olga Kuznetsova, Georgy Scholten, Miruna Ştefana Sorea

*Corresponding author for this work

Research output: Contribution to journalArticleScientificpeer-review

1 Citation (Scopus)
125 Downloads (Pure)

Abstract

We study probability density functions that are log-concave. Despite the space of all such densities being infinite-dimensional, the maximum likelihood estimate is the exponential of a piecewise linear function determined by finitely many quantities, namely the function values, or heights, at the data points. We explore in what sense exact solutions to this problem are possible. First, we show that the heights given by the maximum likelihood estimate are generically transcendental. For a cell in one dimension, the maximum likelihood estimator is expressed in closed form using the generalized W-Lambert function. Even more, we show that finding the log-concave maximum likelihood estimate is equivalent to solving a collection of polynomial-exponential systems of a special form. Even in the case of two equations, very little is known about solutions to these systems. As an alternative, we use Smale's α-theory to refine approximate numerical solutions and to certify solutions to log-concave density estimation.

Original languageEnglish
Article number102448
Pages (from-to)1-32
Number of pages32
JournalAdvances in Applied Mathematics
Volume143
DOIs
Publication statusPublished - Feb 2023
MoE publication typeA1 Journal article-refereed

Keywords

  • Certified solutions
  • Lambert functions
  • Log-concavity
  • Maximum likelihood estimation
  • Polyhedral subdivisions
  • Polynomial-exponential systems
  • Smale's α-theory
  • Transcendence theory

Fingerprint

Dive into the research topics of 'Exact solutions in log-concave maximum likelihood estimation'. Together they form a unique fingerprint.

Cite this