arXiv:2608.06155v1

Verifiable Regularity Criterion for Conditional Expectation Operators and Conditional Mean Embeddings with Applications to Nonparametric Regression, Bayesian Inverse Problems, and Koopman Operators

Maximiliano Hertel, Ilja Klebanov, Manuel Schaller, Karl Worthmann

math.DScs.LGmath.NAmath.STstat.ML47B1037A3046E2245P0562G0862F15

Abstract

Conditional expectation operators (CEOs) and their associated conditional mean embeddings (CMEs) play a central role across applied mathematics and machine learning, appearing in nonparametric regression, Bayesian inverse problems, and Koopman operator theory. A fundamental question is when a CEO maps a function space on Y\mathcal{Y} into a prescribed function space on X\mathcal{X}, particularly a reproducing kernel Hilbert space (RKHS). We show that such mapping properties are characterized by the regularity of the Radon--Nikodym density of the conditional law, and establish a simple, verifiable sufficient condition under which the CEO is bounded and Hilbert--Schmidt. For RKHSs norm-equivalent to Sobolev spaces, this condition reduces to Sobolev regularity of the conditional density. The result yields a direct route to validate CME representations and error bounds for Galerkin-type and CME-based estimators. We verify the regularity condition in three settings: nonparametric regression, Bayesian inverse problems, and Koopman operator theory for stochastic dynamical systems. We show in each case that classical regularity results on the underlying probabilistic model imply the required mapping properties. The resulting framework offers a unified perspective on conditional expectation operators across probability, operator theory, kernel methods, and stochastic dynamics.

AI-generated audit

Audit summary

Audited against arXiv v1

Not a correctness certificate. A “Correct” result may include yellow typos or minor formal corrections that do not affect substantive soundness. It means this audit found no unresolved substantive error under the stated criteria; it does not replace expert scrutiny or formal verification.

Current report

Detailed mathematical audit

Generated August 18, 2026
01Statements4 reported findingsContains unsupported statements

The Hilbert--Schmidt regularity criterion, the abstract projection-error bounds, and the three application theorems are verified. The general learning-rate theorem is also verified under its explicit covariance-eigenvalue hypothesis. Its final claim that the Sobolev setting automatically gives the exponent p=d/(2)p=d/(2\ell) is not established for an arbitrary input law PXP_X: the proof substitutes approximation numbers for the Lebesgue embedding into an operator whose codomain is L2(PX)L^2(P_X).

Theorem 3.3 and Corollary 3.8Correct

Regular conditional densities yield Hilbert--Schmidt CEOs and CMEs

Pages 7–11 · Proposition 3.1, Theorem 3.3, and Corollary 3.8 · arXiv:2608.06155v1

If pXY(y)p_{X\mid Y}(\cdot\mid y) belongs to HkX\mathcal H_{k_X} for almost every yy and its squared RKHS norm is integrable, the Bochner kernel ypXY(y)y\mapsto p_{X\mid Y}(\cdot\mid y) lies in L2(PY;HkX)L^2(P_Y;\mathcal H_{k_X}). Proposition 3.1 therefore gives a Hilbert--Schmidt integral operator. The conditional-expectation identity verifies that this operator is the CEO, and applying it to kY(,y)k_Y(\cdot,y) gives the stated CME representation. The boundedness, compactness, and trace-class consequences follow from standard Hilbert--Schmidt operator identities.

Theorem 3.12 and the general part of Theorem 3.16Correct

Projection and learning rates under an assumed eigenvalue bound

Pages 12–17 · Theorems 3.12 and 3.16 · arXiv:2608.06155v1

The range condition ran(U)ran(CXXα/2)\operatorname{ran}(U)\subseteq\operatorname{ran}(C_{XX}^{\alpha/2}) gives the required factorization through the fractional covariance power. The projection residual is then controlled by the corresponding power-function or interpolation estimate. Under the separately stated decay λj(CXX)cj1/p\lambda_j(C_{XX})\leq c j^{-1/p}, the effective-dimension calculation and the sampling estimate yield the displayed rate after the chosen regularization balance. These conclusions do not depend on the automatic Sobolev-exponent clause discussed separately below.

Theorem 3.16, final Sobolev clauseNot able to verify

The exponent p=d/(2)p=d/(2\ell) is not automatic for an arbitrary input distribution

Pages 16–17 · final paragraph of Theorem 3.16 and its proof · arXiv:2608.06155v1

The theorem assumes only that HkXH(X)\mathcal H_{k_X}\simeq H^\ell(\mathcal X) on a bounded Lipschitz domain and then states that the covariance eigenvalues satisfy λjj2/d\lambda_j\asymp j^{-2\ell/d}. But CXX=EPXEPXC_{XX}=E_{P_X}^*E_{P_X}, where EPX:H(X)L2(PX)E_{P_X}:H^\ell(\mathcal X)\to L^2(P_X) is the embedding determined by the arbitrary probability law PXP_X. The proof cites the classical approximation-number rate for H(X)L2(X)H^\ell(\mathcal X)\to L^2(\mathcal X) with Lebesgue measure and does not supply a comparison between these two codomains. Consequently the claimed automatic exponent, and hence the unconditional specialization of the learning rate, is not verified under the printed assumptions. A verified sufficient repair for the upper eigenvalue bound actually used in the rate is to assume PXP_X has an essentially bounded density with respect to Lebesgue measure; a two-sided \asymp claim additionally needs an appropriate lower comparison. No counterexample to the learning-rate conclusion itself is asserted.

Theorems 4.2, 4.5, and 4.11Correct

Regression, Bayesian inverse, and elliptic-diffusion verification results

Pages 18–32 · Section 4 · arXiv:2608.06155v1

In the regression and Bayesian settings, the stated differentiability and integrability hypotheses permit the required Sobolev estimates for the conditional density. For the uniformly elliptic diffusion, the cited transition-density regularity and the compact-state-space bounds give the required square-integrable Sobolev norm. Substitution into Theorem 3.3 then yields the advertised Hilbert--Schmidt CEO and CME conclusions in each application.

02Proofs5 reported findingsContains incorrect or incomplete proofs

The core conditional-density, projection, and application proofs are correct and complete. The final Sobolev-rate specialization contains an unresolved change from L2(PX)L^2(P_X) to Lebesgue L2L^2, so that portion of Theorem 3.16 is incomplete. The finite-sample projection formulas also print ordinary inverses where the already-defined Moore--Penrose pseudoinverse is required; this is a harmless notation typo.

Proposition 3.1, Theorem 3.3, and Corollary 3.8Correct and complete

Hilbert--Schmidt kernel and conditional-expectation argument

Pages 7–11 · Section 3.1 · arXiv:2608.06155v1

The paper verifies strong measurability and square integrability of the Hilbert-space-valued density kernel, identifies its integral operator with conditional expectation by testing against functions of YY, and then evaluates the operator on kernel sections. The norm and trace identities used downstream are valid for a Hilbert--Schmidt operator.

Theorem 3.12Correct and complete

Fractional-range factorization and Galerkin error estimate

Pages 12–15 · Theorem 3.12 and proof · arXiv:2608.06155v1

The Douglas-type range factorization, spectral calculus for CXXC_{XX}, and projection-residual estimate are applied with compatible domains. The separate regularity regimes in the theorem match the exponents used in the interpolation bounds, and the finite-rank estimator inherits the displayed operator-norm control.

Theorem 3.16, Sobolev specializationIncomplete as written

Lebesgue approximation numbers are used for an L2(PX)L^2(P_X) embedding

Pages 16–17 · last step of the proof of Theorem 3.16 · arXiv:2608.06155v1

For the covariance operator, the relevant singular values are those of EPX:H(X)L2(PX)E_{P_X}:H^\ell(\mathcal X)\to L^2(P_X). The proof instead invokes aj(H(X)L2(X))j/da_j(H^\ell(\mathcal X)\hookrightarrow L^2(\mathcal X))\asymp j^{-\ell/d} and immediately concludes λj(CXX)j2/d\lambda_j(C_{XX})\asymp j^{-2\ell/d}. Without a measure-comparison hypothesis this does not follow. Downstream dependency: only the final automatic choice p=d/(2)p=d/(2\ell) and its specialized rate; the theorem under an assumed covariance-eigenvalue bound remains verified. Repair classification: verified sufficient repair for the needed upper bound. Add dPX/dxL(X)dP_X/dx\in L^\infty(\mathcal X), so fL2(PX)dPX/dx1/2fL2(dx)\|f\|_{L^2(P_X)}\leq\|dP_X/dx\|_\infty^{1/2}\|f\|_{L^2(dx)} and the approximation-number upper rate transfers. Require a corresponding lower density bound if retaining the printed two-sided equivalence.

Notation 3.10 and finite-sample formulasTypo

Gram-matrix inverses should be pseudoinverses

Pages 12–14 · Notation 3.10, Table 1, and the displayed empirical projection formulas · arXiv:2608.06155v1

The points are not assumed distinct and the kernels are not assumed strictly positive definite, so GXXG_{XX} and GYYG_{YY} need not be invertible. The paper has already defined the Moore--Penrose pseudoinverse. Replace GXX1G_{XX}^{-1} and GYY1G_{YY}^{-1} in these projection formulas by GXXG_{XX}^{\dagger} and GYYG_{YY}^{\dagger}. This is the standard orthogonal-projection formula and leaves every abstract result unchanged.

Section 4Correct and complete

Verification of the regularity hypotheses in the three applications

Pages 18–32 · proofs of Theorems 4.2, 4.5, and 4.11 · arXiv:2608.06155v1

Each application derives the claimed conditional-density regularity from its explicit model assumptions, checks the needed integrability uniformly over the conditioning variable, and then invokes the abstract criterion with matching RKHS/Sobolev norms. No missing case or unsupported implication was found in these proof chains.

03Novelty0 reported findingsNo non-novelty findings

No non-novelty findings.

Detailed audit reportFull reasoning, manuscript locations, and references.
Open report PDF ↗

Author response

Challenge an audit finding

Local workflow preview

A listed author may submit formal evidence that an audit is inaccurate. The response would be considered in a fresh AI re-evaluation; it would not edit the audit automatically.

Paper
arXiv:2608.06155v1
Authors listed
Maximiliano Hertel, Ilja Klebanov, Manuel Schaller, Karl Worthmann
Audit date
August 18, 2026
  1. 01Establish identityMatch an authenticated scholarly identity to this paper.
  2. 02Submit evidenceIdentify the finding and give a formal mathematical response.
  3. 03Re-evaluateA separate agent checks the response and records a disposition.
Recommended production method

Authenticate with ORCID, then require an exact arXiv match

MathAudit should accept the identity only when ORCID OAuth authenticates the claimant's iD and this exact arXiv paper appears in arXiv's public authority feed for that iD. A matching name alone is not sufficient.

ORCID OAuth and arXiv authority-record lookup are not connected in this local prototype.

Email fallback for papers without a linked ORCID

A production fallback could send a one-time link only when the submitted address matches an independently maintained author-contact allowlist for this paper. MathAudit must return the same message for every address so the form cannot reveal which contacts are on that list.

This demonstration does not send, store, or compare the address.

Structured response preview

This form remains unavailable until production identity verification succeeds. Nothing entered here is submitted.

This panel never establishes authorship in the local prototype. A production result should be described narrowly as an authenticated ORCID match or control of a separately allowlisted author-contact mailbox.