Repository navigation
feat: the numeraire of two exponential or geometric observations against a common parameter - #439
Open
RemyDegenne wants to merge 1 commit into
Open
RemyDegenne wants to merge 1 commit into
RemyDegenne wants to merge 1 commit into
Conversation
…nst a common parameter For a statistic whose conditional law given it is the same kernel under every member of the null, the likelihood ratio of the alternative to the law with its law of the statistic and that conditional law is an e-variable, and the numeraire when that law is in the effective null. For two exponential observations and the null of the products Exp(l) ⊗ Exp(l), this law (the sum under the alternative, then the first observation uniform on [0, s]) is the reverse information projection, the mixture of the members of the null whose mean is uniform between the two means, and no finite combination of members of the null; the same construction gives the numeraire for two geometric observations. EValues roadmap, Layer 1, item 5. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_0196ftMVbgjSJzPQEwdek3kM
This branch has not been deployed
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
This pull request proves the instance "two samples with a common nuisance parameter" of the exponential-families item of the EValues roadmap: for two independent exponential observations and the null of the products
Exp(l) ⊗ Exp(l), the numeraire is the likelihood ratio of the alternative to the law under which the sum has its law under the alternative and, given the sums, the first observation is uniform on[0, s]; that law is the reverse information projection, the mixture of the members of the null whose mean is uniform between the two means, and no finite combination of members of the null; the same construction gives the numeraire for two geometric observations. It adds three new files,LMLExplore/EValues/Numeraire/Conditional.lean(133 lines, the general conditional e-variable, shared by the two instances),LMLExplore/EValues/TwoSample/Exponential.lean(580 lines) andLMLExplore/EValues/TwoSample/Geometric.lean(392 lines), and changes no existing file.Main declarations
General (
Numeraire/Conditional.lean), for a measurable statisticT : Ω → 𝓨, a finite kernelκ : Kernel 𝓨 Ωwithκ ycarried byT ⁻¹' {y}forQ.map T-almost everyy, and a finite measureQwithQ ≪ κ ∘ₘ Q.map T:map_comp_eq_of_ae_eq: for a Markov kernel carried by the fibers,(κ ∘ₘ ν).map T = ν.ae_lintegral_rnDeriv_comp_map_eq_one:∫⁻ x, Q.rnDeriv (κ ∘ₘ Q.map T) x ∂κ y = 1forQ.map T-almost everyy.lintegral_rnDeriv_comp_map,isEVar_rnDeriv_comp_map: under everyPwithκ ∘ₘ P.map T = PandP.map T ≪ Q.map T, the likelihood ratioQ.rnDeriv (κ ∘ₘ Q.map T)has expectationP univ; so it is an e-variable for every null of finite measures of whichκis the conditional law givenT(the conditional e-variable of [HGLLA24]).Two exponential observations (
TwoSample/Exponential.lean), withQ = (expMeasure l₁).prod (expMeasure l₂)and the nullSet.range fun l : Ioi (0 : ℝ) ↦ (expMeasure l).prod (expMeasure l):Kernel.segmentUniform : Kernel ℝ (ℝ × ℝ), the law of(u * s, (1 - u) * s)foruuniform on[0, 1](Tau Ceti'suniformMeasure 0 1), withKernel.isMarkovKernel_segmentUniform,Kernel.segmentUniform_apply,Kernel.segmentUniform_compandKernel.ae_add_segmentUniform.isNumeraire_rnDeriv_segmentUniform_comp(0 < l₁,0 < l₂):IsNumeraire (Q.rnDeriv (Kernel.segmentUniform ∘ₘ Q.map (fun x ↦ x.1 + x.2))) S Q.ripr_prod_expMeasure(0 < l₁,0 < l₂):ripr Q S = Kernel.segmentUniform ∘ₘ Q.map (fun x ↦ x.1 + x.2).segmentUniform_comp_map_add_prod_expMeasure(0 < l₁,0 < l₂,l₁ ≠ l₂):Kernel.segmentUniform ∘ₘ Q.map (fun x ↦ x.1 + x.2) = (uniformMeasure (min l₁⁻¹ l₂⁻¹) (max l₁⁻¹ l₂⁻¹)).bind fun m ↦ (expMeasure m⁻¹).prod (expMeasure m⁻¹).sum_smul_prod_expMeasure_ne_ripr(0 < l₁,0 < l₂,l₁ ≠ l₂):∑ l ∈ s, w l • (expMeasure l).prod (expMeasure l) ≠ ripr Q Sfor everys : Finset ℝandw : ℝ → ℝ≥0∞.Two geometric observations (
TwoSample/Geometric.lean), with Mathlib'sgeometricMeasureand the nullSet.range fun p : unitInterval ↦ (geometricMeasure p).prod (geometricMeasure p):Kernel.antidiagonalUniform : Kernel ℕ (ℕ × ℕ), the uniform law (uniformOn) on the pairs(j, k)withj + k = s, withKernel.antidiagonalUniform_apply,Kernel.isMarkovKernel_antidiagonalUniform,Kernel.antidiagonalUniform_singletonandKernel.ae_add_antidiagonalUniform.isNumeraire_rnDeriv_antidiagonalUniform_comp((p₁ ≠ 0 ∧ p₁ ≠ 1) ∨ (p₂ ≠ 0 ∧ p₂ ≠ 1)): the likelihood ratio ofGeom(p₁) ⊗ Geom(p₂)toKernel.antidiagonalUniform ∘ₘ Q.map (fun x ↦ x.1 + x.2)is the numeraire.Roadmap coverage (EValues, Layer 1, item 5)
Covered: the bullet "Instance, two samples with a common nuisance parameter [HGLLA24]", that is, the numeraire for two exponential observations, the identification of the law as the reverse information projection, its description as the mixture of the members of the null whose mean
1 / lis uniform between1 / l₁and1 / l₂, the fact that no finite combination of members of the null is equal to it (against the conjecture of [HGLLA24, §5.2]), and the numeraire for two geometric observations with the uniform law on{0, …, s}.Left: the rest of item 5 (the mean-value parametrization of vector exponential families, the equivalences of [GLHBdJ24, Theorem 1], and the Gaussian scale instance).
Notes for reviewers
X = Q.rnDeriv (κ ∘ₘ Q.map T)integrates to one againstκ yforQ.map T-almost everyy, by comparing(Q.map T).withDensity (fun y ↦ ∫⁻ X ∂κ y)withQ.map Ton every set; under a memberP = κ ∘ₘ P.map Tof the null this gives∫⁻ X ∂P = P univ. The numeraire then comes from main'sisNumeraire_of_ae_eq_rnDeriv([LRR25, Theorem 4.1]) and the reverse information projection fromripr_eq_of_isEVar_rnDeriv, once the law is in the effective null (comp_mem_effectiveSet, as a mixture of members of the null).Kernel.segmentUniformgiven the sum, and that the sum has the lawGamma(2, l), is Tau Ceti's beta–gamma algebra (map_div_add_prod_gammaMeasure,betaMeasure_one_one). The law of the sum underQis Tau Ceti'shypoexponentialMeasure ![l₁, l₂], whose densityl₁ l₂ (exp (- l₁ x) - exp (- l₂ x)) / (l₂ - l₁)is computed byhypoexponentialPDFReal_of_injective; the mixture of theGamma(2, 1 / m)over the uniform mean has the same density (Tau Ceti'sMeasure.bind_withDensityand the antiderivativeexp (- x / m)), and the mixture identity in the plane follows by associativity of the composition withKernel.segmentUniform. The equivalencesQ ≪ Qᶜ ≪ Qand the absolute continuity of the laws of the sum need no density: every product of exponential laws with positive rates is equivalent toExp(1) ⊗ Exp(1), which is its ownQᶜ. For the last statement, a finite combination equal to the reverse information projection would give the law of the sum the density∑ w l * l ^ 2 * x * exp (- l x); comparing withexp (- min l₁ l₂ * x)at infinity shows that the terms withl ≤ min l₁ l₂vanish and that the other ones decay too fast.Geom(p) ⊗ Geom(p)depend only on the sum, which gives the conditional law; the mixture overmuniform between1 / p₁and1 / p₂of the lawsGeom(1 / m) ⊗ Geom(1 / m)(the meanm - 1uniform between the two means) is computed on points through the antiderivative(1 - 1 / m) ^ (s + 1) / (s + 1), and is private.[EVR26, Note 28]. The proofs are new; they replace the paper project's direct optimality argument by the effective-null criterion, and its uniqueness of the mixing law (through moment-generating functions) by the asymptotic argument above, which is all the roadmap's statement needs.l₁ = l₂included (thenQis in the null and is its ownQᶜ); only the mixture and the last statement needl₁ ≠ l₂. The geometric statement assumes that one of the two laws is not a point mass,(p₁ ≠ 0 ∧ p₁ ≠ 1) ∨ (p₂ ≠ 0 ∧ p₂ ≠ 1)(Mathlib'sgeometricMeasure 0is the point mass at0, as isgeometricMeasure 1): whenQis the point mass at(0, 0),Q.rnDerivis not determined off(0, 0)and need not be an e-variable. The geometric reverse information projection is not stated (the roadmap asks only for the numeraire; it differs from the law above when one of the laws is a point mass). The "law under which the sum has its law under the alternative and, given the sum, the first observation is uniform" is writtenκ ∘ₘ Q.map (fun x ↦ x.1 + x.2)with the kernelsKernel.segmentUniformandKernel.antidiagonalUniform.SFinite (expMeasure l)(Mathlib has none;inferInstanceAsthroughgammaMeasure 1 l).LMLExplore/MeasureTheory/Constructions/Pi.lean; none of them is needed here. The branch is on top of feat: identifying numeraires through the effective null #410 (merged), whoseisNumeraire_of_ae_eq_rnDerivandripr_eq_of_isEVar_rnDerivit uses.Roadmap: EValues
Paper: RemyDegenne/evalues_research
Item: R31
🤖 Generated with Claude Code
https://claude.ai/code/session_0196ftMVbgjSJzPQEwdek3kM