Repository navigation
feat: the logarithmic sum bound [MDJKLV21, Lemma 9] with the constant 3 - #293
Open
RemyDegenne wants to merge 1 commit into
Conversation
Co-Authored-By: Claude Code <noreply@github.com> Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
This branch has not been deployed
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
This PR adds the logarithmic sum bound of RF-Express [MDJKLV21, Lemma 9] to
LMLExplore/Analysis/SpecialFunctions/Log/Basic.lean. If0 ≤ u k ≤ max 1 (U k)for everyk < n, whereU k = ∑_{i < k} u i, then∑_{k < n} u k / max 1 (U k) ≤ 3 log (U n + 1)(Real.sum_div_max_one_le_three_mul_log).Real.sum_div_max_one_le_four_mul_logis the statement exactly as the roadmap and the source give it, foru k ∈ [0, 1]and with the constant4. The proof telescopes the one-step boundu / max 1 U ≤ 3 (log (U + u + 1) - log (U + 1)), which follows from1 - x⁻¹ ≤ log x(Mathlib'sReal.one_sub_inv_le_log_of_pos) together withU + u + 1 ≤ 3 max 1 U.Target: ReinforcementLearning, Layer 19.2 (RF-Express [MDJKLV21, Theorem 1]), tool bullet "$\sum_t u_{t+1}/\max(1,U_t)\le4\log(U_{T+1}+1)$ [MDJKLV21, Lemma 9]". On indexing: the source writes
U_t = ∑_{l=1}^t u_land sums overt = 0, …, T. Re-indexing from0(u k = u_{k+1},n = T + 1) gives exactly the Lean statement. I checked this against the text of Lemma 9 in arXiv:2007.13442. This is the version with the 0-based indices. The hypotheses are weakened fromu k ≤ 1tou k ≤ max 1 (U k), the same hypotheses as the neighbouring doubling boundReal.sum_div_sqrt_max_one_le(LMLExplore/Analysis/Real/Sqrt.lean), and the same proof gives the constant3. The one-step bound isprivate, as in that sibling. I add the new statements at the end of the file and at the end of its docstring list, so they don't overlap with the edits that the open PR #287 makes to the same file.After this PR, the last open tools of Layer 19.2 are in open PRs: counts versus pseudo-counts in #292, the KL-to-Bernstein transport and variance transfers in #291, and the implicit-inequality inversion in #287. What remains for the milestone is the RF-Express algorithm itself, on the Layer 7.7 and Layer 14 infrastructure (
statesEnv, episodic counts and stream models), and its PAC and sample-complexity theorems.Source: this is adapted from the paper project RemyDegenne/Essakine2026Tight at commit 9c77165d56f81c1db7a9835068356bb14886a3be (Apache 2.0), file
Essakine2026Tight/ForLMLExplore/Analysis/SpecialFunctions/Log/Basic.lean(Real.sum_div_max_one_le_three_mul_log,Real.sum_div_max_one_le_four_mul_log, stated there foru k ∈ [0, 1]). The paper is [EV26, Lemma 28], and the constant3follows that project'snotes/paper-errata.mdE19. The code credits the source and its reference [MDJKLV21]. No public declaration is removed or renamed.Roadmap: ReinforcementLearning
Paper: RemyDegenne/Essakine2026Tight
Item: R25
🤖 Prepared with Claude Code