Repository navigation
Identification: the constant of [GK16, Proposition 12] depends on δ - #17
Merged
Merged
Conversation
Layer 4.2 asks for C(α, K, δ) with log C = O(log log(1/δ)): no constant independent of δ works, and the paper's proof drops the δ in log² (C t^α / δ) when it chooses C. Layer 4.4 allows thresholds log(1/δ) + g(δ) + f(t) with g(δ) = o(log(1/δ)), so that the thresholds of Layer 4.2 are cases of it. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_0196ftMToRcTS8JUy4ChhSPh
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Layer 4.2 asks for the union-bound thresholds
log(C t^α / δ)of [GK16, Proposition 12] with an explicit constantC(α, K). No such constant exists:Chas to depend onδ. This amends the target, and Layer 4.4 so that the corrected thresholds are still covered by the sample-complexity bounds.Why. The proof of [GK16, Proposition 12] (Appendix C) bounds the probability of error by
∑_t e^{K+1} (β(t, δ)² log t / K)^K e^{-β(t, δ)}. Forβ(t, δ) = log(C t^α / δ)this is(δ / C) ∑_t (e^{K+1} / K^K) (log²(C t^α / δ) log t)^K / t^α. The condition the paper then puts onCuseslog²(C t^α), without theδ. The sum with theδgrows likelog(1/δ)^{2K}asδ → 0, so the argument gives aCof that order, that islog C = O(log log(1/δ)). This is erratum E2 of the paper project RemyDegenne/Garivier2016Optimal.Layer 4.4 stated its bounds for thresholds
β_t(h, δ) ≤ log(1/δ) + f(t), withf(t) = o(t). WithCdepending onδ, the Proposition 12 thresholds are no longer of that form. Neither are the other exponential-family thresholds of Layer 4.2: [KK21] haslog(1/δ) + O(log log(1/δ)), and [LS, Lemma 33.7] hasx_δ = (1 + o(1)) log(1/δ). Layer 5.2 asks for Track-and-Stop to beδ-PAC with the thresholds of Layer 4.2 and asymptotically optimal through Layer 4.4, which needs Layer 4.4 to cover them. The proof of [GK16, Theorem 14] goes through with an extra termg(δ) = o(log(1/δ)).Changes (only
LMLRoadmaps/Identification/README.md)C(α, K, δ)such thatlog C(α, K, δ) = O(log log(1/δ)). The item now says that noCindependent ofδworks, and where the paper's proof drops theδ.β_t(h, δ) ≤ log(1/δ) + g(δ) + f(t)withg(δ) = o(log(1/δ))andf(t) = o(t). The thresholds of item 2 andlog(r(t)/δ)withr(t) = O(t^α)are cases. LMLExplore'sIdentTask.eventually_expectedStoppingTime_glrt_leis the caseg = 0.Points to check
δworks is the code owner's assessment, made while checking the statements of the Garivier2016Optimal paper project. What a reader can check directly is the gap in the proof.log C = O(log log(1/δ))is what the paper's argument gives once theδis kept:Cof orderlog(1/δ)^{2K}. A sharper argument might give a smallerC; the target asks only for this order.IdentTask.eventually_expectedStoppingTime_glrt_lehas the narrowerg = 0form. This PR does not schedule its restatement inLMLRoadmaps/Generalization/; a companion PR can add that target.Suggested.leanis unchanged.Drafted with Claude Opus 5.5 at the request of the code owner.
🤖 Generated with Claude Code
https://claude.ai/code/session_0196ftMToRcTS8JUy4ChhSPh