Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
337 commits
Select commit Hold shift + click to select a range
4d109cc
fix(ui): keep alert badges whole and the history scrollable by keyboard
vishr Oct 31, 2026
f4a7a5f
fix(ui): give the query editors' placeholder AA contrast
vishr Oct 31, 2026
b58f2f7
perf(telemetry): keep each compaction inside one ingest hour
vishr Oct 31, 2026
a4e786e
fix(query): let schema discovery finish after its callers leave
vishr Oct 31, 2026
f45fed8
perf(query): sample attribute keys from 1,000 rows, read once
vishr Oct 31, 2026
f1b3f7e
fix(query): say which value form matches a mixed-type attribute
vishr Oct 31, 2026
6a44614
fix(fanql): give foreign forms exact hints and fix-its
vishr Oct 31, 2026
15826e5
fix(fanql): name field problems and offer the field a typo meant
vishr Oct 31, 2026
a3565a1
fix(fanql): rank and/or after a term and offer every column's values
vishr Oct 31, 2026
03dd980
fix(engine): narrow the service rollup window after it runs out of me…
vishr Oct 31, 2026
3167018
docs(api): describe schema_busy from the generator source
vishr Oct 31, 2026
3227ac6
chore(ui): rebuild embedded assets
vishr Oct 31, 2026
090346e
test(e2e): update trace baselines for the unitless duration header
vishr Oct 31, 2026
dd05a06
fix(query): stop schema discoveries when the executor closes
vishr Oct 31, 2026
5ce05db
fix(engine): grow the service rollup window only after committed passes
vishr Oct 31, 2026
503cc7c
perf(store): merge small settled hours across their day
vishr Oct 31, 2026
f9eca7f
fix(query): treat -k:* as one negated term on the traces list
vishr Oct 31, 2026
4999016
fix(ui): leave status and excluded terms out of span error rates
vishr Oct 31, 2026
ea349bd
fix(alert): keep a tick from evaluating a rule disabled mid-tick
vishr Oct 31, 2026
3bc4dc0
fix(alert): store episode starts in one sortable form
vishr Oct 31, 2026
b7f444e
fix(api): answer an unknown schema window with bad_request
vishr Oct 31, 2026
a06329b
fix(alerts): prune resolved alerts by instant, not by text
vishr Oct 31, 2026
43dd96c
test(store): count applied migrations from the migration files
vishr Oct 31, 2026
b6d9b8b
chore(ui): rebuild embedded assets
vishr Oct 31, 2026
577f8df
docs(storage): explain file-granular retention and day merges
vishr Oct 31, 2026
64e48aa
perf(query): read metrics once per metric panel
vishr Oct 31, 2026
fa331fb
fix(alert): keep each firing episode in history
vishr Nov 1, 2026
3a0afda
fix(query): report a panel whose measures are all null as empty
vishr Nov 1, 2026
7e22e2f
fix(ui): say the last run failed when the server refuses it
vishr Nov 1, 2026
7637730
fix(ui): focus the confirmation after restoring a version
vishr Nov 1, 2026
0978129
fix(ui): show Updated only when a panel ran
vishr Nov 1, 2026
bff32fb
fix(ui): show a running state in Explore and explain an empty run
vishr Nov 1, 2026
f6db31c
fix(ui): keep the Builder operator and completion details readable on…
vishr Nov 1, 2026
94ebd54
fix(ui): say that table rows without a trace_id list exemplar traces
vishr Nov 1, 2026
29afea1
fix(ui): read each duration axis in one unit
vishr Nov 1, 2026
0f60484
fix(ui): keep flame graph ticks on one line and fold extra services
vishr Nov 1, 2026
82e5a58
fix(query): label metric panels with the unit the metric reports
vishr Nov 1, 2026
7bc9f4a
fix(query): name duration as FanQL spells it in diagnoses
vishr Nov 1, 2026
0a6c54e
fix(query): read diagnosis values in one scan and suggest near misses
vishr Nov 1, 2026
6959c3d
fix(fanql): complete only the value forms rows store
vishr Nov 1, 2026
1c5a35c
fix(fanql): explain foreign queries, misspelled functions and metric …
vishr Nov 1, 2026
bbeebec
fix(ui): offer FanQL fix-its as buttons under the editor
vishr Nov 1, 2026
202b76c
fix(ui): keep Updated when a refresh is turned away for every panel
vishr Nov 1, 2026
01cad69
fix(ui): make the folded flame legend entry readable without a mouse
vishr Nov 1, 2026
83b7fd3
fix(ui): refocus every restore confirmation and announce it once
vishr Nov 1, 2026
f4fc866
fix(query): cache a metric's unit only when the window settles it
vishr Nov 1, 2026
7f217fc
fix(ui): give a traces table no click hint until its columns arrive
vishr Nov 1, 2026
88d3c29
fix(fanql): match the run's one-metric rule and keep where as an alias
vishr Nov 1, 2026
80bf758
fix(ui): keep FanQL notices to the text they describe
vishr Nov 1, 2026
b8b6fb4
fix(query): suggest near misses for names only, and bound the search
vishr Nov 1, 2026
4186867
chore(ui): rebuild embedded assets
vishr Nov 1, 2026
cf8885f
test(fanql): name the code-point span test plainly
vishr Nov 1, 2026
d7eb2e5
test(e2e): update darwin performance baselines for one-unit axes
vishr Nov 1, 2026
e13fc1f
test(e2e): wait for the flame tooltip to close before scanning the tr…
vishr Nov 1, 2026
4ded3cc
fix(ui): restore an Explore entry's own query on Back after a range c…
vishr Nov 1, 2026
09996ee
fix(fanql): name a misspelled metric name field before the aggregate …
vishr Nov 1, 2026
950b7da
fix(fanql): use http.server.request.duration in metric name examples
vishr Nov 1, 2026
4bdf1c6
fix(fanql): complete stored severity levels in lowercase
vishr Nov 1, 2026
7ac4070
fix(fanql): suggest duration for a misspelled duration with a unit
vishr Nov 1, 2026
5798cf4
fix(ui): qualify truncated trace timelines beside the chart
vishr Nov 1, 2026
07e34d0
fix(ui): head table duration columns without a unit
vishr Nov 1, 2026
f282ec7
fix(fanql): suggest the clause keyword for a misspelled clause
vishr Nov 1, 2026
2885ce6
fix(fanql): suggest a seen key for a misspelled dotted key
vishr Nov 1, 2026
83275b3
fix(ui): treat panels the server turned away as skipped, not failed
vishr Nov 1, 2026
a0de197
fix(ui): keep the other fix-its after applying one, and hide the lint…
vishr Nov 1, 2026
ce8ac94
fix(query): tidy empty-panel diagnosis wording and values seen
vishr Nov 1, 2026
b804425
fix(query): report an ungrouped zero count as empty on every viz
vishr Nov 1, 2026
0f00953
fix(ui): run a shared Explore link on open under StrictMode
vishr Nov 1, 2026
cec2ef5
fix(ui): read chart axes the same way across charts
vishr Nov 1, 2026
b6824b7
fix(dashboard): reject restoring a version the dashboard already has
vishr Nov 1, 2026
b7bde29
fix(api): keep a busy engine ready
vishr Nov 1, 2026
7349032
fix(ingest): drop requests abandoned before their commit starts
vishr Nov 1, 2026
5250c71
perf(query): skip totals and the previous range for an empty stat
vishr Nov 1, 2026
fc7d732
perf(query): cache a metric's unit when its spellings agree
vishr Nov 1, 2026
bb482d4
fix(api): fail health checks for a stalled engine, not a busy one
vishr Nov 1, 2026
081cabb
fix(ingest): release an abandoned request's reservation at once
vishr Nov 1, 2026
6d335ce
fix(ingest): make shed exports retryable by OTLP senders
vishr Nov 1, 2026
31bda50
fix(ui): rerun the Explore draft when an absolute range is applied
vishr Nov 1, 2026
49f34f6
fix(ui): end the bytes axis search past the largest unit
vishr Nov 1, 2026
c7f9ee6
fix(ui): drop whole-query problems when a fix-it is applied
vishr Nov 1, 2026
f9d1cf0
fix(query): show an ungrouped zero count as 0 with the diagnosis as a…
vishr Nov 1, 2026
e2228c7
fix(ui): show a zero count's diagnosis as a panel note and allow savi…
vishr Nov 1, 2026
aa2c91b
fix(ui): keep a stored (none) apart from a missing group value
vishr Nov 1, 2026
6bd6c25
fix(ui): keep the unit in headers of columns printed raw
vishr Nov 1, 2026
0d61040
fix(ui): dismiss hovered trace legend names with Escape
vishr Nov 1, 2026
42cb20b
fix(query): compare a zero count with the previous range
vishr Nov 1, 2026
090d903
fix(engine): count only completed reads as progress
vishr Nov 1, 2026
1106799
fix(fanql): offer a seen-key fix only when the schema covers the query
vishr Nov 1, 2026
31bc030
test(fanql): complete each severity level once whatever its stored case
vishr Nov 1, 2026
12aecf4
fix(ingest): answer OTLP/HTTP failures with a google.rpc.Status body
vishr Nov 1, 2026
b73b0cf
fix(ui): send the page's relative range to FanQL parse
vishr Nov 1, 2026
a058f88
fix(engine): tell a hung engine from an overloaded one
vishr Nov 1, 2026
e975b3f
chore(ui): rebuild embedded assets
vishr Nov 1, 2026
2d88693
test(ui): wait for the history list before restoring a version
vishr Nov 1, 2026
786f598
fix(engine): count only reads that ran as progress, and track publishers
vishr Nov 1, 2026
1813471
test(e2e): update darwin performance baselines for unitless duration …
vishr Nov 1, 2026
f3bfeb3
docs(proposals): accept 0005 dedicated attribute columns and batch fo…
vishr Nov 1, 2026
8dc869f
fix(engine): exit for a restart when the engine stays stalled
vishr Nov 1, 2026
3bf8a1a
docs: run Fanout under a supervisor that restarts on exit
vishr Nov 1, 2026
1ef053c
fix(engine): restart only for stalls in Fanout's own work
vishr Nov 1, 2026
4d2ad0b
fix(engine): reject SQL whose per-row cost is quadratic
vishr Nov 1, 2026
66ec4ae
docs: restarts follow only Fanout's own engine stalls
vishr Nov 1, 2026
df4063e
feat(semconv): generate the format 5 dedicated attribute keys
vishr Nov 1, 2026
19d5517
docs(proposals): extend 0005 to logs, metrics, events and links
vishr Nov 1, 2026
524b7a6
fix(engine): count only connections pings hold as theirs
vishr Nov 1, 2026
cd5e424
fix(query): bound patterns in filters and variables, block Jaro
vishr Nov 1, 2026
682b94d
perf(engine): take the read connection before the Parquet gate
vishr Nov 1, 2026
fa22033
perf(intelligence): read fixed statements on the typed path
vishr Nov 1, 2026
3d9d584
test(api): give the readiness contention test a read pool
vishr Nov 1, 2026
7320c59
refactor(engine): drop branches for a Duck without a repository
vishr Nov 1, 2026
f3c3137
refactor(engine): delete unused query helpers
vishr Nov 1, 2026
061ae1f
refactor(engine): version every DuckDB cache table together
vishr Nov 1, 2026
d596d26
fix(query): make JSON columns with nonfinite numbers parseable
vishr Nov 1, 2026
12d3957
refactor(engine): remove the direct SQL path
vishr Nov 1, 2026
dc3be38
test(query): commit metric fixtures through the telemetry store
vishr Nov 1, 2026
8c3bb90
test(intelligence): run detector fixtures on a real engine
vishr Nov 1, 2026
f9b06d7
refactor(engine): bind every windowed read to the snapshot
vishr Nov 1, 2026
8878da0
fix(engine): keep anomaly history across cache version changes
vishr Nov 1, 2026
4ac6e2a
fix(engine): hold no read connection while a publisher blocks the gate
vishr Nov 1, 2026
befb36f
fix(engine): reject GROUP BY ALL in telemetry SQL
vishr Nov 1, 2026
5c2cbc3
refactor(telemetry): write Parquet from one column registry
vishr Nov 1, 2026
52b55ba
refactor(engine): derive telemetry views from the column registry
vishr Nov 1, 2026
28a0c01
refactor(query): take catalog columns from the telemetry registry
vishr Nov 1, 2026
ec21153
refactor(engine): read each signal's event-time column from the registry
vishr Nov 1, 2026
2d0dbfd
refactor(telemetry): derive per-signal lists from the registry
vishr Nov 1, 2026
b98242b
fix(telemetry): write variant metadata deterministically and dictiona…
vishr Nov 1, 2026
4a21f44
refactor(telemetry): order every signal by a key extractor and compar…
vishr Nov 1, 2026
37b2bab
feat(telemetry)!: write batch format 5
vishr Nov 1, 2026
ed112c2
build(ui): rebuild assets for format 5 span details
vishr Nov 1, 2026
72317d7
fix(query): count histogram points without buckets
vishr Nov 1, 2026
b33cb5e
fix(telemetry): leave null key values unspilled and verify spills by …
vishr Nov 1, 2026
eb8567b
docs: describe batch format 5 where format 4 was current
vishr Nov 1, 2026
0c109ea
perf(telemetry): entropy-code zstd literals in Parquet pages
vishr Nov 1, 2026
8132d5a
test(telemetry): record each signal's Parquet file digest
vishr Nov 1, 2026
4053ecd
perf(telemetry): append dedicated-column NULLs in runs
vishr Nov 1, 2026
df4d191
perf(telemetry): write the trace index alongside the span file
vishr Nov 1, 2026
3472f06
perf(telemetry): radix-sort integer sort keys
vishr Nov 1, 2026
e38f3cb
perf(telemetry): size grouped batches before merging requests
vishr Nov 1, 2026
a39a940
perf(telemetry): gather variant map entries in one pass
vishr Nov 1, 2026
5131c86
test(telemetry): cover empty and absent maps in file digests
vishr Nov 1, 2026
a7f9318
perf(telemetry): walk span attributes once per row
vishr Nov 1, 2026
7c422ac
perf(telemetry): hash metric series identities without allocating
vishr Nov 1, 2026
ca11e0c
perf(telemetry): sort small batches by comparison
vishr Nov 1, 2026
64edfda
perf(telemetry): write a file's columns in parallel lanes
vishr Nov 1, 2026
1d44540
perf(telemetry): keep only the sort key parts an order needs
vishr Nov 1, 2026
97904e1
test(telemetry): compare two write lanes and tighten the ordering limit
vishr Nov 1, 2026
ca9b19f
feat(engine): read standard keys through their dedicated columns
vishr Nov 1, 2026
c1ab751
fix(query): compare standard integer keys as numbers
vishr Nov 1, 2026
52be46d
refactor(query): drop casts of standard keys that are already typed
vishr Nov 1, 2026
7acaf9b
docs(proposals): record the format 5 read path
vishr Nov 1, 2026
0c2264a
docs: describe ingest conversion of standard key values
vishr Nov 1, 2026
a6d4118
feat(telemetry)!: convert standard key values to their column types a…
vishr Nov 1, 2026
3465c45
feat(engine): leave dedicated columns out of result stars
vishr Nov 1, 2026
d6f15d8
fix(engine): leave dedicated columns out of renamed subquery stars
vishr Nov 1, 2026
c39cc0a
fix(engine): bind standard key subscripts to lateral siblings
vishr Nov 1, 2026
38b2865
fix(engine): keep dedicated columns out of COLUMNS and row references
vishr Nov 1, 2026
e90b4ae
feat(query): list standard keys in the schema as indexed
vishr Nov 1, 2026
1dbb4ec
fix(query): offer no type form for standard keys in diagnoses
vishr Nov 1, 2026
2d97d78
docs: say standard keys read typed
vishr Nov 1, 2026
45a69b0
docs(adr): record batch format 5
vishr Nov 1, 2026
5454912
fix(engine): select COLUMNS patterns and unpivots without dedicated c…
vishr Nov 1, 2026
52acfeb
fix(telemetry): keep offline verification within its memory limit
vishr Nov 1, 2026
4c19e6e
fix(engine): close the remaining paths to dedicated columns
vishr Nov 1, 2026
dcf74ac
fix(telemetry): share variant metadata across compacted row groups
vishr Nov 1, 2026
fdfbf7f
fix(telemetry): bound compacted variant pages and buffers
vishr Nov 1, 2026
6df1212
fix(ingest): reject number data points without a value
vishr Nov 2, 2026
972a54a
fix(telemetry): store NULL for metric points with no recorded value
vishr Nov 2, 2026
2714c82
perf(query): project narrow metric reads instead of the whole view
vishr Nov 2, 2026
b3ff8c1
fix(telemetry): compress histogram bucket counts at zstd's default level
vishr Nov 2, 2026
333922f
perf(telemetry): bound compaction readers and skip sorted VARIANT rew…
vishr Nov 2, 2026
fa6555a
perf(telemetry): keep page encoders across garbage collections
vishr Nov 2, 2026
1641514
perf(telemetry): keep shredded resource cells across files
vishr Nov 2, 2026
fb71ed0
perf(telemetry): compare-sort batches under 4,096 rows
vishr Nov 2, 2026
c15777b
perf(telemetry): validate staged files from the footer alone
vishr Nov 2, 2026
ddfdb6a
Preserve ordered log chunks during compaction
vishr Nov 2, 2026
1327c9e
perf(telemetry): avoid sparse merge rewrites
vishr Nov 2, 2026
25f7e48
perf(engine): repeat cache passes only while a backlog remains
vishr Nov 2, 2026
6a5373f
fix(telemetry): keep column paths in multi-group merge footers
vishr Nov 2, 2026
18adbf4
perf(ingest): memoize log body templates by body
vishr Nov 2, 2026
1062577
perf(engine): size DuckDB's worker pool from GOMAXPROCS
vishr Nov 2, 2026
d195991
test(config): expect the automatic DuckDB thread count
vishr Nov 2, 2026
259d6d6
fix(ingest): copy cached log templates instead of pinning request bodies
vishr Nov 2, 2026
c608d8e
perf(telemetry): check every standard key of a map in one verifier query
vishr Nov 2, 2026
1dfb605
fix(store): open every verifier before checking batches
vishr Nov 2, 2026
e747ca6
perf(telemetry): give each compacted VARIANT row its exact metadata
vishr Nov 2, 2026
f8d7c84
perf(query): cache panel results and coalesce identical runs
vishr Nov 2, 2026
5b4cec7
perf(query): reserve read connections and bound the panel queue
vishr Nov 2, 2026
1fff8d9
fix(query): bound cached answers by window age and keep cacheable runs
vishr Nov 2, 2026
010e086
fix(query): cancel abandoned runs still waiting for a read slot
vishr Nov 2, 2026
07aa5cf
build(ui): rebuild assets for manual refresh without the cache
vishr Nov 2, 2026
ce886fb
perf(telemetry): publish Parquet swaps without waiting for readers
vishr Nov 2, 2026
865f559
fix(engine): avoid hashing raw events in service rollups
vishr Nov 2, 2026
50402f2
fix(telemetry): keep compacted and pruned batches retired across retr…
vishr Nov 2, 2026
3174da0
fix(engine): release read setup resources on panic
vishr Nov 2, 2026
54c53c4
fix(engine): bind empty rollup catalogs to the schema batch
vishr Nov 2, 2026
6ca9fae
fix(engine): bound service and edge rollup memory
vishr Nov 2, 2026
15a6a27
test(engine): widen the late-span heap regression signal
vishr Nov 2, 2026
a1a348c
fix(engine): bind rollup keys before scanning spans
vishr Nov 2, 2026
719acfd
fix(engine): unregister statements when query setup panics
vishr Nov 2, 2026
655a493
fix(engine): bound rollup key planning in chunks
vishr Nov 2, 2026
7f1371e
fix(engine): keep raw parent spans off rollup hash builds
vishr Nov 2, 2026
74915b3
fix(query): preserve single-flight cache execution under load
vishr Nov 3, 2026
52314ca
feat(engine): aggregate minute span histograms with service rollups
vishr Nov 3, 2026
9fd34dd
feat(query): route span panels through minute rollups
vishr Nov 3, 2026
5019cba
perf(query): serve resource and peer panels from read summaries
vishr Nov 3, 2026
71718a5
perf(engine): yield background chunks to foreground query pressure
vishr Nov 3, 2026
43b821a
fix(query): bound dashboard batch admission to twelve seconds
vishr Nov 3, 2026
767fb11
fix(engine): keep retained service membership exact during cache catc…
vishr Nov 3, 2026
e6c8d93
test(engine): expect version draining in the rollup tick
vishr Nov 3, 2026
a469543
perf(engine): yield between background units after making progress
vishr Nov 3, 2026
0585808
test(query): accept unordered conversion failure values
vishr Nov 3, 2026
9079089
perf(engine): preserve bounded cache SQL batches when yielding
vishr Nov 3, 2026
7853d97
fix(telemetry): keep compaction running under read pressure
vishr Nov 3, 2026
fee55ec
fix(query): bound exemplar sampling before root lookup
vishr Nov 3, 2026
95437d7
fix(query): probe exemplar roots with constant trace keys
vishr Nov 3, 2026
2c2cad1
fix(query): remove obsolete exemplar ranking SQL
vishr Nov 3, 2026
58f2182
fix(query): restore slowest exemplar candidates with bounded top-n
vishr Nov 3, 2026
48d00e1
feat(ingest): admit rows before queuing instead of waiting on debt
vishr Nov 3, 2026
d3bf669
feat(query): reserve admission capacity for interactive reads
vishr Nov 3, 2026
44dba02
feat(otlp): reject pressured exports before row conversion
vishr Nov 3, 2026
4f61040
perf(ingest): coalesce larger batches under compaction pressure
vishr Nov 3, 2026
d26f86a
docs(storage): record saturation admission and expose compaction reti…
vishr Nov 3, 2026
4e50bc4
fix(query): count interactive waits bounded by caller deadlines
vishr Nov 3, 2026
58e9042
test(ingest): measure refused export CPU cost
vishr Nov 3, 2026
cad3b1c
fix(ingest): preserve throughput under read pressure
vishr Nov 3, 2026
8008d4c
fix(ingest): preserve useful batches in the debt band
vishr Nov 3, 2026
e287998
fix(query): stabilize empty-panel diagnosis under pressure
vishr Nov 3, 2026
3fcc9f2
fix(engine): keep cache leases from stalling compaction
vishr Nov 3, 2026
0e18913
perf(engine): avoid redundant work in span rollups
vishr Nov 4, 2026
b663937
perf(dashboard): bound overview scans with minute summaries
vishr Nov 4, 2026
9352cdc
feat(metrics): expose bounded panel query outcomes
vishr Nov 4, 2026
181a989
fix(engine): preserve route conversions and bound boundary reads
vishr Nov 4, 2026
304cb22
perf(query): aggregate histogram bins before computing quantiles
vishr Nov 4, 2026
eaef3a4
perf(engine): amortize read cache maintenance under ingest
vishr Nov 4, 2026
1b50b20
feat(metrics): distinguish panel admission outcomes
vishr Nov 4, 2026
e83945e
feat(dashboard): summarize receiver and resource minute observations
vishr Nov 4, 2026
ebd058b
fix(query): admit dashboard refreshes with a shared slot budget
vishr Nov 4, 2026
1005911
fix(engine): preserve converted resource keys in receiver summaries
vishr Nov 4, 2026
c3d7575
perf(dashboard): bound reporting witnesses and narrow CPU windows
vishr Nov 4, 2026
dde8692
perf(engine): aggregate resources before projecting minute identities
vishr Nov 4, 2026
c1c435c
perf(engine): reuse resource seconds for batch inventory
vishr Nov 4, 2026
9bc6644
fix(query): admit dashboard refreshes whole instead of refusing panels
vishr Nov 4, 2026
0f3b0b6
refactor(api)!: clarify API and MCP names and normalize list responses
vishr Nov 4, 2026
d080a5c
build(ui): rebuild embedded assets for the renamed contracts
vishr Nov 4, 2026
faf3126
fix(ingest): keep drill-downs ahead and let throttled exporters retry
vishr Nov 4, 2026
d943f93
test(e2e): update Linux performance and trace baselines for unitless …
vishr Nov 5, 2026
1b65b44
test(telemetry): record Parquet file digests per architecture
vishr Nov 5, 2026
551e122
test(e2eseed): give the peer rollup wait room on a loaded CI runner
vishr Nov 5, 2026
afd8ae7
test(query): check exponential histogram conversion grows linearly, n…
vishr Nov 5, 2026
f890251
test(engine): skip the time-budget sizing test under the race detector
vishr Nov 5, 2026
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
The table of contents is too big for display.
Diff view
Diff view
  •  
  •  
  •  
7 changes: 6 additions & 1 deletion .env.example
Original file line number Diff line number Diff line change
Expand Up @@ -81,7 +81,7 @@
# FANOUT_DUCKDB_MEMORY=

# FANOUT_DUCKDB_THREADS; integer
# Caps DuckDB's global query worker pool. Zero leaves DuckDB's own default in place (one worker per core). Set it to leave cores free for ingest on a query-heavy co-tenant host.
# Caps DuckDB's global query worker pool. Zero selects one worker per CPU the process may run on (the affinity mask and cgroup quota, as GOMAXPROCS resolves them) rather than DuckDB's count of the machine's hardware threads. Set it to leave cores free for ingest on a query-heavy co-tenant host.
# Default: 0
# FANOUT_DUCKDB_THREADS=

Expand Down Expand Up @@ -182,6 +182,11 @@
# Default: (empty)
# FANOUT_PUBLIC_URL=

# FANOUT_QUERY_CACHE_TTL; duration
# The oldest a dashboard panel, exemplar or trace detail result served from memory may be, measured from the end of the time window it covers (for traces and exemplars, from when their run started). A result younger than half the TTL is served as is; one younger than the TTL is served while one background run refreshes it; an older one is rerun. A request with Cache-Control: no-cache, such as a dashboard's manual refresh, always reruns. Zero disables the cache; concurrent identical requests still share one execution.
# Default: 10s
# FANOUT_QUERY_CACHE_TTL=

# FANOUT_RETENTION_DAYS; integer
# Sets telemetry retention in days; zero disables expiry.
# Default: 30
Expand Down
18 changes: 12 additions & 6 deletions AGENTS.md
Original file line number Diff line number Diff line change
Expand Up @@ -93,10 +93,15 @@
Analytical service/edge watermark lag is separate. Completed-batch writes
have their own gate and write-pool slot; analytical writes use disjoint tables.
Maintenance must hold both gates for checkpointing.
- Batch format 4, including its physical schema, is the only accepted telemetry
format. Schema changes require a format version change. Disable schema unioning
and Hive partition inference; use native Parquet binding so VARIANT extracts
can reach the scan. Pre-project hot messaging fields into scalar read-view
- Batch format 5, including its physical schema, is the only accepted telemetry
format. Schema changes require a format version change. Ingest copies standard
semconv keys into typed dedicated columns, converting values of another type
by fixed rules; a value with no conversion leaves the column NULL and is
counted as a spill. The map keeps every value as sent, and the column is the
key's read value. No storage column holds JSON: repeated
values are typed lists. Every signal's files keep their declared sort order.
Disable schema unioning and Hive partition inference; use native Parquet
binding so VARIANT extracts can reach the scan. Pre-project hot messaging fields into scalar read-view
columns; this preview does not push general VARIANT extracts across views.
Reject unsupported metadata before cleanup or schema rewriting, preserve those files, and add
no legacy reader or format fallback.
Expand All @@ -105,8 +110,9 @@
cast returned timestamps and datetime-function arguments only. Every engine
connection uses UTC. Do not change Parquet UTC-instant semantics for speed.
- Offline verification reuses one bounded, non-spilling native engine to decode
all Parquet columns and checks physical schemas, complete span sort tuples,
and exact index ranges. Operational errors and unsupported formats never
all Parquet columns and checks physical schemas, every signal's complete sort
tuples, exact index ranges, dedicated columns against their converted map
values and spill counts, and list lengths. Operational errors and unsupported formats never
authorize quarantine. Discarded hashes force decoding; they are not checksums.
- Keep DuckDB 2's memory-governed asynchronous I/O defaults unless measurements
justify tuning them. Do not force an unbounded read-ahead depth.
Expand Down
2 changes: 1 addition & 1 deletion README.md
Original file line number Diff line number Diff line change
Expand Up @@ -31,7 +31,7 @@ client, built-in agent, MCP tools, dashboards, and alerts are preview capabiliti
### Docker

```sh
docker run --name fanout -p 7520:7520 \
docker run --name fanout --restart unless-stopped -p 7520:7520 \
-v fanout-data:/var/lib/fanout/data \
-e FANOUT_AUTH_CODE_SECRET=$(openssl rand -hex 32) \
labstack/fanout:latest
Expand Down
4 changes: 3 additions & 1 deletion cmd/fanout-docgen/routes.go
Original file line number Diff line number Diff line change
Expand Up @@ -265,7 +265,7 @@ func renderRoutes(routes []api.RouteDoc) []byte {

b.WriteString("## Interface stability\n\nThe `/api/*` routes serve the browser client and can change without migration\npaths. [MCP](/docs/guides/mcp) is the agent interface. OTLP ingest and\n[operational endpoints](/docs/reference/endpoints) have their own contracts.\n\nManage alert rules through the [HTTP API](/docs/guides/alerts). Administrators\nrotate ingest tokens on **Connect telemetry** or with\n`POST /api/settings/ingest/token/rotate`.\n\n")

b.WriteString("## Errors\n\nApplication API errors, including unknown routes and wrong methods, return objects shaped like\n`{\"code\":\"bad_request\",\"message\":\"Safe explanation\"}`. Codes are stable\nsnake_case identifiers; clients branch on `code` rather than message text.\nInvalid dashboard or panel specs also include `problems` with field paths,\nmessages and optional hints. Every error response uses `Cache-Control: no-store`;\nHEAD errors have no body. Server failures return a short, safe message; the\nunderlying error is logged and never returned.\n\nDefault codes by HTTP status:\n\n| Status | Code |\n|---|---|\n| 400 | `bad_request` |\n| 401 | `unauthorized` |\n| 403 | `forbidden` |\n| 404 | `not_found` |\n| 405 | `method_not_allowed` |\n| 409 | `conflict` |\n| 413 | `payload_too_large` |\n| 415 | `unsupported_media_type` |\n| 422 | `unprocessable` |\n| 429 | `rate_limited` |\n| 500 | `internal` |\n| 502 | `bad_gateway` |\n| 503 | `unavailable` |\n| 504 | `timeout` |\n\nOther 4xx statuses use `bad_request`; other 5xx statuses use `internal`.\nSpecific conditions use `already_current`, `dashboard_version_not_found`,\n`dashboard_version_conflict`, `invalid_spec` and `last_active_administrator`.\nTool failures carry `error: {code, message}` inside the tool result.\nPanel execution results keep their own status and error fields.\nOAuth, OTLP/gRPC, MCP JSON-RPC and AG-UI run errors keep their protocol spelling.\nOperational responses at `/healthz`, `/readyz` and `/metrics` keep their bodies.\n\n")
b.WriteString("## Errors\n\nApplication API errors, including unknown routes and wrong methods, return objects shaped like\n`{\"code\":\"bad_request\",\"message\":\"Safe explanation\"}`. Codes are stable\nsnake_case identifiers; clients branch on `code` rather than message text.\nInvalid dashboard or panel specs also include `problems` with field paths,\nmessages and optional hints. Every error response uses `Cache-Control: no-store`;\nHEAD errors have no body. Server failures return a short, safe message; the\nunderlying error is logged and never returned.\n\nDefault codes by HTTP status:\n\n| Status | Code |\n|---|---|\n| 400 | `bad_request` |\n| 401 | `unauthorized` |\n| 403 | `forbidden` |\n| 404 | `not_found` |\n| 405 | `method_not_allowed` |\n| 409 | `conflict` |\n| 413 | `payload_too_large` |\n| 415 | `unsupported_media_type` |\n| 422 | `unprocessable` |\n| 429 | `rate_limited` |\n| 500 | `internal` |\n| 502 | `bad_gateway` |\n| 503 | `unavailable` |\n| 504 | `timeout` |\n\nOther 4xx statuses use `bad_request`; other 5xx statuses use `internal`.\nSpecific conditions use `already_current`, `dashboard_version_not_found`,\n`dashboard_version_conflict`, `invalid_spec` and `last_active_administrator`.\n`GET /api/telemetry/schema` returns 503 `schema_busy` with `Retry-After` when a\nnew window and namespace cannot start a discovery yet, or when the discovery is\nstill running after 15 seconds; it keeps running, so a retry finds it cached.\nCached ones are always served. An unknown window is 400 `bad_request`.\nTool failures carry `error: {code, message}` inside the tool result.\nPanel execution results keep their own status and error fields.\nOAuth, OTLP/gRPC, MCP JSON-RPC and AG-UI run errors keep their protocol spelling.\nOperational responses at `/healthz`, `/readyz` and `/metrics` keep their bodies.\n\n")

b.WriteString("[Roles](/docs/reference/roles) maps capabilities to roles.\n\n")

Expand All @@ -286,5 +286,7 @@ func renderRoutes(routes []api.RouteDoc) []byte {
b.WriteString(" session, which is how a scraper reaches the metrics endpoint.\n\n")
b.WriteString("`Any` registers every HTTP method with the same authorization requirement.\n`GET /*` serves the single-page application for browser paths. Unknown `/api/*`\nand OTLP paths return errors.\n")

b.WriteString("\n## OTLP overload responses\n\nOTLP admission counts protobuf spans, log records or metric points before\nconverting them into storage rows. Under compaction debt, interactive starvation\n(refusals or queue-wait timeouts), or the decoded-byte budget, the entire export\nis refused retryably. Panel queueing alone does not trigger ingest throttling.\ngRPC responds with `RESOURCE_EXHAUSTED` and `google.rpc.RetryInfo`; HTTP responds\nwith 429 and `Retry-After` in whole seconds rounded up. The message identifies\nthe pressure reason. Rate refusals request a one-to-five-second delay; the hard\ndebt limit requests two seconds. Byte-budget refusals retain their existing\nretry delay. Enable exporter retries and honor these delays; clients with\nretries disabled can drop refused telemetry. An acknowledgement still means\nthe accepted export was durably published.\n\nExemplars and trace detail use a priority read lane with reserved capacity.\nPanels and interactive reads have separate bounded queues; a refused read\nretains the existing 503 busy response with `Retry-After`.\n")

return []byte(b.String())
}
55 changes: 42 additions & 13 deletions cmd/fanout/main.go
Original file line number Diff line number Diff line change
Expand Up @@ -120,6 +120,14 @@ func main() {
os.Exit(1)
}

// A failed run exits nonzero after every deferred close has run, so a
// supervisor restarts it.
failed := false
defer func() {
if failed {
os.Exit(1)
}
}()
ctx, cancel := context.WithCancel(context.Background())
defer cancel()

Expand All @@ -139,23 +147,20 @@ func main() {
slog.Error("duckdb init failed", "err", err)
os.Exit(1)
}
defer q.Close()
// A stalled engine may still be running native code, so its handles stay
// open; the process exits instead.
stalled := false
defer func() {
if !stalled {
_ = q.Close()
}
}()

writer := telemetrystore.NewWriter(repository, cfg.IngestBatchSize)
writer.SetInFlightBudget(cfg.IngestMaxInFlightBytes)
writerResult := make(chan error, 1)
go func() {
err := writer.Run(ctx)
// Publish the result before notifying the process-wide error channel. The
// shutdown path waits on writerResult after Writer.Wait, so a final-commit
// failure cannot be lost in the close(done) -> goroutine-send scheduling gap.
writerResult <- err
if err != nil {
errCh <- fmt.Errorf("telemetry writer: %w", err)
}
}()

go q.RunRollups(ctx)
go q.Watch(ctx)

// Start intelligence detector
detector := intelligence.NewDetector(q, intelligence.DefaultDetectorConfig())
Expand Down Expand Up @@ -276,11 +281,25 @@ func main() {
// raw *sql.DB here bypassed the Telemetry maintenance-race protection.
queries := observability.New(q, q, cfg.RetentionDays)
panels := query.NewExecutor(q, cfg.RetentionDays)
writer.SetAdmission(repository.CompactionDebt, panels.InteractiveRefusals)
go func() {
err := writer.Run(ctx)
// Publish the result before notifying the process-wide error channel. The
// shutdown path waits on writerResult after Writer.Wait, so a final-commit
// failure cannot be lost in the close(done) -> goroutine-send scheduling gap.
writerResult <- err
if err != nil {
errCh <- fmt.Errorf("telemetry writer: %w", err)
}
}()
q.SetReadPressure(panels.Pressure)
go q.RunRollups(ctx)
panels.SetRollupReader(queries)
panels.SetCacheTTL(cfg.QueryCacheTTL)
api.RegisterQueryRoutes(e, panels)
api.RegisterFanQLRoutes(e, q, panels)
api.RegisterAnnotationRoutes(e, annotations.New(q))
api.RegisterTraceRoutes(e, queries, cfg.RetentionDays)
api.RegisterTraceRoutes(e, panels.CachedTraces(queries), cfg.RetentionDays)
api.RegisterIntelligenceRoutes(e, detector)
dashboards := dashboard.New(sqlite.DB, panels)
api.RegisterDashboardRoutes(e, dashboards)
Expand Down Expand Up @@ -415,7 +434,15 @@ func main() {
case <-stop:
slog.Info("shutting down")
case err := <-errCh:
failed = true
slog.Error("fatal error, shutting down", "err", err)
case err := <-q.Fatal():
// DuckDB invalidated its database, or Fanout's own work on it stalled.
// Flush ingest and exit nonzero so the supervisor restarts Fanout,
// which rebuilds the query cache from Parquet.
failed = true
stalled = errors.Is(err, engine.ErrStalled)
slog.Error("query engine failed, shutting down for a restart", "err", err)
}

// Stop every surface and finish in-flight exports before stopping the writer.
Expand All @@ -427,6 +454,8 @@ func main() {
_ = httpSrv.Close()
}
shutdownCancel()
// Schema discoveries outlive their requests; stop them before the engine.
panels.Close()
grpcSrv.Stop()
cancel()
writer.Wait()
Expand Down
49 changes: 49 additions & 0 deletions docs/adr/0008-batch-format-5.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,49 @@
# 0008. Batch format 5

Status: Accepted
Date: 2026-11-01

## Context

Format 4 kept every OpenTelemetry attribute in a VARIANT map. Filters and
groupings on common keys such as `http.route` or `k8s.pod.name` decoded the
map on every row and could not use Parquet statistics. Some values were
stored as JSON strings, and log and metric files had no declared row order,
so their row groups covered every service and time. Proposal 0005 records
the analysis.

## Decision

Format 5 replaces format 4 and supersedes the format half of ADR 0003.

- A fixed rule over semantic conventions v1.44.0 selects 47 standard keys:
18 span attribute keys and 29 resource keys. Each has a typed dedicated
column. Spans carry all 47; logs and metrics carry the 29 resource
columns. A different key list needs a new format version.
- Ingest converts each key's value to the column type. Integer keys take
integers, integral floats within range and base-10 integer strings, so
`"200"` is stored as 200. String keys take strings and the text of
integers, booleans and floats. Any other value leaves the column NULL and
is counted in the footer as a spill. The map keeps every value as sent.
- No storage column holds JSON. Span events and links, metric exemplars,
histogram buckets and summary quantiles are typed lists.
- Every signal's files keep a declared sort order. Spans sort by trace
hash, start time and span ID. Logs sort by five-minute bucket, namespace,
service and time. Metrics sort by namespace, service, name, hour, series
and time.
- Reads rewrite `attributes['k']` and `resource['k']` for a standard key to
its column on the parsed SQL, so FanQL, structured panels and SQL share one
rule and read the converted value. Users never name the columns, and
result stars leave them out.
- SQL rejects `GROUP BY ALL`, because the pinned engine groups its keys
without VARIANT collation and splits equal attribute values.

## Consequences

- Filters and groupings on standard keys read one typed column and skip
row groups by statistics.
- A standard key has one type in schema discovery, completion and results,
whatever type senders used.
- Format 4 directories are refused and preserved; operators delete them
before running format 5.
- Adding a key, changing a type or changing a sort order is a format change.
Loading
Loading