jsonl: NDJSON / JSON-Lines stream decoder#14
Merged
Merged
Conversation
Generic Decode[T] over json.Decoder yielding stream values as iter.Seq2. Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
Adds a
jsonlpackage that decodes a stream of JSON values (JSON Lines / NDJSON)into typed values via a range-over-func iterator — for consuming streaming JSON
APIs.
What's included
Decode[T any](r io.Reader) iter.Seq2[T, error]— yields each successiveJSON value decoded into a
T. Values may be separated by any JSON whitespace(newlines for NDJSON, or none), built on
encoding/json'sDecoder(incremental,no whole-stream buffering). Clean
io.EOFends iteration; a decode error(including a truncated final value) is surfaced once, then iteration stops.
Background
One of the streaming helpers deferred from the HTTP-value-types roadmap item. The
chunked-transfer side is already handled by
net/http(the body is de-chunkedbefore
Decodesees it).Behavior changes
None — new package only.
Test plan
go build ./...go vet ./...gofmt -l .(clean)go test -race ./...(all packages pass)empty stream → no values; a malformed value mid-stream surfaces the error after
the first value; a truncated final value surfaces an error; early
breakstopsdecoding.
🤖 Generated with Claude Code