Repository navigation
Add single-video YouTube locator entry for Context #107
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
base: main
Are you sure you want to change the base?
Changes from all commits
File filter
Filter by extension
Conversations
Jump to
Diff view
Diff view
There are no files selected for viewing
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,32 @@ | ||
| name: Context video locator transactions | ||
|
|
||
| on: | ||
| pull_request: | ||
| branches: [main] | ||
| push: | ||
| branches: [main] | ||
|
|
||
| permissions: | ||
| contents: read | ||
|
|
||
| jobs: | ||
| context-video-entry: | ||
| runs-on: ubuntu-24.04 | ||
| timeout-minutes: 10 | ||
| strategy: | ||
| fail-fast: false | ||
| matrix: | ||
| postgres: [15, 16] | ||
| steps: | ||
| - uses: actions/checkout@v4 | ||
| - name: Install PostgreSQL | ||
| run: | | ||
| sudo apt-get update | ||
| sudo apt-get install -y postgresql-common | ||
| sudo /usr/share/postgresql-common/pgdg/apt.postgresql.org.sh -y | ||
| sudo apt-get update | ||
| sudo apt-get install -y postgresql-${{ matrix.postgres }} | ||
| - name: Test single-video locator entry | ||
| run: | | ||
| export PATH="/usr/lib/postgresql/${{ matrix.postgres }}/bin:$PATH" | ||
| python3 -m unittest discover -s tests -p 'test_context_video_entry.py' | ||
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,68 @@ | ||
| -- A submitted YouTube video URL identifies a locator, not verified video metadata, | ||
| -- a recording match, an uploader-as-artist link, captions or lyrics. The uploading | ||
| -- channel, performers, credited artists and the recording stay explicitly unresolved | ||
| -- until separate evidence links them. No artist, recording, roster or lyrics rows | ||
| -- are created, and no song or artist brand document is touched. | ||
| begin; | ||
| create function public.create_context_video_request(p_owner uuid,p_actor uuid,p_video text,p_key text) | ||
| returns jsonb language plpgsql set search_path='' as $$ | ||
| declare resource uuid; subject uuid; r public.context_requests; request_fingerprint text; uri text; | ||
| source uuid; source_version uuid; document public.context_documents; v_attempt uuid; result uuid; | ||
| snapshot jsonb; snapshot_hash text; gaps jsonb; | ||
| begin | ||
| if p_video is null or p_video !~ '^[A-Za-z0-9_-]{11}$' then raise exception 'Invalid YouTube video identifier'; end if; | ||
| request_fingerprint:=encode(sha256(convert_to('youtube-video-locator-v1:'||p_video,'UTF8')),'hex'); | ||
| uri:='https://www.youtube.com/watch?v='||p_video; | ||
| insert into public.context_resources(provider,resource_kind,provider_id,canonical_url) | ||
| values('youtube','video',p_video,uri) | ||
| on conflict(provider,resource_kind,provider_id) do update set provider_id=excluded.provider_id returning id into resource; | ||
| insert into public.context_requests(owner_id,created_by,resource_id,idempotency_key,input_fingerprint,input) | ||
| values(p_owner,p_actor,resource,p_key,request_fingerprint, | ||
| jsonb_build_object('kind','video','url',uri,'videoId',p_video,'identityConfirmed',false)) | ||
| on conflict(owner_id,idempotency_key) do nothing; | ||
| select * into strict r from public.context_requests where owner_id=p_owner and idempotency_key=p_key for update; | ||
| if r.input_fingerprint<>request_fingerprint then raise exception 'Idempotency key already used for different input'; end if; | ||
| if r.status in ('completed','partial','cancelled') then return to_jsonb(r)-'claim_token'; end if; | ||
| -- The video is its own subject. It is never attached to an artist, recording or release here. | ||
| insert into public.context_subjects(kind,resource_id) values('video',resource) | ||
| on conflict(resource_id) do update set resource_id=excluded.resource_id returning id into subject; | ||
| insert into public.context_resource_links(resource_id,subject_id,relation,status,evidence) | ||
| values(resource,subject,'identity','accepted',jsonb_build_object('source','submitted_youtube_video_url')) | ||
| on conflict(resource_id,subject_id,relation) do nothing; | ||
| if not exists(select 1 from public.context_resource_links where resource_id=resource and subject_id=subject and relation='identity' and status='accepted') | ||
| then raise exception 'Video locator identity is disputed'; end if; | ||
| -- Every unknown stays an explicit unknown. Nothing below is fetched or inferred. | ||
| snapshot:=jsonb_build_object('url',uri,'youtubeVideoId',p_video,'submittedBy',p_actor, | ||
| 'metadataVerified',false,'uploaderIsArtist','unknown','recordingMatch','unresolved', | ||
| 'captions','uncollected','language','unknown','mediaVersion','unknown'); | ||
| snapshot_hash:=encode(sha256(convert_to(snapshot::text,'UTF8')),'hex'); | ||
| insert into public.context_sources(owner_id,source_url,kind) values(p_owner,uri,'customer') | ||
| on conflict(owner_id,kind,source_url) where withdrawn_at is null and source_url is not null | ||
| do update set source_url=excluded.source_url returning id into source; | ||
| insert into public.context_source_versions(owner_id,source_id,fingerprint,content) | ||
| values(p_owner,source,snapshot_hash,snapshot) | ||
| on conflict(source_id,fingerprint) do update set fingerprint=excluded.fingerprint returning id into source_version; | ||
| insert into public.context_documents(owner_id,subject_id,topic) values(p_owner,subject,'video_locator') on conflict do nothing; | ||
| select * into strict document from public.context_documents where owner_id=p_owner and subject_id=subject and topic='video_locator' for update; | ||
| insert into public.context_attempts(owner_id,request_id,module,attempt,status,provider,recipe_version,schema_version,started_at,finished_at,provider_cost_micros,provider_cost_status) | ||
| values(p_owner,r.id,'video_locator:'||subject,1,'succeeded','user_submission','youtube-video-url-v1','1',now(),now(),0,'confirmed') | ||
| on conflict(request_id,module,attempt) do update set finished_at=now() returning id into v_attempt; | ||
| insert into public.context_results(owner_id,attempt_id,subject_id,topic,reuse_key,status,evidence_kind,raw_response,normalized_response,coverage) | ||
| values(p_owner,v_attempt,subject,'video_locator',snapshot_hash,'accepted','customer_assertion',snapshot,snapshot, | ||
| '{"extent":"partial","scope":"submitted_locator","metadataVerified":false}') returning id into result; | ||
| insert into public.context_result_sources(owner_id,result_id,source_version_id) values(p_owner,result,source_version); | ||
| if not public.accept_context_result(p_owner,document.id,result,document.revision) then raise exception 'Video locator acceptance conflict'; end if; | ||
| gaps:=jsonb_build_array( | ||
| jsonb_build_object('topic','video_metadata','status','uncollected','reason','Title, description and channel were not fetched.'), | ||
| jsonb_build_object('topic','uploader_attribution','status','unresolved','reason','The uploading channel is not assumed to be the artist, a performer or a credited artist.'), | ||
| jsonb_build_object('topic','recording_match','status','unresolved','reason','No recording, release or artist was matched or created for this video.'), | ||
| jsonb_build_object('topic','captions','status','uncollected','reason','Captions and transcripts were not collected; no lyrics were inferred.'), | ||
| jsonb_build_object('topic','media_version','status','unknown','reason','Original, live, remix or dubbed version is unknown.'), | ||
| jsonb_build_object('topic','video_narrative','status','unavailable','reason','Video analysis is not enabled; no narrative or visual interpretation was inferred.')); | ||
| update public.context_requests set status='partial',output=jsonb_build_object('subjectIds',jsonb_build_array(subject),'gaps',gaps),updated_at=now() | ||
| where id=r.id returning * into r; | ||
| return to_jsonb(r)-'claim_token'; | ||
| end $$; | ||
| revoke all on function public.create_context_video_request(uuid,uuid,text,text) from public,anon,authenticated; | ||
| grant execute on function public.create_context_video_request(uuid,uuid,text,text) to service_role; | ||
| commit; |
| Original file line number | Diff line number | Diff line change | ||||
|---|---|---|---|---|---|---|
| @@ -1,5 +1,22 @@ | ||||||
| # Context foundation tests | ||||||
|
|
||||||
| ## Single-video locator entry | ||||||
|
|
||||||
| After `20261010213100_context_video_entry.sql`, run `context_video_entry.sql` in a | ||||||
|
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. P2: The fixture is not runnable after only this migration: it depends on the foundation and earlier Context entry migrations plus their prerequisite tables and roles. List those prerequisites here so manual runners do not hit missing relations or functions. Prompt for AI agents
Suggested change
|
||||||
| disposable database transaction, or `python3 -m unittest discover -s tests -p | ||||||
| 'test_context_video_entry.py'` from the repository root (local PostgreSQL on PATH; | ||||||
| on macOS export `LC_ALL=C` if `pg_ctl` reports a multithreaded postmaster). The | ||||||
| fixture saves one YouTube video as a `video` subject with a `video_locator` | ||||||
| customer assertion and six explicit gaps, then checks identifier validation, | ||||||
| same-key replay, key conflicts, re-submission of the same video under a new key | ||||||
| (one subject, source and document; one more request, attempt and result), a | ||||||
|
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. P3: The re-submission summary omits resource reuse, although the fixture asserts it alongside subject, source, and document reuse. Include Prompt for AI agents
Suggested change
|
||||||
| second video, workspace isolation, source | ||||||
| withdrawal and browser-role denial. It asserts no account, roster, song, song | ||||||
| identifier, artist, recording or release row is created and no song or artist | ||||||
| document is written. No provider is called. The chain applied in CI includes the | ||||||
| catalog and name/brief/text entry migrations so the `video` kind is checked against | ||||||
| the current subject constraints. | ||||||
|
|
||||||
| ## Brief snapshots | ||||||
|
|
||||||
| After `20260926170000_context_brief_snapshots.sql`, run `context_brief_snapshots.sql` | ||||||
|
|
||||||
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
P2: The PGDG bootstrap script is invoked without a version, so each matrix leg also installs the distro's default server (PostgreSQL 16 on ubuntu-24.04), and the
15leg installs and starts an extra default cluster on top of the pinned version. Pass the matrix version to the bootstrap with-vso only the intended server is installed, matching.github/workflows/release-players.yml.Prompt for AI agents