Skip to content

Absorb DevHub recipe patterns into agent skills#76

Open
pkosiec wants to merge 7 commits into
mainfrom
pkosiec/incorporate-devhub-recipes
Open

Absorb DevHub recipe patterns into agent skills#76
pkosiec wants to merge 7 commits into
mainfrom
pkosiec/incorporate-devhub-recipes

Conversation

@pkosiec
Copy link
Copy Markdown
Member

@pkosiec pkosiec commented May 14, 2026

Summary

Unifies 21 DevHub recipes under agent skills as the single source of truth (Phase 2 of the Reconciliation Report).

  • 4 new reference files: pgvector, lakehouse-sync, off-platform (with @databricks/lakebase), medallion-from-cdc
  • 9 enriched existing files: model-serving (AI SDK v6 streaming + embeddings), lakebase (chat persistence + naming), genie (multi-space deployment + troubleshooting), synced-tables (timeseries_key + cost + FGAC), files (user_api_scopes), apps SKILL (State Storage Rule + post-deploy), lakebase SKILL (JSON paths + refs), model-serving SKILL (scale_to_zero), pipelines SKILL (medallion ref)
  • Manifest regenerated and validated

Companion DevHub PR deletes 15 absorbed recipes and converts cookbooks to lightweight skill-referencing prompts.

Test plan

  • python3 scripts/skills.py validate passes
  • Spot-check relative links in new files resolve correctly
  • Verify no regressions in existing content (additions only)
  • Run eval suite against skills-only configuration
  • Run evals (in sync with @keugenek)

This pull request and its description were written by Isaac.

Unify 21 DevHub recipes under agent skills as the single source of truth.

New reference files:
- pgvector.md: vector similarity search with pgvector extension
- lakehouse-sync.md: CDC from Lakebase Postgres to Unity Catalog
- off-platform.md: env management, token refresh, Drizzle ORM (@databricks/lakebase)
- medallion-from-cdc.md: Silver/Gold layers from CDC history tables

Enrichments to existing skills:
- model-serving.md: AI SDK v6 streaming, embeddings, AI Gateway patterns
- lakebase.md: chat persistence, naming conventions, project-owner exception
- genie.md: multi-space deployment, troubleshooting
- synced-tables.md: timeseries_key, cost guidance, FGAC workaround
- files.md: user_api_scopes for OBO
- databricks-apps/SKILL.md: State Storage Rule, post-deploy verification
- databricks-lakebase/SKILL.md: reference links, JSON path table, pgvector cross-ref
- databricks-model-serving/SKILL.md: scale_to_zero_enabled, model discovery
- databricks-pipelines/SKILL.md: medallion-from-cdc reference link

Co-authored-by: Isaac
pkosiec added 3 commits May 14, 2026 19:45
- model-serving: fix placeholder style (<ENDPOINT_NAME>), add cloud-variant
  comment for AI Gateway URL, clarify tRPC heading, add off-platform note
  for AI SDK v6 pattern
- lakehouse-sync + synced-tables: fix Lakehouse Sync availability to
  AWS/Azure/GCP per official docs
- genie: add missing genie_space_name variable in Multi-Space snippet
- off-platform: add verify-full/verify-ca to PGSSLMODE Zod enum, add
  cross-references section
- pgvector: reorder schema creation before table existence check
- SKILL.md: clarify State Storage Rule vs Decision Gate scope
- lakebase: add platform proxy context for x-forwarded-email header

Co-authored-by: Isaac
- Move off-platform AI SDK v6 streaming/embeddings patterns from
  databricks-apps to databricks-model-serving (they don't use AppKit)
- Replace deprecated server({ autoStart: false }) + .then() + .start()
  with onPluginsReady callback in lakebase.md
- Clarify OBO scope requirement in files.md (only for .asUser(req) API)
- Deduplicate scaffolding instructions in lakebase.md (reference SKILL.md)
- Fix databricks apps logs to use --follow for streaming
- Drop stale dollar costs in synced-tables.md, keep relative guidance
- Move medallion-from-cdc.md from databricks-pipelines to databricks-lakebase
  (it's a Lakehouse Sync continuation, not a general pipeline pattern)

Co-authored-by: Isaac
Keep the full --features lakebase commands with --set flags inline
rather than referencing SKILL.md — agents need copy-pasteable commands
when working on a Lakebase app.

Co-authored-by: Isaac
@pkosiec pkosiec requested a review from keugenek May 15, 2026 12:09
- lakehouse-sync.md: Fix CDC column names (_change_type → _pg_change_type,
  _lsn → _pg_lsn, _commit_timestamp → _timestamp), add missing columns
  (_pg_xid, _sort_by), label rename-and-swap as community guidance
- medallion-from-cdc.md: Fix CDC column names in Silver layer SQL, remove
  invalid development: true from pipeline YAML, fix cross-reference paths
- off-platform.md: Remove nonexistent list-databases CLI command, fix
  Drizzle API (drizzle(pool) → drizzle({ client: pool })), add
  Autoscaling-only limitation note and README link
- pgvector.md: Clarify <#> is negative inner product
- databricks-pipelines/SKILL.md: Remove broken medallion-from-cdc link
  (moved to databricks-lakebase, referenced from lakehouse-sync.md)
- databricks-apps/SKILL.md: Update description (user change)
- Regenerate manifest.json

Co-authored-by: Isaac
@pkosiec pkosiec force-pushed the pkosiec/incorporate-devhub-recipes branch from 7c63c06 to 1d6c5af Compare May 15, 2026 12:14
@pkosiec pkosiec marked this pull request as ready for review May 15, 2026 12:15
@pkosiec pkosiec requested review from a team, lennartkats-db and simonfaltum as code owners May 15, 2026 12:15
pkosiec added 2 commits May 15, 2026 14:20
- Fix broken cross-reference in synced-tables.md pointing to
  pipelines skill instead of sibling medallion-from-cdc.md
- Replace AppKit getWorkspaceClient with sdk-experimental
  WorkspaceClient in off-platform-streaming.md embeddings pattern
- Add SPACES context comment in genie.md initAlias() snippet
- Regenerate manifest

Co-authored-by: Isaac
Drop ~100 lines of hand-rolled two-token refresh plumbing from
off-platform.md — the @databricks/lakebase driver handles all of
this automatically. Replace drizzle-kit shell migration with
Drizzle's programmatic migrator using createLakebasePool() directly.

Co-authored-by: Isaac
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant