Skip to content

Fix PyLucene sidecar packaging and add smoke test#174

Draft
nvzm123 wants to merge 4 commits into
NVIDIA:mainfrom
nvzm123:pr-147
Draft

Fix PyLucene sidecar packaging and add smoke test#174
nvzm123 wants to merge 4 commits into
NVIDIA:mainfrom
nvzm123:pr-147

Conversation

@nvzm123

@nvzm123 nvzm123 commented Jul 8, 2026

Copy link
Copy Markdown

This builds on and can supersede #147.

PR #147 adds PyLucene support, but GPU E2E testing exposed several packaging/runtime issues:

  • the PyLucene sidecar merged Lucene-owned SPI descriptors, causing PyLucene to try loading incompatible Lucene providers
  • the sidecar flattened cuvs-java, which breaks its multi-release JDK 22 provider classes
  • PyLucene needs the base cuvs-java jar on the JVM classpath separately from the cuvs-lucene sidecar

This PR updates the sidecar to include only cuvs-lucene classes and service descriptors, removes Lucene-owned service providers from the cuvs-lucene SPI descriptor, documents the required classpath layout, and adds a PyLucene smoke-test wrapper.

Validation performed on a g5.2xlarge EC2 instance with NVIDIA A10G:

  • built cuvs-lucene against cuVS 26.08
  • built/installed PyLucene 10.0.0
  • ran CuVS2510GPUSearchCodec through PyLucene
  • indexed/searched 2,000 rows x 32 dimensions
  • verified cuVS index files were produced (.vcag, .vemc)

Passing smoke output:

PASS: CuVS2510GPUSearchCodec indexed/searched 2000 rows x 32 dims via PyLucene

@nvzm123 nvzm123 requested review from a team as code owners July 8, 2026 22:50
@nvzm123 nvzm123 requested a review from msarahan July 8, 2026 22:50
@copy-pr-bot

copy-pr-bot Bot commented Jul 8, 2026

Copy link
Copy Markdown

This pull request requires additional validation before any workflows can run on NVIDIA's runners.

Pull request vetters can view their responsibilities here.

Contributors can view more details about this message here.

@nvzm123 nvzm123 marked this pull request as draft July 9, 2026 19:58
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants