feat: add AI-assisted OSPS-QA-06.02 evaluation and config docs#326
Open
vinayada1 wants to merge 2 commits into
Open
feat: add AI-assisted OSPS-QA-06.02 evaluation and config docs#326vinayada1 wants to merge 2 commits into
vinayada1 wants to merge 2 commits into
Conversation
Signed-off-by: Vinaya Damle <vinayada1@users.noreply.github.com>
Signed-off-by: Vinaya Damle <vinayada1@users.noreply.github.com>
vinayada1
changed the title
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
This PR adds the first AI-assisted scanner evaluation for OSPS-QA-06.02 and documents how to configure and interpret the new behavior.
Changes in this branch:
example-config.ymlBehavior
When AI is configured successfully, OSPS-QA-06.02 evaluates contributor-facing test execution guidance found in README and CONTRIBUTING content and returns a structured pass/fail result.
When AI is configured incorrectly, unavailable, times out, or returns an unusable response, the scanner falls back to the existing review-needed behavior instead of failing the run.
Review Guidance
This branch includes the implementation for #318 and the related documentation updates for #319 together.
Please review the implementation changes for #318 first, since the documentation updates in this branch describe the behavior introduced by that code.
Dependencies
This PR depends on the SDK AI foundation being available in
privateer-sdkbefore the scanner branch can merge cleanly.Related SDK work:
Issues