Skip to content

fix: use 260 AiEvalDef tags @W-21834632@#244

Merged
EstebanRomero84 merged 1 commit intomainfrom
wr/fixGeneratedAiEvalDef
Apr 6, 2026
Merged

fix: use 260 AiEvalDef tags @W-21834632@#244
EstebanRomero84 merged 1 commit intomainfrom
wr/fixGeneratedAiEvalDef

Conversation

@WillieRuemmele
Copy link
Copy Markdown
Member

@WillieRuemmele WillieRuemmele commented Apr 3, 2026

What does this PR do?

updates the generated AiEvaluationDefinition metadata generated with new tags:

        <expectation>
            <expectedValue>local_weather_16jD60000004CN5</expectedValue>
            <name>topic_sequence_match</name>
        </expectation>
        <expectation>
            <expectedValue>[]</expectedValue>
            <name>action_sequence_match</name>
        </expectation>
        <expectation>
            <expectedValue>22</expectedValue>
            <name>bot_response_rating</name>

vs the old:

        <expectation>
            <expectedValue>local_weather_16jD60000004CN5</expectedValue>
            <name>topic_assertion</name>
        </expectation>
        <expectation>
            <expectedValue>[]</expectedValue>
            <name>actions_assertion</name>
        </expectation>
        <expectation>
            <expectedValue>22</expectedValue>
            <name>output_validation</name>
        </expectation>

What issues does this PR fix or reference?

@W-21834632@

@EstebanRomero84
Copy link
Copy Markdown
Contributor

QA Notes

I verified that the agent test create command a generates valid .aiEvaluationDefinition file with the correct tags.

@EstebanRomero84 EstebanRomero84 merged commit a1844c3 into main Apr 6, 2026
19 checks passed
@EstebanRomero84 EstebanRomero84 deleted the wr/fixGeneratedAiEvalDef branch April 6, 2026 20:41
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants