Fork main to upstream main#168
Closed
thestumonkey wants to merge 73 commits into
Closed
Conversation
test framework streams faster than realtime and so we need this to wait
- Runs Robot Framework test suite on all branch pushes - Triggers on changes to test files and backend source code - Publishes test results and HTML reports as artifacts - Includes test summary in workflow output
- Create fresh .env file instead of appending to template - Eliminates duplicate key issues with ADMIN_EMAIL, OPENAI_API_KEY, etc. - Add TRANSCRIPTION_PROVIDER configuration - Improve readability with comments
- Create .env.test in tests/setup/ instead of tests/ - Matches what test_env.py expects (Path(__file__).parent / '.env.test') - This was causing test setup failures in CI
- Use docker-compose-test.yml explicitly in all commands - Add better health check loops with progress indicators - Show container status and logs on failures - Increase timeout attempts with clearer error messages - Fix cleanup to use correct compose file - Remove push trigger (PR-only workflow)
- Fix TEST_AUDIO_FILE path: remove duplicate 'tests/' prefix - Add clear instructions for downloading HTML reports from artifacts - Improve summary output formatting
- Update .gitignore to allow tests/test_assets/*.wav files - Add DIY_Experts_Glass_Blowing test audio files (1min and 4min) - Install websockets package for audio_stream_library.py - Add OPENAI_API_KEY, OPENAI_BASE_URL, OPENAI_MODEL to test step - Required for backend imports when loading test libraries
Updates robot-tests.yml to post test results as PR comments while maintaining GitHub Pages deployment: - Parse test results from output.xml - Post formatted comment with pass/fail summary table - Include direct links to GitHub Pages reports (report.html, log.html) - Include links to downloadable artifacts - Keep existing GitHub Pages deployment for live reports 🤖 Generated with [Claude Code](https://claude.com/claude-code) Co-Authored-By: Claude <noreply@anthropic.com>
This commit simplifies the robot-tests GitHub workflow by following the same pattern as integration-tests.yml - delegating all logic to a local test runner script. Changes: - Add tests/run-robot-tests.sh (mirrors backends/advanced/run-test.sh) - Handles environment setup and service orchestration - Delegates test execution to Makefile - Supports CLEANUP_CONTAINERS and OUTPUTDIR configuration - Provides colored output and comprehensive error handling - Simplify .github/workflows/robot-tests.yml - Reduce from 413 to ~150 lines - Remove inline Docker setup, service orchestration - Just calls ./run-robot-tests.sh with API keys - Update tests/README.md - Add Quick Start section documenting new script - Explain configuration options - Show local development workflow Benefits: - Consistency with integration-tests workflow pattern - Single source of truth for test logic (script, not YAML) - Same script works locally and in CI - Easier debugging with CLEANUP_CONTAINERS=false - Simpler maintenance 🤖 Generated with [Claude Code](https://claude.com/claude-code) Co-Authored-By: Claude <noreply@anthropic.com>
…ion creation - Increase from 200 to 300 chunks to ensure enough speech detected in CI - Helps ensure open_conversation job is reliably created before checking
The refactored version had several issues: - Missing Docker build cache management (slower builds) - Less visibility into worker validation - Reduced debugging output - Container cleanup issues Restoring the original workflow that had all tests passing.
- Escape template literal syntax to prevent YAML parsing errors - Indent template literal content properly - Add .secrets to .gitignore - Add ACT_GUIDE.md with instructions for local GitHub Actions testing The YAML parser was interpreting ** at start of lines as YAML anchors. Escaping the backticks and $ symbols fixes this.
This helps create test fixtures so we can omit fixture folder from test clears
# Conflicts: # .github/workflows/robot-tests.yml
- env: must come BEFORE run: in GitHub Actions YAML - Previous commit had them in wrong order causing secrets to be empty - Removed unnecessary verification and export steps
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
No description provided.