- Fork the repository
- Clone your fork:
git clone git@github.com:yourusername/automatos-testing.git - Install dependencies:
pip install -r requirements.txt - Run tests to ensure everything works:
python3 run_all_tests.py
- Place new tests in appropriate
phase*directories - Use the
ComprehensiveAPITesterutility class - Follow existing naming conventions:
comprehensive_*_test.py
- All tests must use real API calls (no mocking)
- Include proper error handling and logging
- Update configuration files if new test data needed
- Maintain 70% success threshold logic
- Follow PEP 8 Python style guidelines
- Use descriptive variable and function names
- Include docstrings for all classes and methods
- Add comments for complex logic
Include the following information:
- Python version and OS
- Complete error messages and stack traces
- Steps to reproduce the issue
- Expected vs actual behavior
- Relevant log files
- Describe the new testing capability needed
- Explain why it would be valuable
- Suggest implementation approach if possible
- Create a feature branch:
git checkout -b feature/new-test - Make your changes and test thoroughly
- Update documentation if needed
- Commit with clear, descriptive messages
- Push to your fork and create a pull request
- Ensure all existing tests still pass
Before submitting:
# Run all tests
cd testing_suites/comprehensive_5phase
python3 run_all_tests.py
# Run individual phases
python3 phase1_agent_management/scripts/comprehensive_agent_test.py
python3 phase2_workflow_orchestration/scripts/comprehensive_workflow_test.py
# ... etc- Be respectful and inclusive
- Focus on constructive feedback
- Help others learn and improve
- Follow open source best practices