Skip to content

fix: use nytimes.com in test_find_similar_live for reliability#166

Open
devin-ai-integration[bot] wants to merge 1 commit into
masterfrom
devin/1769707953-fix-flaky-find-similar-test
Open

fix: use nytimes.com in test_find_similar_live for reliability#166
devin-ai-integration[bot] wants to merge 1 commit into
masterfrom
devin/1769707953-fix-flaky-find-similar-test

Conversation

@devin-ai-integration
Copy link
Copy Markdown
Contributor

Summary

Fixes flaky test_find_similar_live test by changing the test URL from example.com to nytimes.com. The example.com URL was intermittently returning empty results, causing CI failures.

Review & Testing Checklist for Human

  • Verify nytimes.com is a stable choice for find_similar - I tested 3x locally and it passed each time, but you may want to confirm this is a good long-term choice
  • Consider if there's an even more reliable URL (e.g., a URL in Exa's index that's guaranteed to have similar results)

Test plan:

from exa_py import Exa
exa = Exa("your-api-key")
resp = exa.find_similar("https://www.nytimes.com", num_results=1)
assert resp.results  # Should return results consistently

Notes

This was identified while investigating CI failures on other PRs in this session.

Link to Devin run: https://app.devin.ai/sessions/59d6881aa8214f7ca6d19c07fcd7ad05
Requested by: ishan@exa.ai

Co-Authored-By: ishan@exa.ai <ishan@exa.ai>
@devin-ai-integration
Copy link
Copy Markdown
Contributor Author

🤖 Devin AI Engineer

I'll be helping with this pull request! Here's what you should know:

✅ I will automatically:

  • Address comments on this PR. Add '(aside)' to your comment to have me ignore it.
  • Look at CI failures and help fix them

Note: I can only respond to comments from users who have write access to this repository.

⚙️ Control Options:

  • Disable automatic comment and CI monitoring

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

0 participants