Skip to content
TDK-99Public

About

πŸ” Stop refreshing LinkedIn. This pipeline scrapes new job listings based on your settings, uses AI agents to summarize each one and score it against your CV, then delivers only the best matches straight to your inbox πŸ“¬ β€” so you're always first to apply πŸš€

Topics

Resources

Contributing

Stars

36 stars

Watchers

0 watching

Forks

Latest commit

Β 

History

316 Commits

Folders and files

Repository files navigation

πŸ” SnapplAI β€” AI-Powered LinkedIn Job Alerts

πŸ“– Contributing Β· ❓ Get Help

Stop refreshing LinkedIn. This pipeline scrapes new job listings based on your settings, uses AI agents to summarize each one and score it against your CV, then delivers only the best matches straight to your inbox πŸ“¬ β€” so you're always first to apply πŸš€

Python Google GenAI pandas python-jobspy License


πŸ“‘ Table of Contents


🎯 The Problem

Job hunting on LinkedIn is a full-time job in itself. New listings appear daily, most are irrelevant, and by the time you spot a good one, 200 people have already applied.

SnapplAI flips the game: it runs on a schedule, scrapes fresh listings, lets AI read and score every single one against your CV, and emails you only the top matches β€” before the crowd even sees them.


βš™οΈ How It Works

The pipeline runs in 4 sequential steps, fully automated:

1. Scrape β†’ job_scraper() pulls fresh listings from LinkedIn based on your search settings (role, location, filters) using python-jobspy.

2. Summarize β†’ agentic_summarize() sends each job description to Gemini, which extracts structured fields (title, seniority, skills, salary, etc.) as clean JSON.

3. Analyze β†’ agentic_analyze() reads your CV and scores each listing on how well it matches your profile. Chain-of-thought enforced: the model writes analysis before score in the JSON schema, so reasoning comes before judgment.

4. Deliver β†’ send_email() builds an email with the top-scored jobs and sends it to your inbox via SMTP.

5. Apply and analytics β†’ Two attachments complete the report: top match, a filtered Excel with all scraped jobs, and an analytics .txt summarizing the batch.

--

Resilience: each Gemini call retries with exponential backoff on transient errors (429/500/503) and falls back through a fixed chain (gemini-3.5-flash-lite β†’ gemini-3.1-flash-lite), so a temporarily overloaded model no longer crashes the whole pipeline.

Key principle: AI reads and evaluates. Python orchestrates and delivers. No frameworks, no agents-calling-agents β€” just a clean data pipeline with LLM calls where they matter.


πŸ”§ Tech Stack

Component Technology
LLM Google GenAI SDK β€” gemini-3.5-flash-lite (primary), gemini-3.1-flash-lite (fallback)
Resilience Retry with exponential backoff + fixed model fallback chain (src/llm.py)
Scraping python-jobspy (LinkedIn)
Data pandas, PyPDF / PyMuPDF
Parsing BeautifulSoup4
Email smtplib (SMTP) β€” provider-agnostic (Gmail, Outlook/Office365, ...)
Config python-dotenv

πŸ—οΈ Pipeline Architecture

Pipeline Architecture

The entire pipeline operates on a single pandas DataFrame that gets enriched at each step. No intermediate files, no database β€” everything flows through memory.


πŸ“Š AI Output Fields

Pipeline Architecture

Each job in the email is ranked by fit score and includes:

  • city, company, role, and work mode
  • a one-line AI summary explaining the match
  • a direct apply link to the LinkedIn listing

Two attachments complete the report: a filtered Excel with all scraped jobs, and an analytics .txt summarizing the batch.


πŸš€ Setup

  1. Get a free API key from Google AI Studio
  2. Generate an app password for your email (e.g. Gmail App Password). For non-Gmail providers, set SMTP_HOST/SMTP_PORT in .env β€” e.g. Outlook/Office365 uses smtp.office365.com on port 587 (STARTTLS); Gmail defaults to smtp.gmail.com on 465 (SSL).
  3. Place your CV (PDF) in your_cv_config/
  4. Configure search settings: config your file_config.env
  5. Create your .env from the template: cp example_env.txt .env

Deploy

Local

git clone https://github.com/TDK-99/SnapplAI.git && cd SnapplAI
pip install -r requirements.txt
# complete setup steps above
python main.py

Docker

git clone https://github.com/TDK-99/SnapplAI.git && cd SnapplAI
# complete setup steps above
docker build -t snapplai .
docker run --env-file .env snapplai

GitHub Actions

  1. Fork this repo (or create a private copy)
  2. Complete setup steps 1-4 above in your fork
  3. Delete the # on schedule and -cron for action auto start
  4. Add credentials as repository secrets (Settings β†’ Secrets β†’ Actions): GOOGLE_API_KEY, GMAIL_USER, GMAIL_APP_PASSWORD
  5. Actions tab β†’ enable workflows β†’ Run workflow (for manual)

πŸ“ Project Structure

SnapplAI/
β”œβ”€β”€ main.py                 # Entry point β€” runs the 4-step pipeline
β”œβ”€β”€ src/
β”‚   β”œβ”€β”€ daily_scraper.py    # LinkedIn scraping with python-jobspy
β”‚   β”œβ”€β”€ ai_agents.py        # Gemini calls: summarize + analyze
β”‚   β”œβ”€β”€ llm.py              # Resilient Gemini wrapper: retry/backoff + model fallback
β”‚   β”œβ”€β”€ smtp.py             # Email builder and SMTP sender
β”‚   └── pydantic.py         # pydantic class for force ai output
β”œβ”€β”€ tests/
β”‚   β”œβ”€β”€ test_ai_analyze.py  # Unit test for AI analysis agent
β”‚   β”œβ”€β”€ test_job_scraper.py # Unit test for the LinkedIn scraper
β”‚   β”œβ”€β”€ test_ai_summarize.py # Unit test for AI summarize agent
β”‚   β”œβ”€β”€ test_pydantic.py    # Unit test for pydantic validation
β”‚   └── test_smtp.py        # Unit test for SMTP email sending
β”œβ”€β”€ your_cv_config/
β”‚   β”œβ”€β”€ .gitkeep            # Keeps folder tracked in git
β”‚   β”œβ”€β”€ file_config.env     # Your settings (role, location, filters)
β”‚   β”œβ”€β”€ file_config.txt     # Additional config parameters
β”‚   └── Your_CV.pdf         # Your CV goes here (PDF)
β”œβ”€β”€ assets/                 # Output screenshots and docs images
β”œβ”€β”€ .github/
β”‚   └── workflows/
β”‚       β”œβ”€β”€ snapplai.yml    # GitHub Actions workflow (scheduled + manual)
β”‚       β”œβ”€β”€ ci.yml          # CI pipeline β€” runs tests on push/PR
β”‚       └── yml.example     # Template for GitHub Actions workflow
β”œβ”€β”€ Dockerfile              # Run anywhere with Docker
β”œβ”€β”€ .env                    # API keys and SMTP credentials (git-ignored)
β”œβ”€β”€ .gitignore
β”œβ”€β”€ example_env.txt         # Template for .env variables
β”œβ”€β”€ requirements.txt        # Dependencies
β”œβ”€β”€ CONTRIBUTING.md         # Contribution guidelines
β”œβ”€β”€ SUPPORT.md              # Support and contact info
β”œβ”€β”€ CLAUDE.md               # Repo workflow standards for Claude Code
β”œβ”€β”€ LICENSE                 # MIT
└── README.md

πŸ›£οΈ Roadmap v2

  • βœ…Multi-country scraping β€” search across 2+ countries in a single run (custom feature, not supported by python-jobspy out of the box)
  • Excel/DB deduplication β€” persistent storage to compare runs and filter out already-seen listings, so you never score the same job twice
  • Scoring calibration β€” benchmark AI scores against known good/bad matches to improve match quality
  • βœ…Output redesign β€” better visual formatting for the email report (job cards, readability, direct links)
  • βœ…Fix issue β€” fix main issue: fallback model e smtp for non @gmail user

🀝 Contributing

Contributions are welcome β€” bug fixes, new features, or docs improvements.

  • Issues β€” Report bugs or suggest features
  • Pull Requests β€” Fork, build, submit

πŸ“„ License

MIT β€” see LICENSE

About

πŸ” Stop refreshing LinkedIn. This pipeline scrapes new job listings based on your settings, uses AI agents to summarize each one and score it against your CV, then delivers only the best matches straight to your inbox πŸ“¬ β€” so you're always first to apply πŸš€

Topics

Resources

Contributing

Stars

36 stars

Watchers

0 watching

Forks

Releases

Packages

Used by

Contributors

Languages