Search U.S. Department of Labor PWD, PERM and H-1B LCA disclosure data — plus USCIS H-1B and I-140 statistics — in one place.
- Features
- Data sources
- Tech stack
- Getting started
- Configuration
- Testing
- Data imports
- Deployment
- Documentation
- Contributing
| Area | Route | What it does |
|---|---|---|
| PWD search | / |
Prevailing Wage Determinations, filtered by employer, job title, case number, location and year |
| PERM search | /perm |
PERM labor certifications, with related PWD lookups |
| H-1B LCA search | /h1b |
DOL H-1B Labor Condition Applications (H-1B1/E-3 excluded) |
| Case details | /cases/:id |
Wage and date summaries, grouped disclosure fields, original source values and alternate records |
| Employers | /employers |
Employer identities merged across programs by normalized name, FEIN and USCIS tax ID |
| Worksite map | /map |
Filings by state, metro, county, city and ZIP, with pan and zoom |
| USCIS H-1B decisions | /h1b-approvals |
Initial and continuing approvals and denials from the USCIS H-1B Employer Data Hub |
| I-140 statistics | /i140 |
National USCIS Form I-140 counts |
| Insights | on each search | Calendar-year trends and outcome shares for any filter set |
| Administration | /admin/data |
Admin-only uploads, automatic import status, coverage grid and validation reports |
- Shareable state. Search filters, page size, sort, pagination and layout choice all live in the URL.
- Prefix search. Employer, job-title, city/state and case-number searches match the beginning of the reported value; employer names tolerate punctuation and spacing differences.
- Honest data. Year filters use recorded calendar dates and never infer them from fiscal years. Wages keep their reported pay periods and are never silently annualized. Invalid source values are flagged and kept, not guessed.
- Fast results. Pages render before the total count is known; totals arrive separately. See search performance.
- Table or cards. Wide-screen comparison tables with sticky headers, responsive cards on mobile, and a saved layout preference.
All case data comes from public U.S. government disclosures:
- DOL OFLC performance data — PWD, PERM and H-1B LCA disclosure files
- USCIS H-1B Employer Data Hub — H-1B petition decisions
- USCIS Immigration and Citizenship Data — I-140 statistics
Coverage: PERM and H-1B from FY2008, PWD from FY2010 (DOL links no national PWD files for FY2008–FY2009). LaborLens is an independent project and is not affiliated with the U.S. Department of Labor or USCIS.
Browser ──► Frontend :3000 ──/api──► Backend :5001 ──► MongoDB :27017
React 19 + Vite 8 Express 5 + Mongoose 9 MongoDB 9.0.8
(build-time prerender) (Node 24)
| Directory | Contents |
|---|---|
frontend/ |
React SPA with React Router; public pages are prerendered at build time for SEO |
backend/ |
Express API (routes/, models/, services/) and the DOL import scripts |
k8s/ |
Kubernetes manifests, import CronJobs and the ArgoCD application |
ops/ |
Optional encrypted Google Drive backup utilities |
docs/ |
Design notes and data-coverage documentation |
- Docker with Docker Compose, or
- Node.js 24 and MongoDB 9.0.8
MongoDB is pinned to 9.0.8. Read the MongoDB migration and recovery notes before reusing an older database volume.
git clone https://github.com/blueandhack/LaborLens.git
cd LaborLens
docker-compose up --build -d| Service | URL |
|---|---|
| Frontend | http://localhost:3000 |
| Backend API | http://localhost:5001 |
| MongoDB | mongodb://localhost:27017 |
# Backend
cd backend
cp .env.example .env # fill in values
npm install
npm run dev # http://localhost:5001
# Frontend (in a second terminal)
cd frontend
npm install
npm run dev # http://localhost:3000The database starts empty. Sign in to Administration (footer link, /admin/data) with the initial admin password to upload a DOL .xlsx file, or run the importer.
See backend/.env.example:
| Variable | Service | Description | Default |
|---|---|---|---|
PORT |
Backend | API port | 5001 |
MONGO_URI |
Backend | MongoDB connection string | mongodb://localhost:27017/pwd_cases |
JWT_SECRET |
Backend | Secret for signing admin JWTs (required in production) | — |
ADMIN_INIT_PASSWORD |
Backend | Password for the initial admin account, used only when no admin exists | — |
BACKEND_URL |
Frontend | Vite dev proxy target | http://localhost:5001 |
cd backend && npm test # importer and API tests
cd frontend && npm test # frontend unit tests
cd frontend && npm run lintTo include the database integration tests, set MONGO_TEST_URI to a disposable MongoDB instance. Tests create and drop only a uniquely named laborlens_import_test_* database. CI runs the full suite against MongoDB 9.0.8.
Large DOL workbooks are stream-processed, fully validated before any case is written, and upserted by CASE_NUMBER. In production, Kubernetes CronJobs check DOL every Sunday and backfill historical files hourly until the archive is complete.
cd backend
npm run import:dol -- --discover # list current files, no writes
npm run import:dol # import current files
npm run import:dol -- --discover --from-year=2008 # inventory historical files
npm run import:dol -- --from-year=2008 --max-files=2 --backfill # resume backfill (safe to rerun)
npm run import:dol -- --force # replay already-imported filesScheduling, validation rules, duplicate handling, provenance and cluster commands are documented in Automatic DOL imports.
The project deploys with GitHub Actions and ArgoCD on k3s:
- A push to
mainruns the tests, then builds and pushes images toghcr.io/blueandhack/laborlens-*. - CI commits the new image tags to
k8s/. - ArgoCD detects the change and syncs the cluster.
To deploy your own instance:
- Set your repository URL in
k8s/argocd-app.yaml. - Create the required secret (see
docs/secret.example.yaml):kubectl create namespace laborlens kubectl create secret generic laborlens-secrets \ --from-literal=jwt-secret='...' \ --from-literal=admin-init-password='...' \ --from-literal=mongodb-app-uri='mongodb://laborlens_app:...@laborlens-mongodb:27017/pwd_cases?authSource=pwd_cases' \ --from-literal=mongodb-backup-local-uri='mongodb://laborlens_backup:...@127.0.0.1:27017/pwd_cases?authSource=admin' \ -n laborlens kubectl label secret laborlens-secrets -n laborlens app.kubernetes.io/instance=external
- Set your domain in
k8s/ingress.yaml. - Apply the ArgoCD application:
kubectl apply -f k8s/argocd-app.yaml
Optional encrypted backups and isolated restore testing are covered in the Google Drive backup guide.
| Topic | Document |
|---|---|
| Automatic and historical imports | docs/automatic-imports.md |
| Historical import audit | docs/historical-import-audit.md |
| H-1B LCA data and coverage | docs/h1b-data.md |
| USCIS H-1B petition decisions | docs/uscis-h1b.md |
| USCIS I-140 statistics | docs/i140.md |
| Employer identities | docs/employers.md |
| Worksite map | docs/map.md |
| Search insights | docs/search-insights.md |
| Search sorting | docs/search-sorting.md |
| Search performance | docs/performance.md |
| MongoDB upgrade and recovery | docs/mongodb-upgrade.md |
| Encrypted backups | docs/google-drive-backup.md |
| SEO audit | docs/seo-strategy.md |
Bug reports and pull requests are welcome. Please open an issue to discuss larger changes first, and run the tests before submitting a PR.
If LaborLens is useful to you, a ⭐ on GitHub helps others find it.