Skip to content

Implement Sidekiq for background job processing - #63

Draft
hopgausi wants to merge 2 commits into
mainfrom
feat/improve-cronjobs
Draft

hopgausi wants to merge 2 commits into
mainfrom
feat/improve-cronjobs

Conversation

@hopgausi

Copy link
Copy Markdown

Introduce Sidekiq for managing background jobs, including six new worker classes for various tasks. Configure job scheduling and enhance logging and error handling. Ensure site_id presence for async check-in jobs and remove old cronjob dependencies. Provide deployment and management scripts for easier Sidekiq operations.

- Created 6 Sidekiq worker jobs: LogTrackingNumbersJob, SyncToNlimsJob, PullFromMasterNlimsJob, AcknowledgeResultsJob, UpdateOrderSourceCouchIdJob, and CleanupStaleLockJob.
- Configured job scheduling in config/schedule.yml and initialized Sidekiq in config/initializers/sidekiq.rb.
- Developed deployment files including systemd service (config/nlims-sidekiq.service) and automated setup script (bin/setup_sidekiq.sh).
- Added a management script (bin/manage_sidekiq.sh) for easier Sidekiq operations.
- Updated crontab example to reflect new Sidekiq approach, ensuring Redis and Sidekiq are running.
- Enhanced logging and error handling across all jobs for better monitoring and troubleshooting.
- Removed old cronjob dependencies, transitioning to a Sidekiq-managed job system.
@hopgausi
hopgausi marked this pull request as draft June 1, 2026 08:43
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant