altimate-dbt execute fails with EMFILE: too many open files, watch on macOS #500
Description
On macOS, altimate-dbt execute fails with EMFILE: too many open files, watch even when the macOS maxfiles limit is raised to 65536 via sudo launchctl limit maxfiles 65536 200000 and ulimit -n 65536.
The error originates from the internal Node.js file watcher inside altimate-dbt, not from dbt itself. Running dbt show --inline directly works perfectly.
Steps to reproduce:
- macOS with dbt-duckdb project
- Run
altimate-dbt execute --query "SELECT 1 AS test" --limit 1 - Error:
{ "error": "EMFILE: too many open files, watch" }
Workaround: Run dbt show --inline directly.
The file watcher in altimate-dbt appears to be opening too many file descriptors regardless of the system limit. This may be related to watching dbt_packages/ which contains 443 macros and many files.
Metadata
| Field | Value |
|---|---|
| CLI Version | 0.5.13 |
| Platform | darwin |
| Architecture | arm64 |
| OS Release | 24.6.0 |
| Category | bug |
| Working Directory | dbt_project |
| Session ID | ses_2d2c1a524ffebQTMqSMFDpjWkG |