-
-
Notifications
You must be signed in to change notification settings - Fork 0
fix(ci): the invisible-character gate never matched anything #49
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
base: main
Are you sure you want to change the base?
Changes from all commits
File filter
Filter by extension
Conversations
Jump to
Diff view
Diff view
There are no files selected for viewing
| Original file line number | Diff line number | Diff line change | ||||
|---|---|---|---|---|---|---|
|
|
@@ -128,7 +128,7 @@ jobs: | |||||
| # Checks for: zero-width spaces, zero-width joiners, BOM, soft hyphens, | ||||||
| # non-breaking spaces, null bytes, and other invisible Unicode in source files. | ||||||
| set +e | ||||||
| PATTERNS='\xc2\xa0|\xe2\x80\x8b|\xe2\x80\x8c|\xe2\x80\x8d|\xef\xbb\xbf|\xc2\xad|\xe2\x80\x8e|\xe2\x80\x8f|\xe2\x80\xaa|\xe2\x80\xab|\xe2\x80\xac|\xe2\x80\xad|\xe2\x80\xae|\x00' | ||||||
| PATTERNS='\x00|[\x01-\x08\x0B\x0C\x0E-\x1F]|\x{a0}|\x{ad}|\x{200b}|\x{200c}|\x{200d}|\x{200e}|\x{200f}|\x{202a}|\x{202b}|\x{202c}|\x{202d}|\x{202e}|\x{2060}|\x{feff}' | ||||||
|
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. 🔴 HIGH RISK Unicode escapes like \x{200b} and \x{feff} will fail to match multi-byte UTF-8 sequences unless the PCRE engine is in UTF-8 mode. Prefix the pattern with (*UTF) to ensure these invisible characters are correctly detected.
Suggested change
|
||||||
| find "$GITHUB_WORKSPACE" \ | ||||||
| -not -path '*/.git/*' -not -path '*/node_modules/*' \ | ||||||
| -not -path '*/.deno/*' -not -path '*/target/*' \ | ||||||
|
|
@@ -139,7 +139,7 @@ jobs: | |||||
| -o -name '*.yml' -o -name '*.yaml' -o -name '*.md' -o -name '*.adoc' \ | ||||||
| -o -name '*.idr' -o -name '*.zig' -o -name '*.v' -o -name '*.jl' \ | ||||||
| -o -name '*.gleam' -o -name '*.hs' -o -name '*.ml' -o -name '*.sh' \) \ | ||||||
| -exec grep -Prl "$PATTERNS" {} \; > /tmp/empty-lint-results.txt 2>/dev/null | ||||||
| -exec grep -aPrl "$PATTERNS" {} \; > /tmp/empty-lint-results.txt 2>/dev/null | ||||||
|
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. ⚪ LOW RISK Suggestion: Optimize the 'find' execution by batching file arguments and removing the redundant recursive '-r' flag from 'grep'. The '-r' flag is unnecessary because 'find' already performs the directory traversal and provides specific file paths to 'grep'.
Suggested change
|
||||||
| EL_EXIT=$? | ||||||
| set -e | ||||||
|
|
||||||
|
|
||||||
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
🎯 Functional Correctness | 🟡 Minor | ⚡ Quick win
Add the separate leading-BOM check.
Line 131 only places
\x{feff}in thegrep -Ppattern. It does not implement the separate leading-BOM check required by the PR objective. A file with a leading UTF-8 BOM can therefore pass the gate. Add a byte-level check for the first three bytes and merge those paths into/tmp/empty-lint-results.txt; keep\x{feff}for embedded BOMs.🤖 Prompt for AI Agents