Skip to content

Latest commit

 

History

History
48 lines (33 loc) · 2.2 KB

README.md

File metadata and controls

48 lines (33 loc) · 2.2 KB

filetype/javascript

LightGBM specialist for javascript. Member of the Azoth routed ensemble; bundle root: ../...

Level labels use the shared pool-adjusted FP allowance: L0 allows zero observed calibration FPs; L1 allows one; L25 adds an estimated 24 FP/100M beyond the initial FP.

Ensemble Performance

Routed ensemble (general + filegroup + filetype where applicable) on the javascript slice of the locked test partition: 18,106 malware / 227,683 benign (245,789 rows).

PR AUC ROC AUC F1 Recall @ L25 Brier
0.990889 0.998567 0.865320 76.31% -

Specialist Performance

filetypes/javascript specialist scored alone on the same held-out slice, using its saved thresholds.

PR AUC ROC AUC F1 Recall @ L25 Brier Δ vs EMBER 2024
0.992196 0.998737 0.743355 59.16% 0.0037 —

Recall by FP level (pool-adjusted)

javascript: recall by FP level (pool-adjusted)

Each curve plots recall at the route's pool-adjusted FP level. L0 allows zero observed calibration FPs; positive L allows 1 + (L - 1) * N / 100_000_000 for N benigns. See the shared level definition. The vertical dashed line marks the L25 deploy operating point.

Routing

Files matching javascript are scored by filegroups/scripts, filetypes/javascript, general. The ensemble's decisions apply the saved routing policy, including every level at or below the requested level. Ranking metrics use the signed distance from that policy's decision boundary. See route_policies.md.

Training

Parameter Value
Algorithm LightGBM binary classifier
Train rows 1,473,378 (112,023 mal / 1,361,355 ben)
Feature spec 21958 features (route_specific)
n_estimators 400
num_leaves 96
max_depth 12
min_child_samples 100
learning_rate 0.05
subsample / colsample 0.8 / 0.8
reg_alpha / reg_lambda 0.0 / 1.0
early_stopping_rounds 25
device auto