5.2. Permutation feature importance
A model-inspection guide explaining permutation importance and its limitations when predictors are strongly correlated.
External resource. No execution or independent verification is claimed here.
How does duplicating a predictive feature change individual permutation-importance scores while predictive accuracy stays comparable?
Use a known evaluator-generated signal and independent held-out scoring, retain repeated permutations and compare individual with grouped feature perturbations.
What you could produce
- A versioned minimal protocol, evaluator-owned test cases, and a comparison report with numerical/statistical uncertainty and failures.
Before you use it
- scikit-learn 1.9.1
- Compatible NumPy/SciPy and compiled dependencies; exact environment not prepared
Limits to keep in view
- No upstream example, source package, build hook or submitted code was executed.
- The current qualified pilot accepts only self-contained Python 3.13 with a 90-second deadline. This reference's package/runtime is not qualified for that path.
- The proposed protocol requires bounded resource estimates and an independently controlled evaluator before any scientific execution claim.
Source and permission context
scikit-learn documentation. 5.2. Permutation feature importance. https://scikit-learn.org/stable/modules/permutation_importance.html; observed version 1.9.1 (observed documentation version; stable URL is mutable).
Rights need review. Review the scope and upstream conditions before reuse.
documentation · BSD-3-Clause
This documentation page credits the developers and explicitly labels its footer BSD License; the matching 1.9.1 COPYING file identifies the three-clause terms. Referenced datasets and separately licensed material are not cleared.
Inspect the license evidence ↗Still unresolved
- Third-party figures, linked papers, datasets and dependency licenses have not been assessed; no external content is copied into this catalog.