← Back to the library
Data science and analytics

NLP: weight decay bias exclusion

Exclude bias terms and LayerNorm weights from weight decay to prevent regularization from distorting normalization layers

Works with the context you provideVersion 1.0.0

Nlp weight decay bias exclusion

Use this skill for the outcome in its description. Start with the supplied request and evidence, identify the specific task, and distinguish planning from execution. Do not trigger solely because the subject happens to be fashion, retail, or a technology named in an example. Read `references/execution-contract.md` before applying a retained source method.

Select the narrowest matching method below, then read its full entrypoint and the resources it requires. If multiple methods cover the same outcome, choose the one matching the user's environment and inputs; do not run them all. Retain each method's input requirements, decision steps, validation, output structure, and failure handling. If prerequisites are absent, use its honest proposal-only fallback or state that its documented path is blocked.

  • **wenmin-wu/nlp-weight-decay-bias-exclusion**: Exclude bias terms and LayerNorm weights from weight decay to prevent regularization from distorting normalization layers Read `references/wenmin-wu/skills/nlp/weight-decay-bias-exclusion/SKILL.md`.

Return the requested deliverable with evidence, assumptions, validation performed, unresolved dependencies, and actual execution status. Source-specific results must be verified independently; importing these methods does not establish a working service connection.