Home / Glossary
Hyperparameter
Definition
A hyperparameter is a setting chosen before a machine learning model is trained that governs the learning process itself — such as learning rate, batch size, or the number of layers. Unlike model parameters (weights), which are learned from data, hyperparameters are set by the practitioner and tuned to optimize performance.
Why it matters
Hyperparameters are the dials that decide whether a model learns well, learns slowly, or fails to learn at all. Two teams can use the same data and the same algorithm and get very different results purely because of how they set values like the learning rate. In production AI — the kind that powers automation workflows and lead scoring — good hyperparameter choices are often the difference between a model that ships and one that stalls.
For B2B teams, the practical takeaway is that AI performance isn’t magic; it’s tuned. Understanding hyperparameters helps you ask the right questions of a vendor or internal team: how was this model validated, how were settings chosen, and how will it be re-tuned as data drifts? That governance is what keeps an AI system reliable after launch.
How it works
Hyperparameters are set before training and adjusted through experimentation:
- Common examples — learning rate (how big each update step is), batch size (how many samples per update), number of layers or trees, and regularization strength (how much the model is penalized for complexity).
- Tuning methods — practitioners search for good values using grid search, random search, or more efficient Bayesian optimization, evaluating each configuration on a validation set.
- Trade-offs — settings balance underfitting (too simple to capture patterns) against overfitting (memorizing the training data and failing on new data).
The goal is a configuration that generalizes — performing well on data the model hasn’t seen. Because the best values depend on the data and the task, hyperparameter tuning is iterative rather than fixed. Curious how tuned AI could streamline your operations? Explore our AI automation services or book a free audit.
Related terms
Want this handled for you? See our services →
Ready when you are
Confused by AI search? We’re not.
Get a free audit and a clear picture of your visibility.