Activation Function

A non-linear function (ReLU, sigmoid, tanh) applied after each neural network layer. Without it, stacking layers would collapse into a single linear transformation — it’s what lets networks learn complex patterns.