In a layer where weights and bias are learnable parameters, which sequence correctly describes the calculation from input to output?
- 1. Multiply the input by W, add b, then apply ReLU.
- 2. Add b to the input, multiply by W, then apply ReLU.
- 3. Apply ReLU first, then use W and b.
- 4. Average W and b, then combine them with the input.
Answer: Multiply the input by W, add b, then apply ReLU.
Explanation: The layer multiplies the input by the weight W, adds the bias b, and passes the result through ReLU. The other choices change that order or use an unrelated operation.