The softmax function for classes is given by
.
It transforms a vector of real values into a probability mass vector for a categorical distribution. It is often used in conjunction with the cross-entropy loss
- Find a simplified expression for when .
- Differentiate with respect to .
- Differentiate with respect to .
What is the variable k in Q1 ?
LikeLike
I considered it the number of classes.
LikeLiked by 1 person
I think it should be m, it is just a mistake.
LikeLike
it gives sigmoid function as in Q5.
LikeLike
1. sigmoid
2.
3.
LikeLike