How much does the student disagree with the teacher?

Slide the student's distribution and watch the KL term react.

q(class A)0.50
p[0.7, 0.3]
q-
KL(p||q)-

KL is asymmetric. When q puts too little mass where p is large, the penalty spikes.