KL Zero: KL divergence intuition game

psarna1 pts0 comments

KL Zero

Target KL

Source

Press start in the chart. The blue line is the generated distribution; draw the green line before the timer ends.

Chart

Generated distribution P

Your drawn distribution Q

Last Score

Total--

Probability sum--

KL accuracy--

Your KL--

Your sum--

Target KL--

Draw to the target KL.<br>KL divergence measures how surprising the blue distribution P would look if your green distribution Q were used instead.

Draw any probability distribution that sums close to 1 and gets as close as possible to the target KL divergence number.

You have 10 seconds to do it. Go!

KL 0.1

nearly same

KL 1

shifted shape

KL 10

far apart

Start

distribution target divergence draw zero start

Related Articles