3Blue1Brown

Home<br>Theater

But what is Cross-Entropy? | Compression is Intelligence Part 2New<br>Details

Jul 16, 2026 What does it cost to compress data when your model of the probabilities is wrong?

videos

subscribers

views

ChannelMailing List

Lessons

All

Best Of

Neural Networks

Linear Algebra

Calculus

Differential Equations

Analysis

Physics

Computer Science

Why Pi

Puzzles

Geometry

Topology

Fractals

Probability

Group Theory

Number Theory

Lockdown Math

Guest Videos

Talks

On other channels

Patreon<br>If these lessons bring you value comparable to that of a textbook or a course, it would mean a lot to me and the rest of the team if you considered joining as a supporter.<br>Supporters get early access to new videos and provide essential feedback to refine their final form. Other perks include a meaningful store discount and having your name in a video.<br>Become a SupporterNew Video (Early Access)

3b1b Talent<br>Think of it as a virtual career fair. We partner with organizations interested in hiring the kinds of technically curious people who watch 3Blue1Brown.<br>Explore Opportunities<br>Follow<br>InstagramMailing ListXBlueSkyTikTokReddit2nd ChannelFacebookSpotifyGitHubBilibiliRSS

Jump to top

Share page

Site feedback