FF's Roam Notes

Home

❯

Difference between MI, IG and KL

Difference between MI, IG and KL

Jun 05, 20251 min read

  • math
  • probability

What’s the difference between Mutual Information, Information Gain and KL Divergence?


Graph View

Created with Quartz v4.5.1 © 2025

  • GitHub
  • Discord Community