OurBigBook About$ Donate
 Sign in+ Sign up

Ciro Santilli @cirosantilli 37

 Message
User's profile image

 Tagged: Overfitting

Machine learning as a form of data compression  Updated 2025-05-29  +Created 1970-01-01
 View more
Philosophically, machine learning can be seen as a form of lossy compression.
And if we make it too lossless, then we are basically overfitting.
Bibliography:
  • bair.berkeley.edu/blog/2019/09/19/bit-swap/
  • www.eecs.tufts.edu/~dsculley/papers/compressionAndVectors.pdf
  • arxiv.org/abs/2202.06533
  • towardsdatascience.com/ai-based-image-compression-the-state-of-the-art-fb5aa6042bfa
 Read the full article
Total articles: 1
 About$ Donate Content license: CC BY-SA 4.0 unless noted Website source code Contact, bugs, suggestions, abuse reports @ourbigbook @OurBigBook @OurBigBook