OurBigBook About$ Donate
 Sign in+ Sign up
by Ciro Santilli (@cirosantilli, 37)

Machine learning as a form of data compression

 ... Area of technology Information technology Computer Machine learning Hyperparameter Overfitting
 0 By others on same topic  0 Discussions  Updated 2025-05-29  +Created 1970-01-01  See my version
Tags: Overfitting
Philosophically, machine learning can be seen as a form of lossy compression.
And if we make it too lossless, then we are basically overfitting.
Bibliography:
  • bair.berkeley.edu/blog/2019/09/19/bit-swap/
  • www.eecs.tufts.edu/~dsculley/papers/compressionAndVectors.pdf
  • arxiv.org/abs/2202.06533
  • towardsdatascience.com/ai-based-image-compression-the-state-of-the-art-fb5aa6042bfa

 Ancestors (8)

  1. Overfitting
  2. Hyperparameter
  3. Machine learning
  4. Computer
  5. Information technology
  6. Area of technology
  7. Technology
  8.  Home

 Incoming links (1)

  • Principal component analysis

 View article source

 Discussion (0)

+ New discussion

There are no discussions about this article yet.

 Articles by others on the same topic (0)

There are currently no matching articles.
  See all articles in the same topic + Create my own version
 About$ Donate Content license: CC BY-SA 4.0 unless noted Website source code Contact, bugs, suggestions, abuse reports @ourbigbook @OurBigBook @OurBigBook