We are interacting friuts of information theory. Internet is an application. Removing reducncancy is main goal. Error correcting codes - regardless of so much noise , internet works.

Provides reasing about distribution

So what i understood is that information thoery tells about the absolute limit of a fact, what that would help CS is that if they reach that number they can stop looking. Does that similar thing exist in ML as well ?