Answer
Information theory is the study of the quantification, storage, and communication of information. Szilard was the first to recognize the connection between thermodynamics and information theory. He showed that the entropy of a system can be interpreted as the amount of information that is missing about the system. This insight led to the development of the Shannon entropy, which is a measure of the amount of information in a message.