information theory

noun

1. the mathematical theory concerned with the content, transmission, storage, and retrieval of information, usually in the form of messages or data, and especially by means of computers.

information theory

noun

1. a collection of mathematical theories, based on statistics, concerned with methods of coding, transmitting, storing, retrieving, and decoding information

information theory

1. A branch of mathematics that mathematically defines and analyzes the concept of information. Information theory involves statistics and probability theory, and applications include the design of systems that have to do with data transmission, encryption, compression, and other information processing.

Word History and Origins

Origin of information theory¹

First recorded in 1945–50

Example Sentences

To explore the issue, Endres applied principles from information theory and algorithmic complexity to estimate what it would take for the first simple cell, known as a protocell, to assemble itself from basic chemical ingredients.

Read more on Science Daily

Cybernetics is basically information theory or the mathematics of information applied in contexts of control.

Read more on Salon

"With Gašper's expertise in information theory, we were able to put it together," Brückner adds excitedly.

Read more on Science Daily

With diffusion models, an iterative data generation process starts from basic noise, a concept used in information theory to mimic the effect of many random processes that occur in nature.

Read more on Science Daily

In September, over 100 consciousness researchers signed a public letter condemning one of the most popular theories of consciousness—the integrated information theory—as pseudoscience.

Read more on Scientific American