Claude Shannon defined a quantitative measure of information based on uncertainty, deliberately separate from semantic meaning.
Shannon's 1948 theory measures the choices and uncertainty in a message source and explicitly sets semantic aspects aside for the engineering problem. Entropy, measured in bits under base-two logarithms, became the theory's central quantity.
