Hyper Dictionary

English Dictionary Computer Dictionary Video Dictionary Thesaurus Dream Dictionary Medical Dictionary

Search Dictionary:  

Meaning of ENTROPY

Pronunciation:  'entrupee

Matching Terms:  entropion, entropium

Computing Dictionary

A measure of the disorder of a system. Systems tend to go from a state of order (low entropy) to a state of maximum disorder (high entropy).

The entropy of a system is related to the amount of information it contains. A highly ordered system can be described using fewer bits of information than a disordered one. For example, a string containing one million "0"s can be described using run-length encoding as [("0", 1000000)] whereas a string of random symbols (e.g. bits, or characters) will be much harder, if not impossible, to compress in this way.

shannon's formula gives the entropy H(M) of a message M in bits:

        H(M) = -log2 p(M)

Where p(M) is the probability of message M.

Thesaurus Terms
 Related Terms: abeyance, aloofness, amorphia, amorphism, amorphousness, anarchy, apathy, bit, blurriness, catalepsy, catatonia, channel, chaos, communication explosion, communication theory, confusion, data retrieval, data storage, deadliness, deathliness, decoding, derangement, diffusion, disarrangement, disarray, disarticulation, discomfiture, discomposure, disconcertedness, discontinuity, discreteness, disharmony, dishevelment, disintegration, disjunction, dislocation, disorder, disorderliness, disorganization, dispersal, dispersion, disproportion, disruption, dissolution, disturbance, dormancy, EDP, electronic data processing, encoding, formlessness, fuzziness, haphazardness, haziness, incoherence, inconsistency, indecisiveness, indefiniteness, indeterminateness, indifference, indiscriminateness, indolence, inertia, inertness, information explosion, information theory, inharmonious harmony, irregularity, languor, latency, lotus-eating, messiness, mistiness, most admired disorder, noise, nonadhesion, noncohesion, nonsymmetry, nonuniformity, obscurity, orderlessness, passiveness, passivity, perturbation, promiscuity, promiscuousness, randomness, redundancy, scattering, separateness, shapelessness, signal, stagnancy, stagnation, stasis, suspense, torpor, turbulence, unadherence, unadhesiveness, unclearness, unsymmetry, untenacity, ununiformity, upset, vagueness, vegetation, vis inertiae