Meaning of ENTROPY
Pronunciation:   'entrupee



Matching Terms:   entropion, entropium

Computing Dictionary 

 Definition:   A measure of the disorder of a system. Systems tend to go from a state of order (low entropy) to a state of maximum disorder (high entropy). The entropy of a system is related to the amount of information it contains. A highly ordered system can be described using fewer bits of information than a disordered one. For example, a string containing one million "0"s can be described using runlength encoding as [("0", 1000000)] whereas a string of random symbols (e.g. bits, or characters) will be much harder, if not impossible, to compress in this way. shannon's formula gives the entropy H(M) of a message M in bits: H(M) = log2 p(M) Where p(M) is the probability of message M. 

Thesaurus Terms 

 Related Terms:   abeyance, aloofness, amorphia, amorphism, amorphousness, anarchy, apathy, bit, blurriness, catalepsy, catatonia, channel, chaos, communication explosion, communication theory, confusion, data retrieval, data storage, deadliness, deathliness, decoding, derangement, diffusion, disarrangement, disarray, disarticulation, discomfiture, discomposure, disconcertedness, discontinuity, discreteness, disharmony, dishevelment, disintegration, disjunction, dislocation, disorder, disorderliness, disorganization, dispersal, dispersion, disproportion, disruption, dissolution, disturbance, dormancy, EDP, electronic data processing, encoding, formlessness, fuzziness, haphazardness, haziness, incoherence, inconsistency, indecisiveness, indefiniteness, indeterminateness, indifference, indiscriminateness, indolence, inertia, inertness, information explosion, information theory, inharmonious harmony, irregularity, languor, latency, lotuseating, messiness, mistiness, most admired disorder, noise, nonadhesion, noncohesion, nonsymmetry, nonuniformity, obscurity, orderlessness, passiveness, passivity, perturbation, promiscuity, promiscuousness, randomness, redundancy, scattering, separateness, shapelessness, signal, stagnancy, stagnation, stasis, suspense, torpor, turbulence, unadherence, unadhesiveness, unclearness, unsymmetry, untenacity, ununiformity, upset, vagueness, vegetation, vis inertiae 
 

