Hyper Dictionary

English Dictionary Computer Dictionary Video Dictionary Thesaurus Dream Dictionary Medical Dictionary


Search Dictionary:  

Meaning of ENTROPY

Pronunciation:  'entrupee

 
Matching Terms:  entropion, entropium

Computing Dictionary
 
 Definition: 

A measure of the disorder of a system. Systems tend to go from a state of order (low entropy) to a state of maximum disorder (high entropy).

The entropy of a system is related to the amount of information it contains. A highly ordered system can be described using fewer bits of information than a disordered one. For example, a string containing one million "0"s can be described using run-length encoding as [("0", 1000000)] whereas a string of random symbols (e.g. bits, or characters) will be much harder, if not impossible, to compress in this way.

shannon's formula gives the entropy H(M) of a message M in bits:

        H(M) = -log2 p(M)

Where p(M) is the probability of message M.

 
Thesaurus Terms
 
 Related Terms: abeyance, aloofness, amorphia, amorphism, amorphousness, anarchy, apathy, bit, blurriness, catalepsy, catatonia, channel, chaos, communication explosion, communication theory, confusion, data retrieval, data storage, deadliness, deathliness, decoding, derangement, diffusion, disarrangement, disarray, disarticulation, discomfiture, discomposure, disconcertedness, discontinuity, discreteness, disharmony, dishevelment, disintegration, disjunction, dislocation, disorder, disorderliness, disorganization, dispersal, dispersion, disproportion, disruption, dissolution, disturbance, dormancy, EDP, electronic data processing, encoding, formlessness, fuzziness, haphazardness, haziness, incoherence, inconsistency, indecisiveness, indefiniteness, indeterminateness, indifference, indiscriminateness, indolence, inertia, inertness, information explosion, information theory, inharmonious harmony, irregularity, languor, latency, lotus-eating, messiness, mistiness, most admired disorder, noise, nonadhesion, noncohesion, nonsymmetry, nonuniformity, obscurity, orderlessness, passiveness, passivity, perturbation, promiscuity, promiscuousness, randomness, redundancy, scattering, separateness, shapelessness, signal, stagnancy, stagnation, stasis, suspense, torpor, turbulence, unadherence, unadhesiveness, unclearness, unsymmetry, untenacity, ununiformity, upset, vagueness, vegetation, vis inertiae
 

 

 

 

COPYRIGHT © 2000-2013 HYPERDICTIONARY.COM HOME | ABOUT HYPERDICTIONARY