Measures of Information & Their Applications English 2009

The present book may be regarded as a successor of author`s Maximum Models in Science and Engineering (Wiley), Generalized Maximum Entropy Principle (Sandford), Entropy Optimization Principles and their Applications (Academic) and Insight into Entropy Optimization Principles (MSTS). It contains sixty research investigations of the author on measures of entropy, directed divergence, weighted directed divergence, information, principles of maximum entropy, minimum entropy, minimum cross-entropy, minimum weighted information and maximum weighted entropy, most likely and most feasible distributions, duals of optimization problems, entropy optimization under inequality constraints, characterising moments, parameter estimation, maximum entropy approximation for a probability distribution, proving inequalities, laws of information, antropic mean, mean-entropy frontier, logistic-type growth models, birth-death processes, distributions of statistical mechanics, estimation of missing values, theorems of information theory and many others.