학술논문

Scalable Automated Proving of Information Theoretic Inequalities with Proximal Algorithms
Document Type
Conference
Source
2019 IEEE International Symposium on Information Theory (ISIT) Information Theory (ISIT), 2019 IEEE International Symposium on. :1382-1386 Jul, 2019
Subject
Communication, Networking and Broadcast Technologies
Computing and Processing
Signal Processing and Analysis
Cramer-Rao bounds
Random variables
Reactive power
Software algorithms
Software
Linear programming
Information theory
Language
ISSN
2157-8117
Abstract
Proving or disproving linear information theoretic inequalities is a fundamental task in information theory, and it has also been proved to be important in fields like cryptography and quantum communication theory. Manually proving information inequalities involving more than a few random variables can often be tedious or even intractable. In 1997, Yeung proposed a linear programming framework for verifying information inequalities, which was later extended to construct analytical proofs and disproofs. However, in practice this framework can be very slow for inequalities involving more than ten random variables, thus it is impossible to be applied to a wide range of practical problems. In this paper, we further extend this optimization-theoretic framework by reformulating the LPs and applying the Alternating Direction Method of Multipliers (ADMM) technique, where all the subproblems have closed-form solutions and thus can be solved efficiently. The proposed algorithm is also parallelizable so the performance can be further improved by running it on a GPU. An online web service is developed to allow users to prove or disprove their problem-specific inequalities without installing any software package or dependency.