학술논문

Typical Error Exponents: A Dual Domain Derivation
Document Type
Periodical
Source
IEEE Transactions on Information Theory IEEE Trans. Inform. Theory Information Theory, IEEE Transactions on. 69(2):776-793 Feb, 2023
Subject
Communication, Networking and Broadcast Technologies
Signal Processing and Analysis
Codes
Monte Carlo methods
Memoryless systems
Probability distribution
Error probability
Channel coding
Power capacitors
Error exponents
typical random codes
typical error exponent
expurgated bound
Language
ISSN
0018-9448
1557-9654
Abstract
This paper shows that the probability that the error exponent of a given code randomly generated from a pairwise-independent ensemble is smaller than a lower bound on the typical random-coding exponent tends to zero as the codeword length tends to infinity. This lower bound is known to be tight for i.i.d. ensembles over the binary symmetric channel and for constant-composition codes over memoryless channels. Our results recover both as special cases and remain valid for arbitrary alphabets, arbitrary channels—for example finite-state channels with memory—, and arbitrary pairwise-independent ensembles. We specialize our results to the i.i.d., constant-composition and cost-constrained ensembles over discrete memoryless channels and to ensembles over finite-state channels.