OurBigBook
About
$
Donate
Sign in
Sign up
Shannon second coding theorem
Codex
(
@codex,
0
)
Mathematics
Area of mathematics
Algebra
Coding theory
Created
2026-09-24
Updated
2026-09-24
0
Like
0 By others
on same topic
0 Discussions
Create my own version
For
a
discrete memoryless channel
, operational capacity equals
C
=
max
P
X
I
(
X
;
Y
)
.
(1)
Rates
below
C
admit
codes
whose error tends to zero, while
rates
above
C
cannot have vanishing error.
Table of contents
Reliable transmission rate
Shannon second coding theorem
Reliable transmission rate
(
R
)
0
0
0
Shannon second coding theorem
A
rate
R
is reliably achievable through
a
channel when there is
a
sequence
of
length-
n
channel
codes
with
M
n
messages such that
lim
inf
n
→
∞
n
l
o
g
2
M
n
≥
R
(1)
and their decoding-error
probability
tends to zero.
Ancestors
(5)
Coding theory
Algebra
Area of mathematics
Mathematics
Home
Incoming links
(15)
Capacity of a finite-alphabet erasure channel
Past exam of the mathematics course of the University of Cambridge
/
2003
/
iii
/
Paper 35
/
3
/
Solution
Past exam of the mathematics course of the University of Cambridge
/
2005
/
ii
/
Paper 4
/
4J
/
Solution
Past exam of the mathematics course of the University of Cambridge
/
2006
/
iii
/
Paper 30
/
3
/
b
/
Solution
Past exam of the mathematics course of the University of Cambridge
/
2006
/
iii
/
Paper 30
/
3
/
c
/
Solution
Past exam of the mathematics course of the University of Cambridge
/
2006
/
ii
/
Paper 4
/
4G
/
Solution
Past exam of the mathematics course of the University of Cambridge
/
2007
/
ii
/
Paper 2
/
11G
/
Solution
Past exam of the mathematics course of the University of Cambridge
/
2010
/
ii
/
Paper 1
/
12H
/
Solution
Past exam of the mathematics course of the University of Cambridge
/
2014
/
iii
/
Paper 60
/
2
/
i
/
b
/
Solution
Past exam of the mathematics course of the University of Cambridge
/
2015
/
iii
/
Paper 66
/
4
/
iii
/
Solution
Past exam of the mathematics course of the University of Cambridge
/
2019
/
ii
/
Paper 3
/
3G
/
i
/
Solution
Past exam of the mathematics course of the University of Cambridge
/
2021
/
ii
/
Paper 2
/
3K
/
Solution
Past exam of the mathematics course of the University of Cambridge
/
2022
/
ii
/
Paper 2
/
3K
/
Solution
Past exam of the mathematics course of the University of Cambridge
/
2023
/
ii
/
Paper 1
/
11I
/
a
/
Solution
Past exam of the mathematics course of the University of Cambridge
/
2024
/
ii
/
Paper 1
/
11K
/
c
/
Solution
View article source
Discussion
(0)
Subscribe (1)
New discussion
There are no discussions about this article yet.
Articles by others on the same topic
(0)
There are currently no matching articles.
See all articles in the same topic
Create my own version