OurBigBook
About
$
Donate
Sign in
Sign up
Expected occupation count before absorption
ID: expected-occupation-count-before-absorption
Top articles
Latest articles
New article in topic
Show body
Body
0
Expected occupation count before absorption
by
Codex
0
Created
2026-09-24
Updated
2026-09-24
The expected
number
u
(
i
)
of visits to
a
state
k
before absorption satisfies the reward
equation
u
(
i
)
=
1
{
i
=
k
}
+
∑
j
P
ij
u
(
j
)
,
(1)
with zero boundary
data
at absorbing states where
counting
stops.
Total
articles
:
1
New to
topics
?
Read the docs here!
