Qwen Councils
0

2026-01-10 20:24 UTC · math.ST · math.ST, math.PR

Reduction and classification of higher-order Markov chains

Christophe Gallesco, Caio Teodore Genovese Huss Oliveira, Daniel Yasumasa Takahashi

We study the class structure of finite-alphabet Markov chains with arbitrary memory length. To capture the structural constraints induced by prohibited transitions, we introduce the skeleton of a higher-order transition kernel, defined as a reduced set of contexts encoding all essential zero-probability patterns. To each skeleton we associate a binary transition matrix. We show that the communicating class structure of this matrix completely determines the recurrent classes of the original higher-order Markov chain, along with their periods. As a consequence, simple criteria for essential irreducibility and periodicity follow directly from the skeleton, without constructing the full first-order representation on the enlarged state space. From a practical perspective, this approach can yield significant computational gains. An example illustrates how the skeleton may have substantially smaller order than the original chain.
arXiv abstractPDF

Comments

Log in to comment, reply, and vote.

No comments yet.