assume that a sequence v1, ..., vt, vt in {1, ..., v} is generated by a markov chain. for a single chain of length t, we have p(v1, ..., vt)