Research Article

Markov Chains of Molecular Processes of Biochemical Materials

Orchidea Maria Lecian*

Published: 18 January, 2024 | Volume 7 - Issue 1 | Pages: 001-005

Biochemical systems are analytically investigated after encoding the properties of the dynamics, which rule the time evolution of the transition properties, using some Markov models, such as the Hierarchical Markov-State Models. The present paper is aimed at analytically writing the (finite) Markov chain originating from the considered Markov models. Within this framework, the interaction with the environment is considered, and the ergodicity of the systems obtained from numerical simulation is controlled and compared with the qualities of the Markov chain. The (von Neumann) conditions to be imposed on the Bloch equations for the biomaterial structures to be described analytically in a consistent way are governed. The formalisms of the ’heat bath’ and that of the control of the numerical errors ensure the good measure-theoretical framework and the ergodicity of the finite chain, respectively.
The finite Markov chains are investigated and the analytical expressions are presented, after which the Hierarchical Markov-State-Model provides the time evolution of the transition probabilities in biochemical systems.
The notion of heat bath is used to describe the interactions of the biomaterial with the environment and thus to control the uses of the projection operators in the Markovian processes where the appropriate measure is defined; the stochastic equations allow one to obtain the wanted measure from the probability spaces.
The cases in which a violation of the Markov property of the process occurs, i.e. in open systems, or dissipative processes are also considered. Furthermore, in complex molecules in biological systems, these features are investigated to be possibly even more dramatic. As far as molecular processes are concerned, this occurrence is associated with the appearance of chaotic effects with certain characteristics of potential surfaces: rather than the technique of isocommittors, the method of projectors in measure spaces is used for the Nakajima-Zwanzig paradigm for the density operator; this latter method complementary compares the time-convolution-less technique.
The finite Markov chains are finally proven to be ergodic after the control of the numerical errors which provide the Sinai-Markov partitions to be applied for the analysis of the measure space of the Markov chain, that is, one endowed with a Hilbert measure. The von Neumann conditions are therefore newly demonstrated to be apt to be applied to the Bloch equations for biomaterial structures after the use of the notion of heat bath, from which the measure space arises.
The qualities of the Hierarchical Markov-Sate Models which bring the analytical expression of the time evolution of probabilities of biomaterials are therefore newly analytically studied.

Read Full Article HTML DOI: 10.29328/journal.ijpra.1001076 Cite this Article Read Full Article PDF


Markov chains; Finite Markov chains; Heat bath; Ergodicity; Sinai-Markov partitions; Von Neumann conditions; Bloch equation


  1. Lou XY. Hidden Markov model approaches for biological studies. Biom Biostat Int J. 2017; 5(4):132-144.
  2. Wolfe DK, Persichetti JR, Sharma AK, Hudson PS, Woodcock HL, O’Brien EP. Hierarchical Markov State Model Building to Describe Molecular Processes. J Chem Theory Comput. 2020; 16: 1816-1826.
  3. Ghosh P, Ghosh S, Basu K, Das SK. A markov model based analysis of stochastic biochemical systems. Comput Syst Bioinformatics Conf. 2007;6:121-32. PMID: 17951818.
  4. Da LT, Sheong FK, Silva DA, Huang X. Application of Markov State Models to Simulate Long-Timescale Dynamics of Biological Macromolecules. In: Han Kl, Zhang X, Yang MJ. (eds) Protein Conformational Dynamics. Advances in Experimental Medicine and Biology. Springer, Cham. 80: 2014.
  5. Yoon BJ. Hidden Markov Models and their Applications in Biological Sequence Analysis. Current Genomics. 2009; 10(6): 402-415.
  6. Richey M. The Evolution of Markov Chain Monte Carlo Methods. The American Mathematical Monthly. 2010; 117383-413.
  7. Geman S, Geman D. Stochastic relaxation, Gibbs distributions, and the Bayesian restoration of images. IEEE Transactions on Pattern Analysis and Machine Intelligence PAMI-6. 1984; 721-741.
  8. Error Analysis for Markov Chain Data, Markov Chain Monte Carlo Simulations, and Their Statistical Analysis. 2004;196-235.
  9. Toft N, Innocent G, Gettinby G, Reid SW. Assessing the convergence of Markov Chain Monte Carlo methods: An example from evaluation of diagnostic tests in absence of a gold standard. Preventive Veterinary Medicine. 2007; 79(2-4): 244-56.
  10. Gillespie DT. A general method for numerically simulating the time evolution of coupled chemical reactions. J Comp Phys. 1976; 22: 403-434.
  11. Gillespie DT. Exact stochastic simulation of coupled chemical reactions. J Phys Chem. 1977; 71(25): 2340-2361.
  12. van Wonderen AJ, Lendi K. Quantum Theory of Dissipative Processes: The Markov Approximation Revisited. Journal of Statistical Physics. 1995; 80.
  13. Davies EB. Markovian Master Equations, Commun Math Phys. 1974; 39: 91110.
  14. Kato T. Perturbation theory for linear operators, Springer: BerlinHeidelberg-New York (1966).
  15. Pule’ JV, The Bloch equations, Communications in Mathematical Physics. 1974; 38: 241-256.
  16. Balslev E, Verbeure A. States on Clifford algebras. Commun Math Phys. 1968; 7: 55-76.
  17. Davies EB. Markovian Master Equations II. Math Ann. 1976; 219: 147-158.
  18. Potts PP, Kalaee AAS, Wacker A. A thermodynamically consistent Markovian master equation beyond the secular approximation. New J Phys. 23: 123013.
  19. Davies EB. Markovian master equations III, Annals of the Henri Poincar´e Institute, Section B, Calculation of probabilities and statistics. 1975; 11: 265-273.
  20. Kurtz TG. A limit theorem for perturbed operator semigroups with applications to random evolutions. J Functional Anal. 1973; 12: 55-67.
  21. Schweitzer PJ. Perturbation Theory and Finite Markov Chains. Journal of Applied Probability. 1968; 5: 401-413.
  22. Lecian OM. Some properties of the Markov chains of the Markov Models of molecular processes, 4th International Conference on Biomaterials & Biodevices, 16 November 2023, Rome, Italy 2023.
  23. Sinai YaG, Construction of Markov partitions. Functional Anal and Its Appl. 1968; 2:245-253.
  24. Sinai YaG. Markov partitions and C-diffeomorphisms, Functional Anal and Its Appl. 1968; 2: 61-82.
  25. Pan AC, Roux B. Building Markov state models along pathways to determine free energies and rates of transitions. J Chem Phys. 2008; 129: 064107.
  26. Lecian OM. Markov chains reconducted from non-Markovian processes: the transition probabilities, in preparation.
  27. Elber R, Bello-Rivas JM, Ma P, Cardenas AE, Fathizadeh A. Calculating Iso-Committor Surfaces as Optimal Reaction Coordinates with Milestoning. Entropy. 2017; 19(5): 219.
  28. Bockius N. Model reduction techniques for the computation of extended Markov parameterizations for generalized Langevin equations. J Phys Condens Matter. 2021; 33: 214003.
  29. Lecian OM. The existence and uniqueness of a measure of the Markov chain from the probability space of reconducted non-Markovian processes, in preparation.
  30. Vanden Eijnden E, Venturoli M, Ciccotti G, Elber R. On the assumption underlying Milestoning. J Chem Phys 2008; 129.
  31. Davies EB. Markovian Master Equations. Commun Math Phys. 1974; 39: 91110.
  32. Nakajima S. On Quantum Theory of Transport Phenomena: Steady Diffusion, Progress of Theoretical Physics. 1958; 20: 948.
  33. Zwanzig R. Ensemble Method in the Theory of Irreversibility. The Journal of Chemical Physics. 1960; 33: 1338 (1960).
  34. Breuer HP, Petruccione F. The Theory of Open Quantum Systems, Oxford Univ. Press, Oxford, 2007.
  35. Lecian OM. Projector techniques of memory kernels from exothermic reactions Markov landscapes, in preparation.
  36. Shardlow T, Stuart AM. A Perturbation Theory for Ergodic Markov Chains and Application to Numerical Approximations, SIAM Journal on Numerical Analysis. 2000; 37: 1120-1137.
  37. Wang LV. Derivation from Bloch Equation to von Neumann Equation to Schroedinger-Pauli Equation, Found Phys 2022; 52: 61.
  38. Sandmann W. Discrete-time stochastic modeling and simulation of biochemical networks. Comput Biol Chem. 2008 Aug;32(4):292-7. doi: 10.1016/j.compbiolchem.2008.03.018. Epub 2008 Apr 10. PMID: 18499525.
  39. Golatkar J. Markovian, Non Markovian process and Master equation. https://www.thphys.uni-heidelberg.de/w˜olschin/statsem21 5 s.pdf.
  40. Chernov NI. Markov Approximations and Decay of Correlations for Anosov Flows, Annals of Mathematics Second Series. 1998; 147: 269-324.


Similar Articles

Recently Viewed

  • Characteristics of Juvenile Sex Offenders in Poland
    Anna Więcek-Durańska* Anna Więcek-Durańska*. Characteristics of Juvenile Sex Offenders in Poland. J Forensic Sci Res. 2023: doi: 10.29328/journal.jfsr.1001053; 7: 072-076
  • Hypercalcaemic Crisis Associated with Hyperthyroidism: A Rare and Challenging Presentation
    Karthik Baburaj*, Priya Thottiyil Nair, Abeed Hussain and Vimal MV Karthik Baburaj*, Priya Thottiyil Nair, Abeed Hussain, Vimal MV. Hypercalcaemic Crisis Associated with Hyperthyroidism: A Rare and Challenging Presentation. Ann Clin Endocrinol Metabol. 2024: doi: 10.29328/journal.acem.1001029; 8: 001-003
  • Physicians’ Anxiety Post-COVID Pandemic: A Cross-Sectional Study
    Ismail Hanine*, Mouna Chtibi, Kenza Hajjami, Siham Belbachir, Mohamed Kadiri and Abderrazzak Ouanass Ismail Hanine*, Mouna Chtibi, Kenza Hajjami, Siham Belbachir, Mohamed Kadiri, Abderrazzak Ouanass. Physicians’ Anxiety Post-COVID Pandemic: A Cross-Sectional Study. Arch Psychiatr Ment Health. 2024: doi: 10.29328/journal.apmh.1001054; 8: 032-037
  • Current anesthesıa for Cesarean Sectıon
    Demet Dogan Erol* and Ismail Aytac Demet Dogan Erol*, Ismail Aytac. Current anesthesıa for Cesarean Sectıon. Clin J Obstet Gynecol. 2018: doi: 10.29328/journal.cjog.1001011; 1: 061-066
  • Therapy of Walker Carcinosarcoma with Pectin and Cyclophosphane
    NY Alimzhanov, ISh Chakeev, BN Lepshin, IO Kudaibergenova, BA Shaimurzayeva, LV Serikova and Sh Jorobekova* NY Alimzhanov, ISh Chakeev, BN Lepshin, IO Kudaibergenova, BA Shaimurzayeva, LV Serikova, Sh Jorobekova*. Therapy of Walker Carcinosarcoma with Pectin and Cyclophosphane. J Radiol Oncol. 2023: doi: 10.29328/journal.jro.1001056; 7: 066-070

Read More

Most Viewed

Read More

Help ?