Markov Chains

INTRO The concept behind markov chains is that in a transition, an event is dependent on the occurrence of a previous event i.e. an event can only occur if an event that is dependent on it has occurred already. Markov chains have a lot of applications including speech recognition, genetic, web…

What’s Markov chain Monte Carlo Markov Chain Monte Carlo is a stochastic sampling method, normally used to sample from target distributions, which in practice are often intractable due to their complication and high dimensionality. You use MCMC whenever you want to sample from the complex high dimensional distribution What is A Markov Chain Markov Chain can be considered as a…

In making a name generator, stringing random letters together will not do. It is too easy to result in something unpronouncable, as mashing your keyboard will show you. eworgjnja, ovfjnpe, ojgnpe, rojngsi, dfgoa, ibvoias, fbvoib Say you devise a system that alternates between consonants and vowels to produce syllables. That…

Introduction to uniform sampling algorithms for streaming items — A sampling task Bob works in quality control at an electronic components factory. Among his tasks, every day he must inspect k different products in order to identify possible defects and to assess the overall smoothness of the production process. The products must be chosen randomly and following a uniform probability of extraction…

Suppose we want to know if it will be sunny or rainy tomorrow. We may have a natural intuition based on your experience and historical observation of the weather. If the weather has been sunny during the last week, we may have a prediction that it will rain 90% tomorrow…

Markov chains have many applications in chemistry, physics, economics, and mathematics. While recently studying neural networks, I noticed similarities between attributes of Markov chains and the architecture of densely connected neural networks. I wondered how far this similarities extended. After doing some research, I came across a paper entitled Markov…

Excerpts from https://arxiv.org/abs/1909.12313, a visual feel in incredibly important to understand MCMC algorithms. Of course, we start…

If you order a t-shirt online today, what’s the probability that Google will show you ads of t-shirts tomorrow? Or if you have a Jalapeño pizza now, what’s the probability you’ll have ice-cream after? …

Not every table can multiply by it self and have meaningful result, you can look at the Markov Matrices as one of those beautiful coincidence in nature or a law that found us. Let’s face it, some mathematic concepts are complicated because we have to fit it in all those…