Markov models

Maximum-entropy Markov model

In statistics, a maximum-entropy Markov model (MEMM), or conditional Markov model (CMM), is a graphical model for sequence labeling that combines features of hidden Markov models (HMMs) and maximum entropy (MaxEnt) models. An MEMM is a discriminative model that extends a standard maximum entropy classifier by assuming that the unknown values to be learnt are connected in a Markov chain rather than being conditionally independent of each other. MEMMs find applications in natural language processing, specifically in part-of-speech tagging and information extraction. (Wikipedia).

Video thumbnail

Entropy production during free expansion of an ideal gas by Subhadip Chakraborti

Abstract: According to the second law, the entropy of an isolated system increases during its evolution from one equilibrium state to another. The free expansion of a gas, on removal of a partition in a box, is an example where we expect to see such an increase of entropy. The constructi

From playlist Seminar Series

Video thumbnail

(ML 14.4) Hidden Markov models (HMMs) (part 1)

Definition of a hidden Markov model (HMM). Description of the parameters of an HMM (transition matrix, emission probability distributions, and initial distribution). Illustration of a simple example of a HMM.

From playlist Machine Learning

Video thumbnail

Hamza Fawzi: "Sum-of-squares proofs of logarithmic Sobolev inequalities on finite Markov chains"

Entropy Inequalities, Quantum Information and Quantum Physics 2021 "Sum-of-squares proofs of logarithmic Sobolev inequalities on finite Markov chains" Hamza Fawzi - University of Cambridge Abstract: Logarithmic Sobolev inequalities play an important role in understanding the mixing times

From playlist Entropy Inequalities, Quantum Information and Quantum Physics 2021

Video thumbnail

(ML 14.2) Markov chains (discrete-time) (part 1)

Definition of a (discrete-time) Markov chain, and two simple examples (random walk on the integers, and a oversimplified weather model). Examples of generalizations to continuous-time and/or continuous-space. Motivation for the hidden Markov model.

From playlist Machine Learning

Video thumbnail

Physics - Thermodynamics 2: Ch 32.7 Thermo Potential (10 of 25) What is Entropy?

Visit http://ilectureonline.com for more math and science lectures! In this video explain and give examples of what is entropy. 1) entropy is a measure of the amount of disorder (randomness) of a system. 2) entropy is a measure of thermodynamic equilibrium. Low entropy implies heat flow t

From playlist PHYSICS 32.7 THERMODYNAMIC POTENTIALS

Video thumbnail

Equidistribution of Measures with High Entropy for General Surface Diffeomorphisms by Omri Sarig

PROGRAM : ERGODIC THEORY AND DYNAMICAL SYSTEMS (HYBRID) ORGANIZERS : C. S. Aravinda (TIFR-CAM, Bengaluru), Anish Ghosh (TIFR, Mumbai) and Riddhi Shah (JNU, New Delhi) DATE : 05 December 2022 to 16 December 2022 VENUE : Ramanujan Lecture Hall and Online The programme will have an emphasis

From playlist Ergodic Theory and Dynamical Systems 2022

Video thumbnail

Maximum Entropy Models for Texture Synthesis - Leclaire - Workshop 2 - CEB T1 2019

Arthur Leclaire (Univ. Bordeaux) / 14.03.2019 Maximum Entropy Models for Texture Synthesis. The problem of examplar-based texture synthesis consists in producing an image that has the same perceptual aspect as a given texture sample. It can be formulated as sampling an image which is 'a

From playlist 2019 - T1 - The Mathematics of Imaging

Video thumbnail

Regularized Functional Inequalities and Applications to Markov Chains by Pierre Youssef

PROGRAM: TOPICS IN HIGH DIMENSIONAL PROBABILITY ORGANIZERS: Anirban Basak (ICTS-TIFR, India) and Riddhipratim Basu (ICTS-TIFR, India) DATE & TIME: 02 January 2023 to 13 January 2023 VENUE: Ramanujan Lecture Hall This program will focus on several interconnected themes in modern probab

From playlist TOPICS IN HIGH DIMENSIONAL PROBABILITY

Video thumbnail

Statistical Rethinking - Lecture 12

Lecture 12 - MCMC / Maximum Entropy - Statistical Rethinking: A Bayesian Course with R Examples

From playlist Statistical Rethinking Winter 2015

Video thumbnail

Maxwell-Boltzmann distribution

Entropy and the Maxwell-Boltzmann velocity distribution. Also discusses why this is different than the Bose-Einstein and Fermi-Dirac energy distributions for quantum particles. My Patreon page is at https://www.patreon.com/EugeneK 00:00 Maxwell-Boltzmann distribution 02:45 Higher Temper

From playlist Physics

Video thumbnail

Maximum Likelihood Estimation Examples

http://AllSignalProcessing.com for more great signal processing content, including concept/screenshot files, quizzes, MATLAB and data files. Three examples of applying the maximum likelihood criterion to find an estimator: 1) Mean and variance of an iid Gaussian, 2) Linear signal model in

From playlist Estimation and Detection Theory

Video thumbnail

Sanjoy Mitter - Overview of variational approach to nonlinear filtering

PROGRAM: Nonlinear filtering and data assimilation DATES: Wednesday 08 Jan, 2014 - Saturday 11 Jan, 2014 VENUE: ICTS-TIFR, IISc Campus, Bangalore LINK:http://www.icts.res.in/discussion_meeting/NFDA2014/ The applications of the framework of filtering theory to the problem of data assimi

From playlist Nonlinear filtering and data assimilation

Video thumbnail

Optimal Mixing of Glauber Dynamics: Entropy Factorization via High-Dimensional Expan - Zongchen Chen

Computer Science/Discrete Mathematics Seminar I Topic: Optimal Mixing of Glauber Dynamics: Entropy Factorization via High-Dimensional Expansion Speaker: Zongchen Chen Affiliation: Georgia Institute of Technology Date: February 22, 2021 For more video please visit http://video.ias.edu

From playlist Mathematics

Video thumbnail

The Rule 54: Exactly solvable deterministic interacting model of transport by Tomaz Prosen

PROGRAM THERMALIZATION, MANY BODY LOCALIZATION AND HYDRODYNAMICS ORGANIZERS: Dmitry Abanin, Abhishek Dhar, François Huveneers, Takahiro Sagawa, Keiji Saito, Herbert Spohn and Hal Tasaki DATE : 11 November 2019 to 29 November 2019 VENUE: Ramanujan Lecture Hall, ICTS Bangalore How do is

From playlist Thermalization, Many Body Localization And Hydrodynamics 2019

Video thumbnail

Entropy: The Heat Death of The Universe

Entropy: The Heat Death of The Universe - https://aperture.gg/heatdeath Sign up with Brilliant for FREE and start learning today: https://brilliant.org/aperture "Maximum Entropy" Hoodies — Available Now: https://aperture.gg/entropy As the arrow of time pushes us forward, each day the univ

From playlist Science & Technology 🚀

Video thumbnail

Sergio Verdu - Information Theory Today

Founded by Claude Shannon in 1948, information theory has taken on renewed vibrancy with technological advances that pave the way for attaining the fundamental limits of communication channels and information sources. Increasingly playing a role as a design driver, information theory is b

From playlist NOKIA-IHES Workshop

Video thumbnail

(ML 14.1) Markov models - motivating examples

Introduction to Markov models, using intuitive examples of applications, and motivating the concept of the Markov chain.

From playlist Machine Learning

Related pages

Graphical model | Forward–backward algorithm | Hidden Markov model | Part-of-speech tagging | Viterbi algorithm | Baum–Welch algorithm | Maximum entropy probability distribution | Generalized iterative scaling | Conditional random field | Discriminative model | Markov chain | Statistics