Maximum likelihood estimation

Quasi-maximum likelihood estimate

In statistics a quasi-maximum likelihood estimate (QMLE), also known as a pseudo-likelihood estimate or a composite likelihood estimate, is an estimate of a parameter θ in a statistical model that is formed by maximizing a function that is related to the logarithm of the likelihood function, but in discussing the consistency and (asymptotic) variance-covariance matrix, we assume some parts of the distribution may be mis-specified. In contrast, the maximum likelihood estimate maximizes the actual log likelihood function for the data and model. The function that is maximized to form a QMLE is often a simplified form of the actual log likelihood function. A common way to form such a simplified function is to use the log-likelihood function of a misspecified model that treats certain data values as being independent, even when in actuality they may not be. This removes any parameters from the model that are used to characterize these dependencies. Doing this only makes sense if the dependency structure is a nuisance parameter with respect to the goals of the analysis. As long as the quasi-likelihood function that is maximized is not oversimplified, the QMLE (or composite likelihood estimate) is consistent and asymptotically normal. It is less efficient than the maximum likelihood estimate, but may only be slightly less efficient if the quasi-likelihood is constructed so as to minimize the loss of information relative to the actual likelihood. Standard approaches to statistical inference that are used with maximum likelihood estimates, such as the formation of confidence intervals, and statistics for model comparison, can be generalized to the quasi-maximum likelihood setting. (Wikipedia).

Video thumbnail

EstimatingRegressionCoeff.8.MLE

This video is brought to you by the Quantitative Analysis Institute at Wellesley College. The material is best viewed as part of the online resources that organize the content and include questions for checking understanding: https://www.wellesley.edu/qai/onlineresources

From playlist Estimating Regression Coefficients

Video thumbnail

(ML 4.1) Maximum Likelihood Estimation (MLE) (part 1)

Definition of maximum likelihood estimates (MLEs), and a discussion of pros/cons. A playlist of these Machine Learning videos is available here: http://www.youtube.com/my_playlists?p=D0F06AA0D2E8FFBA

From playlist Machine Learning

Video thumbnail

Maximum Likelihood Estimation Examples

http://AllSignalProcessing.com for more great signal processing content, including concept/screenshot files, quizzes, MATLAB and data files. Three examples of applying the maximum likelihood criterion to find an estimator: 1) Mean and variance of an iid Gaussian, 2) Linear signal model in

From playlist Estimation and Detection Theory

Video thumbnail

L20.10 Maximum Likelihood Estimation Examples

MIT RES.6-012 Introduction to Probability, Spring 2018 View the complete course: https://ocw.mit.edu/RES-6-012S18 Instructor: John Tsitsiklis License: Creative Commons BY-NC-SA More information at https://ocw.mit.edu/terms More courses at https://ocw.mit.edu

From playlist MIT RES.6-012 Introduction to Probability, Spring 2018

Video thumbnail

Jean-Marc Bardet : Asymptotic behavior of the Laplacian quasi-maximum likelihood estimator of...

Abstract : We prove the consistency and asymptotic normality of the Laplacian Quasi-Maximum Likelihood Estimator (QMLE) for a general class of causal time series including ARMA, AR(∞), GARCH, ARCH(∞), ARMA-GARCH, APARCH, ARMA-APARCH,..., processes. We notably exhibit the advantages (moment

From playlist Probability and Statistics

Video thumbnail

(ML 4.2) Maximum Likelihood Estimation (MLE) (part 2)

Definition of maximum likelihood estimates (MLEs), and a discussion of pros/cons. A playlist of these Machine Learning videos is available here: http://www.youtube.com/my_playlists?p=D0F06AA0D2E8FFBA

From playlist Machine Learning

Video thumbnail

Boris Beranger - Composite likelihood and logistic regression models for aggregated data

Dr Boris Beranger (UNSW Sydney) presents “Composite likelihood and logistic regression models for aggregated data”, 14 August 2020. This seminar was organised by the University of Technology Sydney.

From playlist Statistics Across Campuses

Video thumbnail

Sylvia Biscoveanu - Source characterization of individual compact binary coalescences - IPAM at UCLA

Recorded 20 September 2021. Sylvia Biscoveanu of the Massachusetts Institute of Technology presents "Source characterization of individual compact binary coalescences using Bayesian inference" at IPAM's Mathematical and Computational Challenges in the Era of Gravitational Wave Astronomy Tu

From playlist Tutorials: Math & Computational Challenges in the Era of Gravitational Wave Astronomy

Video thumbnail

Juan Calderon-Bustillo - Challenge of characterising high-mass compact mergers: the case of GW190521

Recorded 18 November 2021. Juan Calderon-Bustillo of the University of Santiago de Compostela presents "The challenge of characterising high-mass compact mergers: the case of GW190521" at IPAM's Workshop III: Source inference and parameter estimation in Gravitational Wave Astronomy. Abstra

From playlist Workshop: Source inference and parameter estimation in Gravitational Wave Astronomy

Video thumbnail

L20.9 Maximum Likelihood Estimation

MIT RES.6-012 Introduction to Probability, Spring 2018 View the complete course: https://ocw.mit.edu/RES-6-012S18 Instructor: John Tsitsiklis License: Creative Commons BY-NC-SA More information at https://ocw.mit.edu/terms More courses at https://ocw.mit.edu

From playlist MIT RES.6-012 Introduction to Probability, Spring 2018

Video thumbnail

Maximum Likelihood For the Normal Distribution, step-by-step!!!

Calculating the maximum likelihood estimates for the normal distribution shows you why we use the mean and standard deviation define the shape of the curve. NOTE: This is another follow up to the StatQuests on Probability vs Likelihood https://youtu.be/pYxNSUDSFH4 and Maximum Likelihood: h

From playlist StatQuest

Video thumbnail

Matt Moores - The Annealed Leap-Point MCMC Sampler (ALPS) for multi-modal posterior distributions

Dr Matt Moores (University of Wollongong) presents, "The Annealed Leap-Point MCMC Sampler (ALPS) for multi-modal posterior distributions", 10 June 2022.

From playlist Statistics Across Campuses

Video thumbnail

Gravitational astronomy (Lecture 5) by B S Sathyaprakash

DATES Monday 25 Jul, 2016 - Friday 05 Aug, 2016 VENUE Madhava Lecture Hall, ICTS Bangalore APPLY Over the last three years ICTS has been organizing successful summer/winter schools on various topics of gravitational-wave (GW) physics and astronomy. Each school from this series aimed at foc

From playlist Summer School on Gravitational-Wave Astronomy

Video thumbnail

Daniel Kuhn: "Wasserstein Distributionally Robust Optimization: Theory and Applications in Machi..."

Intersections between Control, Learning and Optimization 2020 "Wasserstein Distributionally Robust Optimization: Theory and Applications in Machine Learning" Daniel Kuhn - École Polytechnique Fédérale de Lausanne (EPFL) Abstract: Many decision problems in science, engineering and economi

From playlist Intersections between Control, Learning and Optimization 2020

Video thumbnail

Jean-Michel Zakoïan: Testing the existence of moments for GARCH-type processes

It is generally admitted that financial time series have heavy tailed marginal distributions. When time series models are fitted on such data, the non-existence of appropriate moments may invalidate standard statistical tools used for inference. Moreover, the existence of moments can be cr

From playlist Probability and Statistics

Video thumbnail

Jose Antonio Font - Inference with core-collapse supernova waveforms - IPAM at UCLA

Recorded 18 November 2021. Jose Antonio Font of the University of Valencia presents "Inference with core-collapse supernova waveforms" at IPAM's Workshop III: Source inference and parameter estimation in Gravitational Wave Astronomy. Abstract: Parameter estimation of core-collapse supernov

From playlist Workshop: Source inference and parameter estimation in Gravitational Wave Astronomy

Related pages

Efficiency (statistics) | Quasi-likelihood | Parameter | Partial likelihood methods for panel data | Consistent estimator | Nuisance parameter | Likelihood function | Normal distribution | Statistical model