Statistical tests

Exact test

In statistics, an exact (significance) test is a test such that if the null hypothesis is true, then all assumptions made during the derivation of the distribution of the test statistic are met. Using an exact test provides a significance test that maintains the type I error rate of the test at the desired significance level of the test. For example, an exact test at a significance level of , when repeated over many samples where the null hypothesis is true, will reject at most of the time. This is in contrast to an approximate test in which the desired type I error rate is only approximately maintained (i.e.: the test might reject > 5% of the time), while this approximation may be made as close to as desired by making the sample size sufficiently large. Exact tests that are based on discrete test statistics may be conservative, indicating that the actual rejection rate lies below the nominal significance level . As an example, this is the case for Fisher's exact test and its more powerful alternative, Boschloo's test. If the test statistic is continuous, it will reach the significance level exactly. Parametric tests, such as those used in exact statistics, are exact tests when the parametric assumptions are fully met, but in practice, the use of the term exact (significance) test is reserved for non-parametric tests, i.e., tests that do not rest on parametric assumptions. However, in practice, most implementations of non-parametric test software use asymptotical algorithms to obtain the significance value, which renders the test non-exact. Hence, when a result of statistical analysis is termed an “exact test” or specifies an “exact p-value”, this implies that the test is defined without parametric assumptions and is evaluated without making use of approximate algorithms. In principle, however, this could also signify that a parametric test has been employed in a situation where all parametric assumptions are fully met, but it is in most cases impossible to prove this completely in a real-world situation. Exceptions in which it is certain that parametric tests are exact include tests based on the binomial or Poisson distributions. The term permutation test is sometimes used as a synonym for exact test, but it should be kept in mind that all permutation tests are exact tests, but not all exact tests are permutation tests. (Wikipedia).

Video thumbnail

Intro to Hypothesis Testing

What is a hypothesis test? The meaning of the null and alternate hypothesis, with examples. Overview of test statistics and confidence levels.

From playlist Hypothesis Tests and Critical Values

Video thumbnail

Statistics Lecture 3.3: Finding the Standard Deviation of a Data Set

https://www.patreon.com/ProfessorLeonard Statistics Lecture 3.3: Finding the Standard Deviation of a Data Set

From playlist Statistics (Full Length Videos)

Video thumbnail

Intro to The F Test

Overview of the F-Test. What it is and how it works with general steps and assumptions.

From playlist F Test

Video thumbnail

Identify the Level of Measurement MyMathlab Statistics Homework

Please Subscribe here, thank you!!! https://goo.gl/JQ8Nys Identify the Level of Measurement MyMathlab Statistics Homework

From playlist Statistics

Video thumbnail

Statistics 5_1 Confidence Intervals

In this lecture explain the meaning of a confidence interval and look at the equation to calculate it.

From playlist Medical Statistics

Video thumbnail

Hypothesis Tests AS Level Maths Statistics Exam Questions 2

AS Level Maths Statistics Exam Questions on hypothesis tests with binomial distribution, from AQA, Edexcel and OCR MEI, perfect revision and practice for your AS Maths exams and A Level Maths year 1! Statistical hypothesis testing is a huge part of statistics in A Level Maths, and you'll

From playlist Hypothesis Tests AS Level Maths Statistics Exam Questions

Video thumbnail

Find x given the z-score, sample mean, and sample standard deviation

Please Subscribe here, thank you!!! https://goo.gl/JQ8Nys Find x given the z-score, sample mean, and sample standard deviation

From playlist Statistics

Video thumbnail

#26. What type of tailed test should be performed?

Please Subscribe here, thank you!!! https://goo.gl/JQ8Nys #26. What type of tailed test should be performed?

From playlist Statistics Final Exam

Video thumbnail

Fisher's Exact Test for Independence in SPSS

How to run Fisher's Exact Test in SPSS.

From playlist SPSS

Video thumbnail

Hypothesis Tests AS Level Maths Statistics Exam Questions 4

AS Level Maths Statistics Exam Questions on hypothesis tests with binomial distribution, from AQA, Edexcel and OCR MEI, perfect revision and practice for your AS Maths exams and A Level Maths year 1! Statistical hypothesis testing is a huge part of statistics in A Level Maths, and you'll

From playlist Hypothesis Tests AS Level Maths Statistics Exam Questions

Video thumbnail

MoreNPTests.2.ReferenceDistributions

his video is brought to you by the Quantitative Analysis Institute at Wellesley College. The material is best viewed as part of the online resources that organize the content and include questions for checking understanding: https://www.wellesley.edu/qai/onlineresources

From playlist More Non-Parametric Tests

Video thumbnail

Differential Equations: Exact DEs Example 1

It's important to be able to classify a differential equation so we can pick the right method to solve it. In this video, I run through the steps of how to classify a first order differential equation as separable, linear, exact, or neither.

From playlist Differential Equations

Video thumbnail

Differential Equations: Lecture 2.4 Exact Equations (Version 2)

This is a real classroom lecture. In this video I covered section 2.4 which is on Exact Equations. This course uses Zill's book on DE's, this is my review of the book, https://www.youtube.com/watch?v=M6o3Sp-LeJo& Here is my DE lecture playlist, https://www.youtube.com/playlist?list=PLO1

From playlist Differential Equations Full Lectures

Video thumbnail

Differential Equations: Lecture 2.4 Exact Equations

This is an actual classroom lecture on Differential Equations. In this video I covered section 2.4 which is on Exact Differential Equations. If you find this video helpful please like and share. I hope this helps someone:) This course uses the book written by Zill, here is my review of t

From playlist Differential Equations Full Lectures

Video thumbnail

Why Does Building a Robust Automation Framework Matter?

This talk will dive into the importance of building a robust automation framework architecture that leverages Object Orientated Design Principles. Why does automation architecture matter? Clean code, Flexible, Easy to read, interpret, maintain and build upon. Come and see how this autom

From playlist Performance and Testing

Video thumbnail

Jonah Stiennon Lightning Demo Keynote - Velocity Santa Clara 2014

Jonah Stiennon's lightning demo from the 2014 O'Reilly Velocity conference in Santa Clara, CA: "Test Driven Mobile Development with Appium, Just Like Selenium". "In this Lightning Demo, I'll give a tour of Appium, an open source project which allows you to programmatically control mobile

From playlist Velocity Conference 2014 (Santa Clara, CA)

Video thumbnail

FEM@LLNL | An Efficient and Effective FEM Solver for Diffusion Equation with Strong Anisotropy

Sponsored by the MFEM project, the FEM@LLNL Seminar Series focuses on finite element research and applications talks of interest to the MFEM community. On December 13, 2022, Lin Mu of the University of Georgia presented "An Efficient and Effective FEM Solver for Diffusion Equation with St

From playlist FEM@LLNL Seminar Series

Video thumbnail

Odds Ratios and Log(Odds Ratios), Clearly Explained!!!

Odds Ratios and Log(Odds Ratios) are like R-Squared - they describe a relationship between two things. And just like R-Squared, you need to determine if this relationship is statistically significant. This StatQuest goes over all these details so that you are ready for any odds ratio and l

From playlist StatQuest

Video thumbnail

Hypothesis Tests AS Level Maths Statistics Exam Questions 3

AS Level Maths Statistics Exam Questions on hypothesis tests with binomial distribution, from AQA, Edexcel and OCR MEI, perfect revision and practice for your AS Maths exams and A Level Maths year 1! Statistical hypothesis testing is a huge part of statistics in A Level Maths, and you'll

From playlist Hypothesis Tests AS Level Maths Statistics Exam Questions

Video thumbnail

Excel Magic Trick 1134: IF or VLOOKUP function for Assigning Categories w/ Excel Formula 8 Examples

Download Excel Start File: https://people.highline.edu/mgirvin/YouTubeExcelIsFun/EMT1134.xlsb Download Excel File: http://people.highline.edu/mgirvin/ExcelIsFun.htm See how to assign product and sales categories using various methods: Overview 1) (00:44 min) Overview (01:30 min) IF and Ha

From playlist Excel Series: Magic Tricks (6th 200 videos)

Related pages

Fisher's exact test | Parametric statistics | Likelihood-ratio test | Statistical Methods for Research Workers | Exact statistics | Statistical assumption | Expected value | Type I and type II errors | P-value | Boschloo's test | Combinatorics | Test statistic | Statistics | Pearson's chi-squared test | Approximation | Permutation test | Probability distribution | Null hypothesis