Comparison of assessments | Statistical reliability

Intra-rater reliability

In statistics, intra-rater reliability is the degree of agreement among repeated administrations of a diagnostic test performed by a single rater. Intra-rater reliability and inter-rater reliability are aspects of test validity. (Wikipedia).

Video thumbnail

Reliability 1: External reliability and rater reliability and agreement

In this video, I discuss external reliability, inter- and intra-rater reliability, and rater agreement.

From playlist Reliability analysis

Video thumbnail

Centrality - Intro to Algorithms

This video is part of an online course, Intro to Algorithms. Check out the course here: https://www.udacity.com/course/cs215.

From playlist Introduction to Algorithms

Video thumbnail

The Range & Interquartile Range – Two Simple Measures of Variability (6-2)

We will begin with two simple measures of variability: the range and the interquartile range. Range is the variability between the two most extreme scores in the distribution. It is the difference between the largest and smallest scores. Outliers can affect the range, but not the interquar

From playlist WK6 Measures of Variability - Online Statistics for the Flipped Classroom

Video thumbnail

SPSS - Reliability Analysis Example

Lecturer: Katherine Miller Missouri State University Fall 2015 This video covers how to run Cronbach's alpha in SPSS for reliability. Lecture materials and assignments available at statisticsofdoom.com. https://statisticsofdoom.com/page/basic-statistics/

From playlist Intermediate Statistics Videos

Video thumbnail

JASP 0.17 Tutorial: Intraclass Correlation [ICC] Analysis (Episode 47)

In this JASP video, I show you how to perform an Intraclass Correlation (ICC), another reliability analysis that can assist when trying to figure out if judges or measurements are in agreement. It is found under the Reliability Module! JASP: https://jasp-stats.org NOTE: This tutorial use

From playlist JASP Tutorials

Video thumbnail

MAE915_Week 8_Assessing Writing (Practice)_30/09/2021

To support the channel, I would like to invite you to join this channel to get access to perks: https://www.youtube.com/channel/UCfu2GCdjq50W-kL-cv3rcLw/join

From playlist Language Assessment & Technology

Video thumbnail

JASP 0.16 Tutorial: Inter-Item Correlation Reliability Module (Episode 40)

In this JASP tutorial, I explore briefly the new options and calculations of the Inter-item correlation coefficient (ICC) for reliability analysis! The data in this video can be found in the base JASP Data Library. JASP: https://jasp-stats.org NOTE: This tutorial uses the new preview/be

From playlist JASP Tutorials

Video thumbnail

Writing & Assessment (6)

In this series of videos, I will discuss some of the fundamental principles writing and writing assessment.

From playlist What is Writing?

Video thumbnail

Statistics - How to find outliers

This video covers how to find outliers in your data. Remember that an outlier is an extremely high, or extremely low value. We determine extreme by being 1.5 times the interquartile range above Q3 or below Q1. For more videos visit http://www.mysecretmathtutor.com

From playlist Statistics

Video thumbnail

Statistics - Compute the interquartile range

This video shows how to compute the interquartile range for a set of data. Remember to reorganize the data so that you can find the median values easier. For more videos visit http://mysecretmathtutor.com

From playlist Statistics

Video thumbnail

Jamovi 1.8/2.0 Tutorial: SeolMatrix Add-on Module (Episode 39)

In this Jamovi tutorial, I discuss a new add-on module to Jamovi called SeolMatrix (https://github.com/hyunsooseol/seolmatrix), created by Hyunsoo Seol! This package contains several specific types of correlations, including polychoric, spearman, and partial correlations. I compare its par

From playlist Jamovi Tutorials

Video thumbnail

Intrusion Detection: Part 2

Fundamental concepts of intrusion detection are discussed. Various types of intrusion are analyzed. Password management is explained.

From playlist Network Security

Video thumbnail

Many-Facet Rasch Measurement Using Facets Software

In this video, I demonstrate how to carry out a Many-Facet Rasch Measurement Using Facets Software. If you have not watched the previous videos on Rasch measurement, they can be found from the links below: 1. https://www.youtube.com/watch?v=FDUYm7ZhXkw&t=49s 2. https://www.youtube.com/watc

From playlist Rasch Measurement

Video thumbnail

Finding Outliers using Interquartile Range | Statistics, IQR, Quartiles

How do we find outliers of a data set using the interquartile range? This is done using a simple rule, any value less than Q1-1.5*IQR is an outlier, and any value greater than Q3+1.5*IQR is an outlier. We'll go through the step by step process of finding outliers using IQR in today's video

From playlist Statistics

Video thumbnail

Reliability 4: Cohen's Kappa and inter-rater agreement

In this video, I discuss Cohen's Kappa and inter-rater agreement. I will demonstrate how to compute these in SPSS and excel and make sense of the output. If you are interested to see how Cohen's Kappa compares with McNemar's tests, please watch the following video: https://youtu.be/va-Tjv

From playlist Cohen's Kappa

Video thumbnail

SPSS Tutorial for data analysis | SPSS for Beginners | Part 2

SPSS Statistics is a software package used for interactive, or batched, statistical analysis. Long produced by SPSS Inc., it was acquired by IBM in 2009. The current versions are named IBM SPSS Statistics. In this course you will how to use SPSS for data analysis. This #SPSS course is begi

From playlist SPSS data Analysis

Video thumbnail

IP Security: Part 1

Fundamental concepts of IPSec are discussed. Authentication Header is explained. ESP & IKE are analyzed.

From playlist Network Security

Video thumbnail

Many-Facet Rasch Measurement in the Peer-Assessments of Oral Presentations | Part 3

In this third installment, I continue to discuss Many-Facet Rasch Measurement in the psychometric validation of a peer-rated oral presentation assignment. The video is highly recommended for the teachers who want to find out if the peer assessments of their students are reliable. For intro

From playlist Rasch Measurement

Related pages

Inter-rater reliability | Repeatability | Statistics | Reliability (statistics) | Test validity