Deep learning

Foundation models

A foundation model is a large artificial intelligence model trained on a vast quantity of unlabeled data at scale (usually by self-supervised learning) resulting in a model that can be adapted to a wide range of downstream tasks. Foundation models have helped bring about a major transformation in how AI systems are built since their introduction in 2018. Early examples of foundation models were large pre-trained language models including BERT and GPT-3. Using the same ideas, domain specific models using sequences of other kinds of tokens, such as medical codes, have been built as well. Subsequently, several multimodal foundation models have been produced including DALL-E, Flamingo, and Florence. The Stanford Institute for Human-Centered Artificial Intelligence's (HAI) Center for Research on Foundation Models (CRFM) popularized the term. (Wikipedia).

Video thumbnail

Stanford Webinar: Business Models for Entrepreneurs and Innovators

http://create.stanford.edu/ This discussion with Professor Haim Mendelson explores the best approach for putting together a business model and how to use it for new business development opportunities. Learn why the business model is a blueprint for planning, and then building, new busine

From playlist Stanford Webinars

Video thumbnail

Build Anything with FoundationDB

FoundationDB is like a database construction kit, which can be intimidating to new developers and those unfamiliar with database system design and internals. In this talk, Ryan will explain how to start from nothing but an empty key-value store and build anything you can dream up, all whil

From playlist Databases

Video thumbnail

Session 4 - Foundation models: the new kid on the block?

What are the strengths and weaknesses of foundational models such as GPT3? Are they the future and what are their limitations and societal implications? Panellists include... Professor Michael Wooldridge, Programme Co-Director for Artificial Intelligence and Turing AI World-Leading Resea

From playlist AI UK 2022 - IN THE LAB STAGE

Video thumbnail

Foundation CSS Framework Tutorial - Crash Course for Beginners

Learn everything you need to know about Foundation by ZERB. Foundation is a responsive front-end CSS framework that makes it easy to design beautiful responsive websites. This tutorial for beginners covers all of the components of Foundation. First, you will learn how to use Foundation's

From playlist HTML and CSS Tutorials

Video thumbnail

Higher data structures | Data structures in Mathematics Math Foundations 163

Lists, ordered sets (osets), multisets (msets) and sets are the four key types of data structures. In this video we begin looking at how we can combine these types in a nested fashion, by considering for example lists of lists, or sets of msets etc. This will give us a lot more flexibili

From playlist Math Foundations

Video thumbnail

Model Theory - part 01 - The Setup in Classical Set Valued Model Theory

Here we give the basic setup for Model Theory. I learned this from a talk Tom Scanlon gave in 2010 at CUNY.

From playlist Model Theory

Video thumbnail

Definitions, specification and interpretation | Arithmetic and Geometry Math Foundations 44

We discuss important meta-issues regarding definitions and specification in mathematics. We also introduce the idea that mathematical definitions, expressions, formulas or theorems may support a variety of possible interpretations. Examples use our previous definitions from elementary ge

From playlist Math Foundations

Video thumbnail

Sets and other data structures | Data Structures in Mathematics Math Foundations 151

In mathematics we often want to organize objects. Sets are not the only way of doing this: there are other data types that are also useful and that can be considered together with set theory. In particular when we group objects together, there are two fundamental questions that naturally a

From playlist Math Foundations

Video thumbnail

Foundation Models | On the opportunities and risks of calling pre-trained models “Foundation Models”

Sound the opinionated video alarm! 🚨 We need to talk about “foundation models”: What does the term mean? Is ViT a foundation model? Do we really need AI to “understand”? And what’s the thing with out-of-domain generalization / distribution shift? 😎 Btw, 50,000 ViT models released with the

From playlist Explained AI/ML in your Coffee Break

Video thumbnail

ETHICS in AI? Are there RISKS for us? In Education or Medical treatment?

We look at the US response to Explainable AI (XAI) and Ethics in 2022. Stanford's HAI response on: Explainable AI / Foundation models / Large Language Models - can there be risks for us? A new group assembled by Stanford’s institute for Human-Centered Artificial Intelligence (HAI), called

From playlist Explainable AI (XAI) and Decision Intelligence (DI). Performance on Vision.

Video thumbnail

The AI Buzz, Episode #3: Constitutional AI, Emergent Abilities and Foundation Models

The AI Buzz is a conversation about the latest trends in AI between me and Luca Antiga, the Chief Technology Officer at Lightning AI. In this episode, we talk about Constitutional AI, the ability of a model to train itself not to say bad words, Emergent Abilities, Foundation Models and Sir

From playlist The AI Buzz with Luca and Josh

Video thumbnail

Zermelo Fraenkel Foundation

This is part of a series of lectures on the Zermelo-Fraenkel axioms for set theory. We discuss the axiom of foundation, which says that the membership relation is well founded, and give some examples of the bizarre things that can happen if sets are allowed to be non-well-founded. For

From playlist Zermelo Fraenkel axioms

Video thumbnail

Foundation: Are We Predictable?

In which Jeff Goldblum, lemmings, and a pixelated photo of Obama help me uncover the mathematical reality of Isaac Asimov’s psychohistory. In his Foundation book series, Asimov invented psychohistory, a scientific description of history that can predict the future. This video asks whether

From playlist Video Essays

Video thumbnail

Payel Das - Design and Evaluation of Foundation Models and Generative AI in Molecular Space

Recorded 23 January 2023. Payel Das of IBM Research presents "Design and Evaluation of Foundation Models and Generative AI in Molecular Space" at IPAM's Learning and Emergence in Molecular Systems Workshop. Abstract: Learning effective representations of molecules is critical in a variety

From playlist 2023 Learning and Emergence in Molecular Systems

Video thumbnail

Linear Regression Fit Point by Point — Topic 75 of Machine Learning Foundations

#MLFoundations #Calculus #MachineLearning In this video, I introduce the mathematically simplest machine learning model I could think of: a regression line that we fit to data points one by one, single point by single point. This simple model will enable us, in the next video, to derive t

From playlist Calculus for Machine Learning

Video thumbnail

[ML News] Stanford HAI coins Foundation Models & High-profile case of plagiarism uncovered

#plagiarism #foundationmodels #tesla The best place to keep up to date with the latest and greatest from the ML world! OUTLINE: 0:00 - Intro & Sponsor 3:15 - A high-profile case of plagiarism shocks the ML world 11:55 - Stanford AI releases paper on "Foundation Models" 19:45 - Updates on

From playlist All Videos

Video thumbnail

Calculus II: Partial Derivatives & Integrals — Subject 4 of Machine Learning Foundations

#MLFoundations #Calculus #MachineLearning This video provides a preview of the content that is covered in this subject, which is focused on Partial Derivatives (Multi-Variable Calculus) and Integration. It also reviews the Single-Variable Calculus you need to be familiar with (from the pr

From playlist Calculus for Machine Learning

Related pages

GPT-3 | DALL-E | Artificial intelligence