Evolutionary computation | Evolutionary algorithms | Artificial neural networks

Evolutionary acquisition of neural topologies

Evolutionary acquisition of neural topologies (EANT/EANT2) is an evolutionary reinforcement learning method that evolves both the topology and weights of artificial neural networks. It is closely related to the works of Angeline et al. and Stanley and Miikkulainen. Like the work of Angeline et al., the method uses a type of parametric mutation that comes from evolution strategies and evolutionary programming (now using the most advanced form of the evolution strategies CMA-ES in EANT2), in which adaptive step sizes are used for optimizing the weights of the neural networks. Similar to the work of Stanley (NEAT), the method starts with minimal structures which gain complexity along the evolution path. (Wikipedia).

Video thumbnail

Evolving Normalization-Activation Layers

Normalization and activation layers have seen a long history of hand-crafted variants with various results. This paper proposes an evolutionary search to determine the ultimate, final and best combined normalization-activation layer... in a very specific setting. https://arxiv.org/abs/200

From playlist Deep Learning Architectures

Video thumbnail

Jean-Claude Belfiore - Beyond the statistical perspective on deep learning,...

Talk at the school and conference “Toposes online” (24-30 June 2021): https://aroundtoposes.com/toposesonline/ Beyond the statistical perspective on deep learning, the toposic point of view: Invariance and semantic information (joint work with Daniel Bennequin) The last decade has witnes

From playlist Toposes online

Video thumbnail

Neural Architecture Search

Meta-Learning is one of the most interesting methods powering next-generation Deep Neural Networks. This video will explain the idea of using Search algorithms to design Neural Network layers! Thanks for watching, please Subscribe for more Deep Learning videos! Paper Link: https://arxiv.

From playlist Neural Network Design

Video thumbnail

Public Lecture: Scaling of Electronic Devices: From the Vacuum Tube... by Latha Venkataraman

Second Bangalore School on Population Genetics and Evolution URL: http://www.icts.res.in/program/popgen2016 DESCRIPTION: Just as evolution is central to our understanding of biology, population genetics theory provides the basic framework to comprehend evolutionary processes. Population

From playlist Modern Trends in Electron Transfer Chemistry: From Molecular Electronics to Devices

Video thumbnail

Neural Networks and Deep Learning

This lecture explores the recent explosion of interest in neural networks and deep learning in the context of 1) vast and increasing data sets, and 2) rapidly improving computational hardware, which have enabled the training of deep neural networks. Book website: http://databookuw.com/

From playlist Intro to Data Science

Video thumbnail

Stanford Course - Genetic Engineering & Biotechnology

Preview the online course: Genetic Engineering and Biotechnology (XGEN203) More info: http://geneticscertificate.stanford.edu/courses/genetic-engineering-and-biotechnology.php The co-evolution of genetic engineering and biotechnology in the last 30+ years has allowed for groundbreaking fi

From playlist Genetics & Genomics

Video thumbnail

Detecting other types of positive selection by Wolfgang Stephan

Second Bangalore School on Population Genetics and Evolution URL: http://www.icts.res.in/program/popgen2016 DESCRIPTION: Just as evolution is central to our understanding of biology, population genetics theory provides the basic framework to comprehend evolutionary processes. Population

From playlist Second Bangalore School on Population Genetics and Evolution

Video thumbnail

Andrew Ferguson: "Machine learning-enabled enhanced sampling in biomolecular simulation and..."

Machine Learning for Physics and the Physics of Learning Tutorials 2019 "Machine learning-enabled enhanced sampling in biomolecular simulation and data-driven design of self-assembling photonic crystals and optoelectonic π-conjugated oligopeptides" Andrew Ferguson, University of Chicago -

From playlist Machine Learning for Physics and the Physics of Learning 2019

Video thumbnail

AI Weekly Update - May 11th, 2020 (#20)

Thank you for watching! Please Subscribe! Machine Learning Street Talk: https://www.youtube.com/channel/UCMLtBahI5DMrt0NPvDSoIRQ Paper Links: Deep Learning with Graph-Structured Representations: https://dare.uva.nl/search?identifier=1b63b965-24c4-4bcd-aabb-b849056fa76d Yoshua Bengio ICLR

From playlist AI Research Weekly Updates

Video thumbnail

On the Measure of Intelligence by François Chollet - Part 1: Foundations (Paper Explained)

How does one measure the Intelligence of an AI? Is AlphaGo intelligent? How about GPT-3? In this landmark paper, Chollet proposes a solid measure of intelligence for AI that revolves around generalization, rather than skill. OUTLINE: 0:00 - Intro 1:15 - The need for a measure of intellige

From playlist Papers Explained

Video thumbnail

Mohammed AlQuraishi - OpenFold: Lessons and insights from rebuilding and retraining AlphaFold2

Recorded 23 January 2023. Mohammed AlQuraishi of Harvard Medical School, Systems Biology, presents "OpenFold: Lesson learned and insights gained from rebuilding and retraining AlphaFold2" at IPAM's Learning and Emergence in Molecular Systems Workshop. Abstract: AlphaFold2 revolutionized st

From playlist 2023 Learning and Emergence in Molecular Systems

Video thumbnail

Detecting strong positive directional selection in the genome by Wolfgang Stephan

Second Bangalore School on Population Genetics and Evolution URL: http://www.icts.res.in/program/popgen2016 DESCRIPTION: Just as evolution is central to our understanding of biology, population genetics theory provides the basic framework to comprehend evolutionary processes. Population

From playlist Second Bangalore School on Population Genetics and Evolution

Video thumbnail

Sayan Mukherjee (8/29/21): Modeling shapes and fields: a sheaf theoretic perspective

We will consider modeling shapes and fields via topological and lifted-topological transforms. Specifically, we show how the Euler Characteristic Transform and the Lifted Euler Characteristic Transform can be used in practice for statistical analysis of shape and field data. The Lifted Eul

From playlist Beyond TDA - Persistent functions and its applications in data sciences, 2021

Video thumbnail

Deep Learning Lecture 5.2 - Convolutions

Convolutional Neural Networks - Convolutions - Equivariance - Sparse connections - Parameter sharing

From playlist Deep Learning Lecture

Video thumbnail

Kaggle Reading Group: Weight Agnostic Neural Networks (Part 2) | Kaggle

Today we're continuing with the paper "Weight Agnostic Neural Networks" by Gaier & Ha from NeurIPS 2019. Link to paper: https://arxiv.org/pdf/1906.04358.pdf SUBSCRIBE: https://www.youtube.com/c/kaggle?sub_... About Kaggle: Kaggle is the world's largest community of data scientists. Join

From playlist Kaggle Reading Group | Kaggle

Video thumbnail

Gene genealogies with recombination by John Wakeley

Second Bangalore School on Population Genetics and Evolution URL: http://www.icts.res.in/program/popgen2016 DESCRIPTION: Just as evolution is central to our understanding of biology, population genetics theory provides the basic framework to comprehend evolutionary processes. Population

From playlist Second Bangalore School on Population Genetics and Evolution

Video thumbnail

How I created an evolving neural network ecosystem

After my last video I got a lot of comments (mainly on Reddit) asking me to make a video explaining how I did it. It took me a while to learn how to video edit, voice act, and animate, so it was about time I presented and explained this project. The Bibites Made in C# on Unity I highly

From playlist Progress of Artificial Life Simulation

Video thumbnail

Lecture 08: Function Approximation with Supervised Learning

Eighth lecture video on the course "Reinforcement Learning" at Paderborn University during the summer term 2020. Source files are available here: https://github.com/upb-lea/reinforcement_learning_course_materials

From playlist Reinforcement Learning Course: Lectures (Summer 2020)

Video thumbnail

Stanford Course - New Frontiers in Cancer Genomics

Preview the online course: New Frontiers in Cancer Genomics (XGEN206) Info: http://geneticscertificate.stanford.edu/ New research shows that genetic variations continue to accrue throughout tumor development. Having the ability to conduct deep sequencing on the healthy and cancerous cells

From playlist Genetics & Genomics

Video thumbnail

Kaggle Reading Group: Weight Agnostic Neural Networks | Kaggle

Today we're starting the paper "Weight Agnostic Neural Networks" by Gaier & Ha from NeurIPS 2019. Link to paper: https://arxiv.org/pdf/1906.04358.pdf SUBSCRIBE: https://www.youtube.com/c/kaggle?sub_... About Kaggle: Kaggle is the world's largest community of data scientists. Join us to

From playlist Kaggle Reading Group | Kaggle

Related pages

Artificial neural network | Neuroevolution | Neuroevolution of augmenting topologies | Reinforcement learning | CMA-ES | Evolution strategy | Evolutionary computation | Gauss–Newton algorithm | Evolutionary programming