A timeline of events related to information theory, quantum information theory and statistical physics, data compression, error correcting codes and related subjects. * 1872 – Ludwig Boltzmann presents his H-theorem, and with it the formula Σpi log pi for the entropy of a single gas particle * 1878 – J. Willard Gibbs defines the Gibbs entropy: the probabilities in the entropy formula are now taken as probabilities of the state of the whole system * 1924 – Harry Nyquist discusses quantifying "intelligence" and the speed at which it can be transmitted by a communication system * 1927 – John von Neumann defines the von Neumann entropy, extending the Gibbs entropy to quantum mechanics * 1928 – Ralph Hartley introduces Hartley information as the logarithm of the number of possible messages, with information being communicated when the receiver can distinguish one sequence of symbols from any other (regardless of any associated meaning) * 1929 – Leó Szilárd analyses Maxwell's Demon, showing how a Szilard engine can sometimes transform information into the extraction of useful work * 1940 – Alan Turing introduces the deciban as a measure of information inferred about the German Enigma machine cypher settings by the Banburismus process * 1944 – Claude Shannon's theory of information is substantially complete * 1947 – Richard W. Hamming invents Hamming codes for error detection and correction (to protect patent rights, the result is not published until 1950) * 1948 – Claude E. Shannon publishes A Mathematical Theory of Communication * 1949 – Claude E. Shannon publishes Communication in the Presence of Noise – Nyquist–Shannon sampling theorem and Shannon–Hartley law * 1949 – Claude E. Shannon's Communication Theory of Secrecy Systems is declassified * 1949 – Robert M. Fano publishes Transmission of Information. M.I.T. Press, Cambridge, Massachusetts – Shannon–Fano coding * 1949 – Leon G. Kraft discovers Kraft's inequality, which shows the limits of prefix codes * 1949 – Marcel J. E. Golay introduces Golay codes for forward error correction * 1951 – Solomon Kullback and Richard Leibler introduce the Kullback–Leibler divergence * 1951 – David A. Huffman invents Huffman encoding, a method of finding optimal prefix codes for lossless data compression * 1953 – and George W. Patterson devise the Sardinas–Patterson algorithm, a procedure to decide whether a given variable-length code is uniquely decodable * 1954 – Irving S. Reed and David E. Muller propose Reed–Muller codes * 1955 – Peter Elias introduces convolutional codes * 1957 – Eugene Prange first discusses cyclic codes * 1959 – Alexis Hocquenghem, and independently the next year Raj Chandra Bose and Dwijendra Kumar Ray-Chaudhuri, discover BCH codes * 1960 – Irving S. Reed and Gustave Solomon propose Reed–Solomon codes * 1962 – Robert G. Gallager proposes low-density parity-check codes; they are unused for 30 years due to technical limitations * 1965 – Dave Forney discusses concatenated codes * 1966 – Fumitada Itakura (Nagoya University) and Shuzo Saito (Nippon Telegraph and Telephone) develop linear predictive coding (LPC), a form of speech coding * 1967 – Andrew Viterbi reveals the Viterbi algorithm, making decoding of convolutional codes practicable * 1968 – Elwyn Berlekamp invents the Berlekamp–Massey algorithm; its application to decoding BCH and Reed–Solomon codes is pointed out by James L. Massey the following year * 1968 – Chris Wallace and David M. Boulton publish the first of many papers on Minimum Message Length (MML) statistical and inductive inference * 1970 – Valerii Denisovich Goppa introduces Goppa codes * 1972 – proposes Justesen codes, an improvement of Reed–Solomon codes * 1972 – Nasir Ahmed proposes the discrete cosine transform (DCT), which he develops with T. Natarajan and K. R. Rao in 1973; the DCT later became the most widely used lossy compression algorithm, the basis for multimedia formats such as JPEG, MPEG and MP3 * 1973 – David Slepian and Jack Wolf discover and prove the Slepian–Wolf coding limits for distributed source coding * 1976 – Gottfried Ungerboeck gives the first paper on trellis modulation; a more detailed exposition in 1982 leads to a raising of analogue modem POTS speeds from 9.6 kbit/s to 33.6 kbit/s * 1976 – Richard Pasco and Jorma J. Rissanen develop effective arithmetic coding techniques * 1977 – Abraham Lempel and Jacob Ziv develop Lempel–Ziv compression (LZ77) * 1989 – Phil Katz publishes the .zip format including DEFLATE (LZ77 + Huffman coding); later to become the most widely used archive container * 1993 – Claude Berrou, Alain Glavieux and Punya Thitimajshima introduce Turbo codes * 1994 – Michael Burrows and David Wheeler publish the Burrows–Wheeler transform, later to find use in bzip2 * 1995 – Benjamin Schumacher coins the term qubit and proves the quantum noiseless coding theorem * 2003 – David J. C. MacKay shows the connection between information theory, inference and machine learning in his book. * 2006 – first Asymmetric numeral systems entropy coding: since 2014 popular replacement of Huffman and arithmetic coding in compressors like Facebook Zstandard, Apple LZFSE, CRAM or JPEG XL * 2008 – Erdal Arıkan introduces polar codes, the first practical construction of codes that achieves capacity for a wide array of channels (Wikipedia).
History of computers - A Timeline
A timeline from the first computer, The Turing Machine, to the 1970's. Hope you guys enjoy,and make sure to subscribe and like! Adding subtitles for our video is welcomed! Your translation can help people around the world see our awesome videos! http://www.youtube.com/timedtext_cs_panel?c
From playlist Computers
(IC 1.6) A different notion of "information"
An informal discussion of the distinctions between our everyday usage of the word "information" and the information-theoretic notion of "information". A playlist of these videos is available at: http://www.youtube.com/playlist?list=PLE125425EC837021F Attribution for image of TV static:
From playlist Information theory and Coding
Mark C. Mescher - A Natural History of Information
In this talk, I discuss the role of information in biology from an evolutionary perspective. I will define information as a biological concept and argue that Darwinian evolution is fundamentally an information-centric process. Building on that idea, I will discuss how key transitions in ev
From playlist LSC 2022
(IC 1.1) Information theory and Coding - Outline of topics
A playlist of these videos is available at: http://www.youtube.com/playlist?list=PLE125425EC837021F Overview of central topics in Information theory and Coding. Compression (source coding) theory: Source coding theorem, Kraft-McMillan inequality, Rate-distortion theorem Error-correctio
From playlist Information theory and Coding
From information theory to learning via Statistical Physics by Florent Krzakala
26 December 2016 to 07 January 2017 VENUE: Madhava Lecture Hall, ICTS Bangalore Information theory and computational complexity have emerged as central concepts in the study of biological and physical systems, in both the classical and quantum realm. The low-energy landscape of classical
From playlist US-India Advanced Studies Institute: Classical and Quantum Information
From information theory to learning via Statistical Physics: Introduction: by Florent Krzakala
26 December 2016 to 07 January 2017 VENUE: Madhava Lecture Hall, ICTS Bangalore Information theory and computational complexity have emerged as central concepts in the study of biological and physical systems, in both the classical and quantum realm. The low-energy landscape of classical
From playlist US-India Advanced Studies Institute: Classical and Quantum Information
From information theory to learning via Statistical Physics: From statistical by Florent Krzakala
26 December 2016 to 07 January 2017 VENUE: Madhava Lecture Hall, ICTS Bangalore Information theory and computational complexity have emerged as central concepts in the study of biological and physical systems, in both the classical and quantum realm. The low-energy landscape of classical
From playlist US-India Advanced Studies Institute: Classical and Quantum Information
Information Theory Meets Quantum Physics: The magic of wave dynamics by Apoorva Patel
26 December 2016 to 07 January 2017 VENUE: Madhava Lecture Hall, ICTS Bangalore Information theory and computational complexity have emerged as central concepts in the study of biological and physical systems, in both the classical and quantum realm. The low-energy landscape of classical
From playlist US-India Advanced Studies Institute: Classical and Quantum Information
Stanford Seminar - Developing Design Spaces for Visualization - Tamara Munzner
Tamara Munzner is a Professor of Computer Science at the University of British Columbia. This talk was given March 4, 2022. Design spaces impose a systematic structure on the set of possibilities, intended to capture the key variables at play in the context of a particular design proble
From playlist Stanford Seminars
If you want to dive into topics like free will, Marvel, and multiple dimensions, then today is your LOKI day! Wow, what a pun! Listen as Dominic Andre and Julian Huguet help Ethan attempt to understand these fascinating concepts. » Subscribe to Seeker+! https://bit.ly/SeekerPlusSubscribe
From playlist Seeker+
Chrome Dev Tools: Timeline Tab
Info and mini-lesson on the 'Timeline' tab of Chrome Dev Tools. Check out more in-depth documentation here: https://developers.google.com/web/tools/profile-performance/evaluate-performance/timeline-tool The Timeline panel lets you record and analyze all the activity in your application as
From playlist Computer Science and Software Engineering Theory with Briana
Timeline to Collapse by Francesco Cerini
PROGRAM TIPPING POINTS IN COMPLEX SYSTEMS (HYBRID) ORGANIZERS: Partha Sharathi Dutta (IIT Ropar, India), Vishwesha Guttal (IISc, India), Mohit Kumar Jolly (IISc, India) and Sudipta Kumar Sinha (IIT Ropar, India) DATE: 19 September 2022 to 30 September 2022 VENUE: Ramanujan Lecture Hall an
From playlist TIPPING POINTS IN COMPLEX SYSTEMS (HYBRID, 2022)
Can Your Dreams Tell the Future?
Have you ever had a feeling that something big was going to happen, and then it does? A study by the American Psychological Association defines a precognitive dream as "a dream that seemingly includes knowledge about the future that cannot be inferred with by some prior knowledge.". In oth
From playlist Philosophy & Psychology 🧠
DEFCON 17: PLA Information Warfare Development Timeline and Nodal Analysis
Speaker: TK234 Analyst The development timeline is consistent with the broad contours of China's current IW theory. It showed clearly the footprints of China's common war preparation patterns and People's war concept. For China, IW is a People's War, beyond simple "hacking," and is a long
From playlist DEFCON 17
At the edge of time: Exploring the mysteries of our universe’s first seconds
Over the past few decades, scientists have made incredible discoveries about how our cosmos evolved over the past 13.8 billion years. But we still know very little about what happened in the first seconds after the Big Bang. In this public lecture, physicist and author Dan Hooper explores
From playlist Lecture Series
Thermodynamics of Information by Juan MR Parrondo (Lecture 4)
26 December 2016 to 07 January 2017 VENUE: Madhava Lecture Hall, ICTS Bangalore Information theory and computational complexity have emerged as central concepts in the study of biological and physical systems, in both the classical and quantum realm. The low-energy landscape of classical
From playlist US-India Advanced Studies Institute: Classical and Quantum Information
Introduction to the Bible (from an academic point of view)
Buy the summary chart: https://usefulcharts.com/collections/religion/products/timeline-of-the-bible Chapters: 00:00:00 Torah 00:16:00 Prophets 00:38:32 Writings 01:00:43 Apocrypha 01:27:03 Gospels 01:48:17 Epistles 02:02:48 Revelation Introduction to the Qur'an: https://youtu.be/-SGzYrGz
From playlist Best of UsefulCharts
DEFCON 19: An Insider's Look at International Cyber Security Threats and Trends
Speaker: Rick Howard Verisign iDefense General Manager Verisign iDefense General Manager, Rick Howard, will provide an inside look into current cyber security trends with regard to Cyber War, Cyber Hacktivism, and Cyber Espionage. In this presentation Rick will discuss the current capabil
From playlist DEFCON 19
Thermodynamics of Information by Juan MR Parrondo (Lecture 1)
26 December 2016 to 07 January 2017 VENUE: Madhava Lecture Hall, ICTS Bangalore Information theory and computational complexity have emerged as central concepts in the study of biological and physical systems, in both the classical and quantum realm. The low-energy landscape of classical
From playlist US-India Advanced Studies Institute: Classical and Quantum Information
Physical Science 7.3f - Scientific Revolution
An introduction to two important revolutionary periods in the history of science. 1) The transition from an Aristotelian worldview to a Newtonian worldview, and 2) the supplanting of Newtonian physics by Modern Physics. From the Physical Science class by Derek Owens. The distance learni
From playlist Physical Science - Atoms