Floating point

Base-65536 floating point

No description. (Wikipedia).

Video thumbnail

Chapter 01.05: Lesson: IEEE-754 Single Precision Representation: Part 2 of 2

Learn how the IEEE-754 standard represents a floating point in single precision. For more videos and resources on this topic, please visit http://nm.mathforcollege.com/topics/floatingpoint_representation.html

From playlist Scientific Computing

Video thumbnail

Binary 4 – Floating Point Binary Fractions 1

This is the fourth in a series of videos about the binary number system which is fundamental to the operation of a digital electronic computer. In particular, this video covers the representation of real numbers using floating point binary notation. It begins with a description of standard

From playlist Binary

Video thumbnail

Convert a Base-10 Number to a Decimal to Base-60

This video explains how to convert a base ten number to a different base. http://mathispower4u.com

From playlist Historical Counting Systems

Video thumbnail

Convert a Base-60 Number to Base-10 with a Decimal

This video explains how to convert a base sixty number to base ten with a decimal. http://mathispower4u.com

From playlist Historical Counting Systems

Video thumbnail

1,010,010,101,000,011 - #MegaFavNumbers

This is my submission to the #megafavnumbers project. My number is 1010010101000011, which is prime in bases 2, 3, 4, 5, 6 and 10. I've open-sourced my code: https://bitbucket.org/Bip901/multibase-primes Clarification: by "ignoring 1" I mean ignoring base 1, since this number cannot be fo

From playlist MegaFavNumbers

Video thumbnail

Go to https://www.youtube.com/watch?v=ICJ5dtBUc1M for replacement. Floating Pt Repre Ex Pt 1 of 2.

Learn via example how to represent a number in floating point. For more videos and resources on this topic, please visit http://nm.mathforcollege.com/topics/floatingpoint_representation.html

From playlist Scientific Computing

Video thumbnail

Floating Point Numbers (Part1: Fp vs Fixed) - Computerphile

How much does a floating point processor improve floating point operations? Dr Bagley installed one to find out - and explains how computers store the bits. https://www.facebook.com/computerphile https://twitter.com/computer_phile This video was filmed and edited by Sean Riley. Compute

From playlist Software Development Lectures

Video thumbnail

MegaFavNumbers - A number with 19729 digits

This video is about my MegaFavNumber. It has 19729 digits, and it is a power of two. [This link is now broken, and I can't find it anywhere else. :( ] See all the digits here: https://sites.google.com/site/largenumbers/home/appendix/a/numbers/265536 The OEIS sequence I mentioned: https:/

From playlist MegaFavNumbers

Video thumbnail

#MegaFavNumbers : 1331952 - How walking in place for hours popularized a community

ok this turned out worse than I thought but whatever. A few hundred subtitles and a good description and it should work. Today I learned that recording a 15 minute scripted video in one go, without preparing visuals, and without having a good microphone, is not only stressful but also seve

From playlist MegaFavNumbers

Video thumbnail

0.1 + 0.2 is NOT 0.3 in Most Programming Languages

All about floating-point errors. Try Anvil: https://anvil.works/mcoding Most programming languages use a shared standard (IEEE 754 floating point numbers) for how to represent floating point numbers like 0.1. In this video, we see how these floats are represented and how this can cause un

From playlist How Python Works

Video thumbnail

IEEE 754 Standard for Floating Point Binary Arithmetic

This computer science video describes the IEEE 754 standard for floating point binary. The layouts of single precision, double precision and quadruple precision floating point binary numbers are described, including the sign bit, the biased exponent and the mantissa. Examples of how to con

From playlist Binary

Video thumbnail

Digital Sampling, Signal Spectra and Bandwidth - A Level Physics

An A Level Physics revision video covering Digital Sampling, Signal Spectra and Bandwidth

From playlist A Level Physics Revision

Video thumbnail

1,114,112 and Unicode: My #MegaFavNumber

Here's something a little bit different on my channel. It's math! Or, like, computer science or something because my chosen number is actually not very math-y at all. But it's definitely a change of pace from my recent Fire Emblem/music-y videos that I've been doing. Here's the playlist o

From playlist MegaFavNumbers

Video thumbnail

4. Assembly Language & Computer Architecture

MIT 6.172 Performance Engineering of Software Systems, Fall 2018 Instructor: Charles Leiserson View the complete course: https://ocw.mit.edu/6-172F18 YouTube Playlist: https://www.youtube.com/playlist?list=PLUl4u3cNGP63VIBQVWguXxZZi0566y7Wf Prof. Leiserson walks through the stages of code

From playlist MIT 6.172 Performance Engineering of Software Systems, Fall 2018

Video thumbnail

Binary 7 – Floating Point Binary Addition

This is the seventh in a series of videos about the binary number system which is fundamental to the operation of a digital electronic computer. In particular, this video covers adding together floating point binary numbers for a given sized mantissa and exponent, both in two’s complement.

From playlist Binary

Video thumbnail

Lecture 12: Square Roots, Newton's Method

MIT 6.006 Introduction to Algorithms, Fall 2011 View the complete course: http://ocw.mit.edu/6-006F11 Instructor: Srini Devadas License: Creative Commons BY-NC-SA More information at http://ocw.mit.edu/terms More courses at http://ocw.mit.edu

From playlist MIT 6.006 Introduction to Algorithms, Fall 2011

Video thumbnail

Linux Sysadmin Basics -- LXC 5: Unprivileged Containers

A tutorial demonstrating Stephane Graber's instructions on getting an unprivileged LXC container running on Ubuntu 14.04. See his fantastic blog post series here: https://www.stgraber.org/2013/12/20/lxc-1-0-blog-post-series/ Commands: sudo apt-get install lxc uidmap ## check yo shiznit

From playlist LXC -- Linux Containers

Video thumbnail

ASCII and Unicode Character Sets

This video describes the fundamental principles of character sets, character encoding, ASCII and Unicode. In particular, it covers the limitations of ASCII and the plethora of extended ASCII code pages. It also covers the design goals of Unicode, and describes the way control bits are al

From playlist GCSE Computer Science

Video thumbnail

Convert a Base-10 Number to Base-60

This video explains how to convert a base ten number to a different base. http://mathispower4u.com

From playlist Historical Counting Systems

Related pages

Floating-point arithmetic