Theory of computation

Parallel computation thesis

In computational complexity theory, the parallel computation thesis is a hypothesis which states that the time used by a (reasonable) parallel machine is polynomially related to the space used by a sequential machine. The parallel computation thesis was set forth by Chandra and Stockmeyer in 1976. In other words, for a computational model which allows computations to branch and run in parallel without bound, a formal language which is decidable under the model using no more than steps for inputs of length n is decidable by a non-branching machine using no more than units of storage for some constant k. Similarly, if a machine in the unbranching model decides a language using no more than storage, a machine in the parallel model can decide the language in no more than steps for some constant k. The parallel computation thesis is not a rigorous formal statement, as it does not clearly define what constitutes an acceptable parallel model. A parallel machine must be sufficiently powerful to emulate the sequential machine in time polynomially related to the sequential space; compare Turing machine, non-deterministic Turing machine, and alternating Turing machine. N. Blum (1983) introduced a model for which the thesis does not hold.However, the model allows parallel threads of computation after steps. (See Big O notation.) Parberry (1986) suggested a more "reasonable" bound would be or , in defense of the thesis.Goldschlager (1982) proposed a model which is sufficiently universal to emulate all "reasonable" parallel models, which adheres to the thesis.Chandra and Stockmeyer originally formalized and proved results related to the thesis for deterministic and alternating Turing machines, which is where the thesis originated. (Wikipedia).

Video thumbnail

How to use Parallel Computing in MATLAB

Parallel Computing Toobox™ lets you solve computationally and data-intensive problems using multicore processors, GPUs, clusters, and clouds. Parallel computing is ideal for problems such as parameter sweeps, optimizations, and Monte Carlo simulations. Perform parallel computing concepts u

From playlist “How To” with MATLAB and Simulink

Video thumbnail

Parallel Computing: Its Opportunities and Challenges

(March 30, 2009) Victor W. Lee

From playlist Engineering

Video thumbnail

6. TM Variants, Church-Turing Thesis

MIT 18.404J Theory of Computation, Fall 2020 Instructor: Michael Sipser View the complete course: https://ocw.mit.edu/18-404JF20 YouTube Playlist: https://www.youtube.com/playlist?list=PLUl4u3cNGP60_JNv2MmK3wkOt9syvfQWY Quickly reviewed last lecture. Showed that various TM variants are al

From playlist MIT 18.404J Theory of Computation, Fall 2020

Video thumbnail

Interview at CIRM: Martin Gander

Interview at CIRM Martin Gander (University of Genève) held the Jean-Morlet Chair at CIRM during the second semester of 2022, in collaboration with Florence Hubert (Aix-Marseille University, co-holder). His research focuses on application-oriented applied and computational mathematics. I

From playlist Jean-Morlet Chair - Gander/Hubert

Video thumbnail

Parallel Programming 2.0

November 7, 2007 lecture by Renee James and Wei Li for the Stanford University Computer Systems Colloquium (EE 380). Renee and her co-presenter touch upon Intel's processor direction for multi-core and then dive into its impact to software; parallel programming in the mainstream has differ

From playlist Lecture Collection | Computer Systems Laboratory Colloquium (2007-2008)

Video thumbnail

2019 Distinguished Alumnus - W. Dally - 5/18/2019

Distinguished Alumnus William Dally (PhD '86, Computer Science), Chief Scientist and Senior Vice President of Research, NVIDIA, and Professor of Computer Science and Electrical Engineering, Stanford University. The 82nd Annual Seminar Day was part of Caltech's Alumni Reunion Weekend held

From playlist Caltech Alumni Seminar Day

Video thumbnail

Factorization-based Sparse Solvers and Preconditions, Lecture 3

Xiaoye Sherry Li's (from Lawrence Berkeley National Laboratory) lecture number three on Factorization-based sparse solves and preconditioners

From playlist Gene Golub SIAM Summer School Videos

Video thumbnail

Gilles Dowek : Une deuxième révolution galiléenne?

Find this video and other talks given by worldwide mathematicians on CIRM's Audiovisual Mathematics Library: http://library.cirm-math.fr. And discover all its functionalities: - Chapter markers and keywords to watch the parts of your choice in the video - Videos enriched with abstracts, b

From playlist Mathematical Aspects of Computer Science

Video thumbnail

Genomic Analysis at Scale: Mapping Irregular Computations to Advanced Architectures

Abstract: Genomic data sets are growing dramatically as the cost of sequencing continues to decline and community databases are built to store and share this data with the research community. Some of data analysis problems require large scale parallel platforms to meet both the memory and

From playlist SIAG-ACDA Online Seminar Series

Video thumbnail

TEDxCaltech - Danny Hillis - Reminiscing about Richard Feynman

Danny Hillis is an inventor, scientist, author and engineer, and is chairman and co-founder of Applied Minds.  Previously, he was Vice President and Disney Fellow at Walt Disney Imagineering and was a co-founder of Thinking Machines Corp. Danny pioneered the concept of parallel computers t

From playlist TEDxCaltech - 1/14/11

Video thumbnail

Q&A August 2020

Topics: 00:00:00 Introduction 00:02:38 Your shell prompt? 00:02:56 Swift vs Rust? 00:03:31 Understanding difficult concepts 00:03:56 Is Rust too complex? 00:05:04 Dvorak and Colemak 00:05:26 GPT-3 00:07:10 Higher-ranked trait bounds 00:07:54 Protocol parsers 00:09:09 GPU programming 00:10:

From playlist Q&A

Video thumbnail

Ray Kurzweil: The Coming Singularity | Big Think

Ray Kurzweil: The Coming Singularity New videos DAILY: https://bigth.ink/youtube Join Big Think Edge for exclusive videos: https://bigth.ink/Edge ---------------------------------------------------------------------------------- By 2045, we’ll have expanded the intelligence of our human m

From playlist Ray Kurzweil | Big Think

Related pages

Big O notation | Alternating Turing machine | Computational model | Computational complexity theory | Formal language | Larry Stockmeyer | Turing machine