| Page 1228 | Kisaco Research

Cerebras Systems builds the fastest AI accelerators in the industry. In this talk we will review how the size and scope of massive natural language processing (NLP) presents fundamental challenges to legacy compute and to traditional cloud providers. We will explore the importance of guaranteed node to node latency in large clusters, how that can’t be achieved in the cloud, and how it prevents linear and even deterministic scaling. We will examine the complexity of distributing NLP models over hundreds or thousands of GPUs and show how quickly and easily a cluster of Cerebras CS-2s is set up, and how linear scaling can be achieved over millions of compute cores with Cerebras technology. And finally, we will show how innovative customers are using clusters of Cerebras CS-2s to train large language models in order to solve both basic and applied scientific challenges, including understanding the COVID-19 replication mechanism, epigenetic language modelling for drug discovery, and in the development of clean energy. This enables researchers to test ideas that may otherwise languish for lack of resources and, ultimately, reduces the cost of curiosity.  ​

 

Chip Design
Enterprise AI
ML at Scale
Novel AI Hardware
Systems Design
Data Science
Hardware Engineering
Software Engineering
Strategy
Systems Engineering

Author:

Andy Hock

VP, Product Management
Cerebras

Dr. Andy Hock is VP of Product Management at Cerebras Systems with responsibility for product strategy. His organization drives engagement with engineering and our customers to inform the hardware, software, and machine learning technical requirements and accelerate world-leading AI with Cerebras’ products. Prior to Cerebras, Andy has held senior leadership positions with Arete Associates, Skybox Imaging (acquired by Google), and Google. He holds a PhD in Geophysics and Space Physics from UCLA.

Andy Hock

VP, Product Management
Cerebras

Dr. Andy Hock is VP of Product Management at Cerebras Systems with responsibility for product strategy. His organization drives engagement with engineering and our customers to inform the hardware, software, and machine learning technical requirements and accelerate world-leading AI with Cerebras’ products. Prior to Cerebras, Andy has held senior leadership positions with Arete Associates, Skybox Imaging (acquired by Google), and Google. He holds a PhD in Geophysics and Space Physics from UCLA.

 

Stefania Avanzini

OP2B Director
World Business Council for Sustainable Development

Stefania is impact-driven and passionate about collective transformations. As Director of One Planet Business for Biodvisersity, she is working to scale the adoption of regenerative agriculture globally through the organization’s cross-sectoral membership that spans the agricultural value chain from production to distribution. Prior to her work at OP2B, Stefania worked for Danone’s investment fund for social business, and for Ashoka – the world’s largest network of social entrepreneurs.

Stefania Avanzini

OP2B Director
World Business Council for Sustainable Development

Stefania Avanzini

OP2B Director
World Business Council for Sustainable Development

Stefania is impact-driven and passionate about collective transformations. As Director of One Planet Business for Biodvisersity, she is working to scale the adoption of regenerative agriculture globally through the organization’s cross-sectoral membership that spans the agricultural value chain from production to distribution. Prior to her work at OP2B, Stefania worked for Danone’s investment fund for social business, and for Ashoka – the world’s largest network of social entrepreneurs. Stefania believes in the power of business to transform agricultural systems in a way that is beneficial for people, climate, and nature.

 

Anthony Wood

Formal Verification Lead
Graphcore

Anthony has held a number of a design and verification roles working on CPUs, GPUs and IPUs at Infineon, Xmos, Imagination and Graphcore.  At Imagination he was head of verification for the high-end GPU cores.  At Graphcore his responsibilities include leveraging formal verification techniques throughout the silicon team; reducing delivery timescales through Continuous Delivery; and working to ensure verification disciplines are adopted for DFT.  He strives to find ways of improving the productivity of silicon engineers and of co

Anthony Wood

Formal Verification Lead
Graphcore

Anthony Wood

Formal Verification Lead
Graphcore

Anthony has held a number of a design and verification roles working on CPUs, GPUs and IPUs at Infineon, Xmos, Imagination and Graphcore.  At Imagination he was head of verification for the high-end GPU cores.  At Graphcore his responsibilities include leveraging formal verification techniques throughout the silicon team; reducing delivery timescales through Continuous Delivery; and working to ensure verification disciplines are adopted for DFT.  He strives to find ways of improving the productivity of silicon engineers and of course he agonises about potential verification holes.

 

Manish Pandey

Fellow & VP, R&D
Synopsys

Manish Pandey is Vice President R&D and Fellow at Synopsys, and an Adjunct Professor at Carnegie Mellon University. He completed his PhD in Computer Science from Carnegie Mellon University and a B. Tech. in Computer Science from the Indian Institute of Technology Kharagpur. He currently leads the R&D teams for formal and static technologies, and machine learning at Synopsys. He previously led the development of several static and formal verification technologies at Verplex and Cadence which are in widespread use in the industry.

Manish Pandey

Fellow & VP, R&D
Synopsys

Manish Pandey

Fellow & VP, R&D
Synopsys

Manish Pandey is Vice President R&D and Fellow at Synopsys, and an Adjunct Professor at Carnegie Mellon University. He completed his PhD in Computer Science from Carnegie Mellon University and a B. Tech. in Computer Science from the Indian Institute of Technology Kharagpur. He currently leads the R&D teams for formal and static technologies, and machine learning at Synopsys. He previously led the development of several static and formal verification technologies at Verplex and Cadence which are in widespread use in the industry. Manish has been the recipient of the IEEE Transaction in CAD Outstanding Young author award and holds over two dozen patents and refereed publications.

 

Jian Zhang

Director, Machine Learning
SambaNova Systems

Jian Zhang

Director, Machine Learning
SambaNova Systems

Jian Zhang

Director, Machine Learning
SambaNova Systems
 

Sriraman Chari

Fellow & Head of AI Accelerator IP Solution
Cadence Design Systems

Sriraman Chari

Fellow & Head of AI Accelerator IP Solution
Cadence Design Systems

Sriraman Chari

Fellow & Head of AI Accelerator IP Solution
Cadence Design Systems
 

Phil Brown

VP, Scaled Systems Product
Graphcore

Phil leads Graphcore’s efforts to build large scale AI/ML processing capability using Graphcore unique Intelligence Processing Units (IPUs) and IPU-Fabric and Streaming Memory technology. Previously he has held a number of different roles at Graphcore including Director of Applications, leading development of Graphcore’s flagship AL/ML models, and Director of Field Engineering, which acts as the focal point for technical engagements with our customers. Prior to joining Graphcore, Phil worked for Cray Inc.

Phil Brown

VP, Scaled Systems Product
Graphcore

Phil Brown

VP, Scaled Systems Product
Graphcore

Phil leads Graphcore’s efforts to build large scale AI/ML processing capability using Graphcore unique Intelligence Processing Units (IPUs) and IPU-Fabric and Streaming Memory technology. Previously he has held a number of different roles at Graphcore including Director of Applications, leading development of Graphcore’s flagship AL/ML models, and Director of Field Engineering, which acts as the focal point for technical engagements with our customers. Prior to joining Graphcore, Phil worked for Cray Inc. in a number of roles, including leading their engagement with the weather forecasting and climate research customers worldwide and as a technical architect. Phil holds a PhD in Computational Chemistry from the University of Bristol.

 

Sébastien Burgess

Senior Principal Solutions Architect
Jupiter Intelligence

Seb Burgess is a Senior Principal Solutions Architect focused on solution implementation and project management.

Mr. Burgess is a Senior Principal Solutions Architect focused on solution implementation and project management and a subject matter expert on physical risk screening exercises for capital-intensive infrastructure operators and EMEA-based financial services clients. 

Sébastien Burgess

Senior Principal Solutions Architect
Jupiter Intelligence

Sébastien Burgess

Senior Principal Solutions Architect
Jupiter Intelligence

Seb Burgess is a Senior Principal Solutions Architect focused on solution implementation and project management.

Mr. Burgess is a Senior Principal Solutions Architect focused on solution implementation and project management and a subject matter expert on physical risk screening exercises for capital-intensive infrastructure operators and EMEA-based financial services clients. 

Prior to joining Jupiter, Mr. Burgess worked at Urbint, a utility field risk management company where he led product roll-outs and adoption strategies for a number of major US-based utilities. Mr. Burgess also worked at Carto, a spatial analysis and location intelligence company.

Mr. Burgess started his career in Mexico City as an environmental planner where he also founded his own cartography and data visualization company.

Mr. Burgess has a B.S. in Conservation and Natural Resources Studies from the University of California, Berkeley.

 

https://www.linkedin.com/in/sebastienburgess/