| Page 99 | Kisaco Research

As the adoption of generative and agentic AI accelerates, the challenges for memory as a key enabler of AI/ML processing architectures continue to grow. Balancing the demands for ever greater bandwidth and capacity with the needs of power efficiency, thermal management and increased reliability is increasingly difficult. Continued advances in high performance HBM and GDDR memories, and mainstream DDR and LPDDR memories, remains a strategic industry imperative. In addition, a suite of new technologies including multiplexed modules (MRDIMM), CXL and processing in memory are needed to meet upcoming AI requirements. In this panel, we’ll discuss the evolution of memory technologies and the challenges the industry faces on the road ahead for future AI chips and systems.

 

Memory

Author:

Steven Woo

Fellow and Distinguished Inventor
Rambus

I was drawn to Rambus to focus on cutting edge computing technologies. Throughout my 15+ year career, I’ve helped invent, create and develop means of driving and extending performance in both hardware and software solutions. At Rambus, we are solving challenges that are completely new to the industry and occur as a response to deployments that are highly sophisticated and advanced.

As an inventor, I find myself approaching a challenge like a room filled with 100,000 pieces of a puzzle where it is my job to figure out how they all go together – without knowing what it is supposed to look like in the end. For me, the job of finishing the puzzle is as enjoyable as the actual process of coming up with a new, innovative solution.

For example, RDRAM®, our first mainstream memory architecture, implemented in hundreds of millions of consumer, computing and networking products from leading electronics companies including Cisco, Dell, Hitachi, HP, Intel, etc. We did a lot of novel things that required inventiveness – we pushed the envelope and created state of the art performance without making actual changes to the infrastructure.

I’m excited about the new opportunities as computing is becoming more and more pervasive in our everyday lives. With a world full of data, my job and my fellow inventors’ job will be to stay curious, maintain an inquisitive approach and create solutions that are technologically superior and that seamlessly intertwine with our daily lives.

After an inspiring work day at Rambus, I enjoy spending time with my family, being outdoors, swimming, and reading.

Education

  • Ph.D., Electrical Engineering, Stanford University
  • M.S. Electrical Engineering, Stanford University
  • Master of Engineering, Harvey Mudd College
  • B.S. Engineering, Harvey Mudd College

... read more

Steven Woo

Fellow and Distinguished Inventor
Rambus

I was drawn to Rambus to focus on cutting edge computing technologies. Throughout my 15+ year career, I’ve helped invent, create and develop means of driving and extending performance in both hardware and software solutions. At Rambus, we are solving challenges that are completely new to the industry and occur as a response to deployments that are highly sophisticated and advanced.

As an inventor, I find myself approaching a challenge like a room filled with 100,000 pieces of a puzzle where it is my job to figure out how they all go together – without knowing what it is supposed to look like in the end. For me, the job of finishing the puzzle is as enjoyable as the actual process of coming up with a new, innovative solution.

For example, RDRAM®, our first mainstream memory architecture, implemented in hundreds of millions of consumer, computing and networking products from leading electronics companies including Cisco, Dell, Hitachi, HP, Intel, etc. We did a lot of novel things that required inventiveness – we pushed the envelope and created state of the art performance without making actual changes to the infrastructure.

I’m excited about the new opportunities as computing is becoming more and more pervasive in our everyday lives. With a world full of data, my job and my fellow inventors’ job will be to stay curious, maintain an inquisitive approach and create solutions that are technologically superior and that seamlessly intertwine with our daily lives.

After an inspiring work day at Rambus, I enjoy spending time with my family, being outdoors, swimming, and reading.

Education

  • Ph.D., Electrical Engineering, Stanford University
  • M.S. Electrical Engineering, Stanford University
  • Master of Engineering, Harvey Mudd College
  • B.S. Engineering, Harvey Mudd College

Author:

Taeksang Song

CVP
Samsung Electronics

Taeksang is a Corporate VP at Samsung Electronics where he is leading a team dedicated to pioneering cutting-edge technologies including CAMM, MRDIMM, CXL memory expander, fabric attached memory solution and processing near memory to meet the evolving demands of next-generation data-centric AI architecture. He has 20 years' professional experience in memory and sub-system architecture, interconnect protocols, system-on-chip design and collaborating with CSPs to enable heterogeneous computing infrastructure. Prior to joining Samsung Electronics, he worked at Rambus Inc., Micron Technology and SK hynix in lead architect roles for the emerging memory controllers and systems. 

Taeksang received his Ph.D. degree from KAIST, South Korea, in 2006. Dr. Song has authored and co-authored over 20 technical papers and holds over 50 U.S. patents.

 

... read more

Taeksang Song

CVP
Samsung Electronics

Taeksang is a Corporate VP at Samsung Electronics where he is leading a team dedicated to pioneering cutting-edge technologies including CAMM, MRDIMM, CXL memory expander, fabric attached memory solution and processing near memory to meet the evolving demands of next-generation data-centric AI architecture. He has 20 years' professional experience in memory and sub-system architecture, interconnect protocols, system-on-chip design and collaborating with CSPs to enable heterogeneous computing infrastructure. Prior to joining Samsung Electronics, he worked at Rambus Inc., Micron Technology and SK hynix in lead architect roles for the emerging memory controllers and systems. 

Taeksang received his Ph.D. degree from KAIST, South Korea, in 2006. Dr. Song has authored and co-authored over 20 technical papers and holds over 50 U.S. patents.

 

Author:

Shreya Singhal

Generative AI Research & Development
Aristocrat Gaming

Shreya Singhal works in Generative AI Research & Development at Aristocrat Gaming and is a Graduate Research Assistant at the University of Texas at Austin. Her work spans large language models (LLMs), reinforcement learning, and optimization for scalable and interpretable AI systems.

 

Shreya has hands-on experience fine-tuning open-source models like Gemma 2B for under-resourced languages, deploying compressed generative models in low-resource environments, and implementing bias and fairness evaluation pipelines using interpretable subspace analysis. She has previously worked at Dell Technologies, Charles Schwab, Deloitte, and Accenture, contributing to AI-powered solutions across gaming, finance, and enterprise automation.

 

Her current research focuses on efficient LLM training and evaluation pipelines, fairness-aware model design, and bringing generative AI to edge and enterprise use cases. She is passionate about making AI more inclusive, scalable, and grounded in real-world constraints.

 

... read more

Shreya Singhal

Generative AI Research & Development
Aristocrat Gaming

Shreya Singhal works in Generative AI Research & Development at Aristocrat Gaming and is a Graduate Research Assistant at the University of Texas at Austin. Her work spans large language models (LLMs), reinforcement learning, and optimization for scalable and interpretable AI systems.

 

Shreya has hands-on experience fine-tuning open-source models like Gemma 2B for under-resourced languages, deploying compressed generative models in low-resource environments, and implementing bias and fairness evaluation pipelines using interpretable subspace analysis. She has previously worked at Dell Technologies, Charles Schwab, Deloitte, and Accenture, contributing to AI-powered solutions across gaming, finance, and enterprise automation.

 

Her current research focuses on efficient LLM training and evaluation pipelines, fairness-aware model design, and bringing generative AI to edge and enterprise use cases. She is passionate about making AI more inclusive, scalable, and grounded in real-world constraints.

 

Software Infra

Author:

Aswini Atibudhi

Distinguished Architect
Walmart

Aswini is a Distinguished Architect at Walmart Global Tech, with over 22 years of IT experience in designing scalable AI/ML, micro frontend, microservices, and cloud applications. His professional expertise encompasses diverse domains including  e-commerce, finance, telecom and healthcare meticulously developed through his tenure at Walmart, Cisco, Equinix, Finastra, and TCS. Over seven years at Walmart, he has been a founding member of critical platforms like Last Mile Delivery, Fleet Management, MerchOne, Supplier Portal and several others. As a recognized expert in generative AI, Aswini specializes in leveraging machine learning and large language models to create transformative digital experiences, including personalized content generation and AI-driven customer engagement.

He has received numerous awards including Walmart’s Innovation Award, Equinix’s Top Performer Award, and Cisco’s Group Race Award. With many certifications in AI, machine learning, and cloud technologies, he stays at the forefront of innovation. Known for his strategic insights, Aswini has a proven ability to deliver transformative AI solutions across industries. 

... read more

Aswini Atibudhi

Distinguished Architect
Walmart

Aswini is a Distinguished Architect at Walmart Global Tech, with over 22 years of IT experience in designing scalable AI/ML, micro frontend, microservices, and cloud applications. His professional expertise encompasses diverse domains including  e-commerce, finance, telecom and healthcare meticulously developed through his tenure at Walmart, Cisco, Equinix, Finastra, and TCS. Over seven years at Walmart, he has been a founding member of critical platforms like Last Mile Delivery, Fleet Management, MerchOne, Supplier Portal and several others. As a recognized expert in generative AI, Aswini specializes in leveraging machine learning and large language models to create transformative digital experiences, including personalized content generation and AI-driven customer engagement.

He has received numerous awards including Walmart’s Innovation Award, Equinix’s Top Performer Award, and Cisco’s Group Race Award. With many certifications in AI, machine learning, and cloud technologies, he stays at the forefront of innovation. Known for his strategic insights, Aswini has a proven ability to deliver transformative AI solutions across industries. 

Software Infra
Systems Optimization
Memory

Author:

Puneet Kumar

CEO
Rivos

Puneet Kumar, CEO and co-founder of Rivos Inc., which he established in May 2021. His impressive career includes leading the ChromeOS Platform Engineering team at Google as a Senior Director, where he oversaw the program's growth to over 100 million users. Puneet's entrepreneurial journey includes co-founding Agnilux (acquired by Google), where he served as VP of Engineering, and PASemi Inc. (acquired by Apple), where he was an Engineering Director in the Platform Architecture team. He also held senior leadership positions at SiByte Inc. (acquired by Broadcom) and was a Systems Researcher at Digital Equipment Corporation's Systems Research Center. Puneet holds a PhD in Computer Science from Carnegie Mellon University.

... read more

Puneet Kumar

CEO
Rivos

Puneet Kumar, CEO and co-founder of Rivos Inc., which he established in May 2021. His impressive career includes leading the ChromeOS Platform Engineering team at Google as a Senior Director, where he oversaw the program's growth to over 100 million users. Puneet's entrepreneurial journey includes co-founding Agnilux (acquired by Google), where he served as VP of Engineering, and PASemi Inc. (acquired by Apple), where he was an Engineering Director in the Platform Architecture team. He also held senior leadership positions at SiByte Inc. (acquired by Broadcom) and was a Systems Researcher at Digital Equipment Corporation's Systems Research Center. Puneet holds a PhD in Computer Science from Carnegie Mellon University.

Software Infra

Author:

Ankur Mehrotra

GM, SageMaker AI
AWS

Ankur Mehrotra is a GM at AWS Machine Learning and leads foundational SageMaker AI services such as SageMaker Studio, Notebooks, Training, Inference, Feature Store, MLOps, etc. Before SageMaker AI, he led AI services for personalization, forecasting, healthcare & life sciences, edge AI devices and SDKs, as well as thought leadership programs such as AWS DeepRacer. Ankur has worked at Amazon for over 15 years. Before joining AWS, he spent several years in Amazon’s Consumer organization, where he led the development of automated marketing/advertising systems, as well as automated pricing systems.

... read more

Ankur Mehrotra

GM, SageMaker AI
AWS

Ankur Mehrotra is a GM at AWS Machine Learning and leads foundational SageMaker AI services such as SageMaker Studio, Notebooks, Training, Inference, Feature Store, MLOps, etc. Before SageMaker AI, he led AI services for personalization, forecasting, healthcare & life sciences, edge AI devices and SDKs, as well as thought leadership programs such as AWS DeepRacer. Ankur has worked at Amazon for over 15 years. Before joining AWS, he spent several years in Amazon’s Consumer organization, where he led the development of automated marketing/advertising systems, as well as automated pricing systems.

Systems Optimization

Author:

Haseeb Budhani

Co-Founder & CEO
Rafay Systems

Haseeb Budhani is the CEO and co-founder of Rafay Systems. He previously co-founded and led Soha Systems, which was acquired by Akamai Technologies, where he later served as Vice President of Enterprise Strategy. Haseeb has also held executive and leadership roles at Infineta Systems, NET, and several other technology companies. He holds an MBA from UC Berkeley’s Haas School of Business and a B.S. in Computer Science from the University of Southern California.

... read more

Haseeb Budhani

Co-Founder & CEO
Rafay Systems

Haseeb Budhani is the CEO and co-founder of Rafay Systems. He previously co-founded and led Soha Systems, which was acquired by Akamai Technologies, where he later served as Vice President of Enterprise Strategy. Haseeb has also held executive and leadership roles at Infineta Systems, NET, and several other technology companies. He holds an MBA from UC Berkeley’s Haas School of Business and a B.S. in Computer Science from the University of Southern California.