Samsung Aims to Elevate Mobile AI with High-Bandwidth Memory Chips
Article / iPhone

Samsung Aims to Elevate Mobile AI with High-Bandwidth Memory Chips

Samsung is developing high-bandwidth memory (HBM) for smartphones and tablets to enhance on-device AI capabilities, using advanced packaging techniques.

Recent reports indicate that Samsung is poised to transform mobile devices by incorporating high-bandwidth memory (HBM) chips into smartphones and tablets. This change could greatly improve the on-device AI capabilities of these gadgets, enabling them to manage more complex tasks with greater efficiency. With the demand for mobile computing power on the rise, Samsung's initiatives arrive at a pivotal moment, especially as profits increase amid ongoing market shortages.

Advancements in Memory Technology

Historically, mobile devices have depended on conventional DRAM, which uses copper wire bonding that limits input/output (I/O) terminals to typically between 128 and 256. These constraints result in significant signal loss, impacting both efficiency and heat generation. Samsung's new strategy seeks to overcome these challenges by using ultra-high aspect ratio copper pillars along with Fan-Out Wafer Level Packaging (FOWLP), a method previously applied in its Exynos 2600 system-on-chip (SoC).

By adopting FOWLP, Samsung can improve heat resistance and enhance performance during sustained workloads. This technology is essential for maximizing the potential of HBM in mobile devices, which must adhere to strict size and power limits.

Vertical Copper Post Stack Configuration

Samsung's innovative Vertical Copper Post Stack (VCS) configuration enables the stacking of DRAM dies in a new 'staircase' arrangement, with copper pillars filling the gaps. This development has drastically increased the aspect ratio of the copper pillars from 3-5:1 to an impressive 15:1-20:1. This enhancement aims to elevate data bandwidth, allowing devices to process information at remarkable speeds.

Nonetheless, challenges remain. If the diameter of the copper pillars drops below 10 micrometers, the structural integrity may be compromised, resulting in potential bending or breakage. Here, FOWLP is crucial, extending the copper wiring outward to strengthen the structure and increase the number of I/O terminals. This combination is projected to deliver a 30% boost in bandwidth, which could revolutionize the capabilities of future mobile devices.

Market Implications

While Samsung is advancing this technology, the timeline for mobile-based HBM remains unclear. Nevertheless, the potential impact on the smartphone and tablet markets is substantial. By integrating HBM into devices, Samsung could establish a new benchmark for mobile computing, particularly in artificial intelligence. This innovation could empower smartphones and tablets to undertake tasks that were once the domain of high-performance desktops or servers.

The competitive field is intensifying, with competitors like Apple and Google also advancing mobile AI. As these companies strive to enhance their devices, Samsung's emphasis on HBM could offer a significant advantage, especially as consumers increasingly seek higher performance and smarter features in their mobile devices.

Samsung's progress in HBM technology could usher in a new era of mobile computing, positioning the company as a leader in integrating artificial intelligence into everyday devices. As development continues, the tech community will closely monitor how these advancements translate into consumer products.

Quick answers

How does this compare to existing mobile DRAM?

Samsung's HBM will significantly increase bandwidth and efficiency compared to traditional DRAM, which is limited by I/O terminals.

When can we expect devices with this technology?

The exact timeline for the release of mobile devices featuring HBM is still unclear as Samsung continues its development.

What advantages does Fan-Out Wafer Level Packaging provide?

FOWLP enhances structural integrity and increases the number of I/O terminals, contributing to improved performance.

About the author

MJI Desk

MJI Desk covers consumer tech for MJI News.