Heterogeneous Computing
What is it?
Traditionally, heterogeneous computing refers to a system that uses more than one type of computing cores, such as CPU, GPU, DPU, VPU, FPGA, or ASIC. By assigning different workloads to specialized processors suited for diverse purposes, performance and energy efficiency can be vastly improved. The different elements are interconnected via high-throughput, low-latency channels so they can operate as a single unit.
In recent years, the definition of heterogeneous computing has expanded to encompass processors based on different computer architectures. For example, processors based on the Arm architecture may be a better choice for some tasks, due to their higher number of cores, better power-efficiency, and compatibility with Arm-based mobile devices. The adoption of an alternative architecture may reveal smarter ways to handle existing workloads and computing tasks.
In recent years, the definition of heterogeneous computing has expanded to encompass processors based on different computer architectures. For example, processors based on the Arm architecture may be a better choice for some tasks, due to their higher number of cores, better power-efficiency, and compatibility with Arm-based mobile devices. The adoption of an alternative architecture may reveal smarter ways to handle existing workloads and computing tasks.
Why do you need it?
If you are using coprocessors besides CPUs in your server solutions, such as GPUs or DPUs, then you are already reaping the benefits of heterogeneous computing. Coprocessors can greatly accelerate computing speed and reduce the time it takes to complete a task. Especially in the development of artificial intelligence through machine vision and deep learning, which requires the server to process a vast amount of data converted to graphical form, the use of GPUs that operate at lower frequencies but have more cores than traditional CPUs is vital.
By the same logic, installing processors based on an entirely different architecture may be another way to realize the full potential of heterogeneous computing. In recent years, the trend has been to explore alternatives to the conventional x86 architecture, such as Arm processors. Industry experts are looking for ways to unleash the potential of these new products and develop new computing solutions. If your current configuration of processors and coprocessors is performing below expectations, it may be that heterogeneous computing based on a different architecture will have a better chance of fulfilling your needs.
By the same logic, installing processors based on an entirely different architecture may be another way to realize the full potential of heterogeneous computing. In recent years, the trend has been to explore alternatives to the conventional x86 architecture, such as Arm processors. Industry experts are looking for ways to unleash the potential of these new products and develop new computing solutions. If your current configuration of processors and coprocessors is performing below expectations, it may be that heterogeneous computing based on a different architecture will have a better chance of fulfilling your needs.
How is GIGABYTE helpful?
Nearly all of GIGABYTE's server solutions support the conventional sense of heterogeneous computing, where CPUs are paired with coprocessors such as GPGPUs to handle workloads related to parallel computing, machine learning, etc. Whether the main processor is the latest Intel® Xeon® Scalable processors or AMD EPYC™ processors, they can transfer data to peripheral devices such as graphics cards, storage devices, and high-speed network cards with PCIe Gen 4.0, which has a maximum bandwidth of 64GB/s and is twice as fast as PCIe Gen 3.0.
What's more, GIGABYTE has worked for many years with Arm-based systems. GIGABYTE offers a full range of servers designed for Ampere® Altra® processors, based on the Arm architecture. These products are highly recommended for high performance computing (HPC), cloud computing, and edge computing because they can address diverse deployment scenarios with scalability and flexibility. NVIDIA® has also unveiled the NVIDIA® Arm HPC Developer Kit, which includes an Ampere® Altra® processor, two NVIDIA® A100 Tensor Core GPUs, and two NVIDIA® BlueField®-2 DPUs, all contained inside a G242 server by GIGABYTE. This shining example of heterogeneous computing will pave the way for industry leaders to find new ways of tackling computing workloads with tools suited to the task.
Free Download:
《How to Build Your Data Center with GIGABYTE? A Free Downloadable Tech Guide》
What's more, GIGABYTE has worked for many years with Arm-based systems. GIGABYTE offers a full range of servers designed for Ampere® Altra® processors, based on the Arm architecture. These products are highly recommended for high performance computing (HPC), cloud computing, and edge computing because they can address diverse deployment scenarios with scalability and flexibility. NVIDIA® has also unveiled the NVIDIA® Arm HPC Developer Kit, which includes an Ampere® Altra® processor, two NVIDIA® A100 Tensor Core GPUs, and two NVIDIA® BlueField®-2 DPUs, all contained inside a G242 server by GIGABYTE. This shining example of heterogeneous computing will pave the way for industry leaders to find new ways of tackling computing workloads with tools suited to the task.
Free Download:
《How to Build Your Data Center with GIGABYTE? A Free Downloadable Tech Guide》
WE RECOMMEND
RELATED ARTICLES
AI & AIoT
How to Benefit from AI In the Healthcare & Medical Industry
If you work in healthcare and medicine, take some minutes to browse our in-depth analysis on how artificial intelligence has brought new opportunities to this sector, and what tools you can use to benefit from them. This article is part of GIGABYTE Technology’s ongoing “Power of AI” series, which examines the latest AI trends and elaborates on how industry leaders can come out on top of this invigorating paradigm shift.
Tech Guide
How to Pick the Right Server for AI? Part One: CPU & GPU
With the advent of generative AI and other practical applications of artificial intelligence, the procurement of “AI servers” has become a priority for industries ranging from automotive to healthcare, and for academic and public institutions alike. In GIGABYTE Technology’s latest Tech Guide, we take you step by step through the eight key components of an AI server, starting with the two most important building blocks: CPU and GPU. Picking the right processors will jumpstart your supercomputing platform and expedite your AI-related computing workloads.
AI & AIoT
10 Frequently Asked Questions about Artificial Intelligence
Artificial intelligence. The world is abuzz with its name, yet how much do you know about this exciting new trend that is reshaping our world and history? Fret not, friends; GIGABYTE Technology has got you covered. Here is what you need to know about the ins and outs of AI, presented in 10 bite-sized Q and A’s that are fast to read and easy to digest!
AI & AIoT
How to Benefit from AI in the Automotive & Transportation Industry
If you work in the automotive and transportation industry, spend a few minutes to read our in-depth analysis of how artificial intelligence has created new opportunities in this sector, and what tools you can use to get ahead. This article is part of GIGABYTE Technology’s ongoing “Power of AI” series, which examines the latest AI-related trends, and how intrepid visionaries can reap the benefits of this exciting paradigm shift.
Success Case
Researching Cellular Aging Mechanisms at Rey Juan Carlos University
The speed, the precision, the vast amount of data need a computing cluster. Researchers Sergio Muñoz and Luis Bote at Rey Juan Carlos University worked with SIE and GIGABYTE to create a cluster composing of nodes: GPU, storage, compute, and head.
Success Case
GIGABYTE PILOT: The Autonomous-Driving Control Unit at the Heart of Taiwan’s First Self-Driving Bus
Developed by the Automotive Research Testing Center (ARTC), the WinBus is Taiwan’s first self-driving electric bus that has reached SAE Level 4 Driving Automation. GIGABYTE PILOT, GIGABYTE Technology’s Autonomous-Driving Control Unit (ADCU), is the AI Mobile Edge Computing Platform at the heart of the autonomous vehicle. It provides superb processing power to support the deployment of self-driving AI algorithms, versatile connectivity to act as the hub between onboard sensors and the vehicle control system, and a rugged and reliable design that is ready for long-term operations. GIGABYTE PILOT is the ideal choice for autonomous vehicles, vessels, heavy machinery, and autonomous mobile robots (AMRs).
Success Case
0 to 100 KPH in 3.3 Seconds! NTHU Builds Electric Formula Student Race Cars with GIGABYTE
Representing Hsinchu’s Tsing Hua University, NTHU Racing is one of Taiwan’s top Formula Student racing teams. In 2019, its electric formula student race car, the “TH04”, took second place in Formula SAE Japan. In August of 2022, its new and improved, 100% manufactured in Taiwan “TH06” raced for the gold in Formula Student Germany. Tsing Hua University built the “TH06” using GIGABYTE Technology’s W771-Z00 and W331-Z00 Tower Server/Workstation products. From finite element analysis (FEA) and computational fluid dynamics (CFD) modelling and analysis during the design phase, to racing simulations and experimenting with new tech during the testing phase, GIGABYTE servers provided NTHU Racing with the processing power and versatility it needed to engineer a high-performing electric vehicle that can go from 0 to 100 kph in 3.3 seconds—almost on par with Tesla’s Model S, which can go from 0 to 60 mph in 2.6 seconds.
Success Case
Japanese Telco Leader KDDI Invents Immersion Cooling Small Data Center with GIGABYTE
Japanese telco giant KDDI Corporation has invented a new class of data centers that are mobile and eco-friendly. These “container-type immersion cooling small data centers” employ “single-phase immersion cooling” to reduce power consumption by 43% and lower the PUE below 1.07. GIGABYTE Technology drew from its years of experience in the telco sector to provide the R282-Z93 and R182-Z91 Rack Servers for KDDI to use as the management and GPU computing nodes in the data center. KDDI benefits from the servers’ powerful 3rd Gen AMD EPYC™ CPUs, the scalable, high-density configuration of NVIDIA® GPUs in small form factors, and the servers’ optimized compatibility with the liquid-based data center cooling solution. GIGABYTE’s participation in KDDI’s project is in line with GIGABYTE’s long-term CSR and ESG efforts, which are focused on working with global industry leaders to “Upgrade Your Life” with high tech while building a greener, more sustainable environment for our future.
