DPU

What is it?

Taken as a whole, the evolution of server technology and data center applications has revolved around finding new helpers for the central processing unit (CPU) to make computing faster. The most obvious example is the GPU, which was created to help render computer graphics; and by extension, the GPGPU, which came into existence when people realized the GPU could actually do more than render graphics. Through the synergies of heterogeneous computing and parallel computing, GPGPUs are now widely used to boost the CPUs' processing capabilities into the realms of high performance computing (HPC) and supercomputing.

The DPU, or data processing unit, is a more recent milestone in the actualization of this philosophy. Envisioned as the third pillar of the data center in addition to the CPU and the GPU, the DPU further helps out the CPU by taking over its networking and communication workloads. It uses hardware acceleration technology as well as high-performance network interfaces to excel at handling data transfers, data compression, data storage, data security, and data analytics. While these tasks have traditionally been carried out by the CPU, in a large-scale server farm or server room, delegating the tasks to DPUs can free up the CPUs for other workloads. This can make a huge difference in performance when working with data-intensive tasks, such as big data, artificial intelligence (AI), machine learning, and deep learning.

Free Download:《How to Build Your Data Center with GIGABYTE?

Why do you need it?

Introducing DPUs into your computing cluster can upgrade your performance, especially if you are working on large-scale projects that are pushing the envelope of data technology. A data center that uses DPUs to move data between the processors can expect to see faster computing, higher availability, better security, and greater shareability. Its proponents are confident that DPUs will be the linchpin of future cloud computing data centers, as more and more of the world's data is poured into the cloud.

How is GIGABYTE helpful?

One of the foremost DPU products on the market is NVIDIA's BlueField®-2 DPU, which is designed to offload critical networking, storage, and security tasks from the CPUs, enabling organizations to transform their IT infrastructure into state-of-the-art data centers that are accelerated, fully programmable, and armed with "zero-trust" security features to prevent data breaches and cyberattacks. GIGABYTE G242-P32, a G-Series GPU Server, is part of the Nvidia Arm HPC Developer Kit, an integrated hardware and software platform for HPC, AI, and scientific computing applications; the kit is outfitted with two NVIDIA® Bluefield®-2 DPUs. The Arm HPC Developer Kit has already been put to good use by customers across many different sectors; including the Graduate Institute of Networking and Multimedia at Taiwan University (NTU), which has developed an intelligent transportation system, called a "high-precision traffic flow model", to test autonomous vehicles and identify accident-prone road sections for immediate redress.

Recommended Reading

Setting the Record Straight: What is HPC? A Tech Guide by GIGABYTE
Article

Setting the Record Straight: What is HPC? A Tech Guide by GIGABYTE

The term HPC, which stands for high performance computing, gets thrown around a lot nowadays, as server solutions become more and more ubiquitous. It is running the risk of becoming a catchall phrase: anything that is “HPC” must be the right choice for your computing needs. You may be wondering: what exactly are the benefits of HPC, and is HPC right for you? GIGABYTE Technology, an industry leader in high-performance servers, presents this tech guide to help you understand what HPC means on both a theoretical and a practical level. In doing so, we hope to help you evaluate if HPC is right for you, while demonstrating what GIGABYTE has to offer in the field of HPC.
World AI Cannes Festival 2024: GIGABYTE Highlights Its GPU Server Portfolio for AI Supercomputing

World AI Cannes Festival 2024: GIGABYTE Highlights Its GPU Server Portfolio for AI Supercomputing

NTHU’s Student Team Won 2nd Place in the ISC 2024 Student Cluster Competition
Article

NTHU’s Student Team Won 2nd Place in the ISC 2024 Student Cluster Competition

A student team from National Tsing Hua University (NTHU), led by Professor Jerry Chou, secured second place in the ISC 2024 Student Cluster Competition. Leveraging GIGABYTE servers and high-performance computing (HPC) solutions,
GIGABYTE to Showcase at ISC High Performance 2024

GIGABYTE to Showcase at ISC High Performance 2024

Its New Service - GIGA POD - Offers a Scalable, Turnkey AI Supercomputing Solution
NCHC and Xanthus Elevate Taiwanese Animation on the World Stage with GIGABYTE Servers
Article

NCHC and Xanthus Elevate Taiwanese Animation on the World Stage with GIGABYTE Servers

Created by Greener Grass Production, the Taiwanese sci-fi mini-series “2049” made its debut on Netflix and various local TV channels. The animated spin-off “2049+ Voice of Rebirth”, crafted by Xanthus Animation Studio, premiered on the streaming service myVideo. The CGI show was created with the NCHC Render Farm’s GIGABYTE servers, which employ top-of-the-line NVIDIA® graphics cards to empower artists with industry-leading rendering capabilities. The servers can take on multiple workloads simultaneously through parallel computing, and they boast a wide range of patented smart features that ensure stability and availability. With all it has going for it, “2049+ Voice of Rebirth” may garner enough attention to become the breakout hit that will introduce Taiwanese animation to international audiences.
GIGABYTE’s ARM Server Boosts Development of Smart Traffic Solution by 200%
Article

GIGABYTE’s ARM Server Boosts Development of Smart Traffic Solution by 200%

A team of scientists at NTU has adopted GIGABYTE’s G242-P32 server and the Arm HPC Developer Kit to incubate a “high-precision traffic flow model”—a smart traffic solution that can be used to test autonomous vehicles and identify accident-prone road sections for immediate redress. The ARM-based solution gives the project a 200% boost in efficiency, thanks to the cloud-native processor architecture that “speaks” the same coding language as the roadside sensors, the high number of CPU cores that excel at parallel computing, the synergy with GPUs that enable heterogeneous computing, and the ISO certifications which make the resulting model easily deployable for automakers and government regulators alike.
CPU vs. GPU: What's the Difference and Which Do You Need
Article

CPU vs. GPU: What's the Difference and Which Do You Need

Besides the central processing unit (CPU), the graphics processing unit (GPU) is also an important part of a high-performing server. Do you know how a GPU works and how it is different from a CPU? Do you know the best way to make them work together to deliver unrivalled processing power? GIGABYTE Technology, an industry leader in server solutions that support the most advanced processors, is pleased to present our latest Tech Guide. We will explain the differences between CPUs and GPUs; we will also introduce GIGABYTE products that will help you inject GPU computing into your server rooms and data centers.
Researching Cellular Aging Mechanisms at Rey Juan Carlos University
Article

Researching Cellular Aging Mechanisms at Rey Juan Carlos University

The speed, the precision, the vast amount of data need a computing cluster. Researchers Sergio Muñoz and Luis Bote at Rey Juan Carlos University worked with SIE and GIGABYTE to create a cluster composing of nodes: GPU, storage, compute, and head.
OCP ORv3 Solution

OCP ORv3 Solution

The alternative of power-efficient server solutions.
NVIDIA Grace™ CPU Superchip & GH200 Grace Hopper Superchip

NVIDIA Grace™ CPU Superchip & GH200 Grace Hopper Superchip

The breakthrough CPU accelerates data center AI & HPC with an advanced superchip design.