Heterogeneous Computing | 異質運算

  • 異質運算是什麼?
    一般來說,異質運算是指系統使用不同種類的計算單元,例如CPUGPUDPU、VPU、FPGA或ASIC。不同運算工作交由符合需求的專用處理器來執行,大幅提升運算效能、改善能源使用效率,計算單元之間透過高流量、低延遲的通道互相串聯,就如一個大型處理器。

    近年來,異質運算的定義變得更廣泛,包含使用不同架構的處理器,例如Arm架構處理器,其運算核心數量較多、功耗較低,也比較容易與Arm架構行動裝置互相「溝通」。使用不同處理器架構的伺服器解決方案,有可能更快解決特殊的工作負載。

  • 為何需要?
    如果您的伺服器解決方案使用CPU以外的協同處理器,例如GPU或是DPU,這就是所謂的異質運算,使用協同處理器大幅提升運算效能,減少完成運算所需的時間。尤其是運用機器視覺或深度學習開發人工智慧(AI),伺服器必須處理大量的視覺資訊,適合用頻率較低、核心數量較多的GPU產品,輔助CPU快速完成運算工作。

    使用不同的處理器架構,等於是進階版的異質運算,最近的趨勢是找尋x86架構以外的替代方案,例如Arm架構處理器,可開發新的運算產品,充分發揮異質運算的潛能。如果您目前使用的處理器和協同處理器不足以滿足您的運算需求,那使用不同處理器架構的異質運算解決方案,可能就是您所需要的產品。

  • 技嘉的特色
    技嘉科技旗下的伺服器解決方案,幾乎都能實現狹義的異質運算,就是將CPU與GPGPU等協同處理器結合,進行平行運算機器學習等特殊運算工作。主要的處理器可採用最新的Intel® Xeon® 可擴充處理器或AMD EPYC™處理器,並透過新一代的PCIe Gen 4.0連接顯示卡、儲存裝置、高速網路卡等零組件,PCIe Gen 4.0最高頻寬64GB/s,是PCIe Gen 3.0的兩倍快。

    技嘉長年開發Arm架構系統,推出一系列支援Ampere® Altra®處理器的Arm架構伺服器,適合高效能運算(HPC)雲端運算邊緣運算,所提供的高擴充性能協助使用者滿足各種運算需求。NVIDIA®發表 NVIDIA® Arm HPC 開發套件,包含支援單顆Ampere® Altra®處理器的技嘉G242伺服器、兩張NVIDIA A100 Tensor核心運算卡、一張NVIDIA® BlueField® 2資料處理器以及NVIDIA® HPC軟體開發套件,為高效能運算和AI應用開發者提供另類的開發平台選項,運用最適當的異質運算方案解決困難的運算問題。

    免費下載Tech Guide:《How to Build Your Data Center with GIGABYTE?

  • WE RECOMMEND
    RELATED ARTICLES
    How to Benefit from AI  In the Healthcare & Medical Industry

    AI & AIoT

    How to Benefit from AI In the Healthcare & Medical Industry

    If you work in healthcare and medicine, take some minutes to browse our in-depth analysis on how artificial intelligence has brought new opportunities to this sector, and what tools you can use to benefit from them. This article is part of GIGABYTE Technology’s ongoing “Power of AI” series, which examines the latest AI trends and elaborates on how industry leaders can come out on top of this invigorating paradigm shift.
    How to Pick the Right Server for AI? Part One: CPU & GPU

    Tech Guide

    How to Pick the Right Server for AI? Part One: CPU & GPU

    With the advent of generative AI and other practical applications of artificial intelligence, the procurement of “AI servers” has become a priority for industries ranging from automotive to healthcare, and for academic and public institutions alike. In GIGABYTE Technology’s latest Tech Guide, we take you step by step through the eight key components of an AI server, starting with the two most important building blocks: CPU and GPU. Picking the right processors will jumpstart your supercomputing platform and expedite your AI-related computing workloads.
    10 Frequently Asked Questions about Artificial Intelligence

    AI & AIoT

    10 Frequently Asked Questions about Artificial Intelligence

    Artificial intelligence. The world is abuzz with its name, yet how much do you know about this exciting new trend that is reshaping our world and history? Fret not, friends; GIGABYTE Technology has got you covered. Here is what you need to know about the ins and outs of AI, presented in 10 bite-sized Q and A’s that are fast to read and easy to digest!
    How to Benefit from AI in the Automotive & Transportation Industry

    AI & AIoT

    How to Benefit from AI in the Automotive & Transportation Industry

    If you work in the automotive and transportation industry, spend a few minutes to read our in-depth analysis of how artificial intelligence has created new opportunities in this sector, and what tools you can use to get ahead. This article is part of GIGABYTE Technology’s ongoing “Power of AI” series, which examines the latest AI-related trends, and how intrepid visionaries can reap the benefits of this exciting paradigm shift.
    Researching Cellular Aging Mechanisms at Rey Juan Carlos University

    Success Case

    Researching Cellular Aging Mechanisms at Rey Juan Carlos University

    The speed, the precision, the vast amount of data need a computing cluster. Researchers Sergio Muñoz and Luis Bote at Rey Juan Carlos University worked with SIE and GIGABYTE to create a cluster composing of nodes: GPU, storage, compute, and head.
    GIGABYTE PILOT: The Autonomous-Driving Control Unit at the Heart of Taiwan’s First Self-Driving Bus

    Success Case

    GIGABYTE PILOT: The Autonomous-Driving Control Unit at the Heart of Taiwan’s First Self-Driving Bus

    Developed by the Automotive Research Testing Center (ARTC), the WinBus is Taiwan’s first self-driving electric bus that has reached SAE Level 4 Driving Automation. GIGABYTE PILOT, GIGABYTE Technology’s Autonomous-Driving Control Unit (ADCU), is the AI Mobile Edge Computing Platform at the heart of the autonomous vehicle. It provides superb processing power to support the deployment of self-driving AI algorithms, versatile connectivity to act as the hub between onboard sensors and the vehicle control system, and a rugged and reliable design that is ready for long-term operations. GIGABYTE PILOT is the ideal choice for autonomous vehicles, vessels, heavy machinery, and autonomous mobile robots (AMRs).
    0 to 100 KPH in 3.3 Seconds! NTHU Builds Electric Formula Student Race Cars with GIGABYTE

    Success Case

    0 to 100 KPH in 3.3 Seconds! NTHU Builds Electric Formula Student Race Cars with GIGABYTE

    Representing Hsinchu’s Tsing Hua University, NTHU Racing is one of Taiwan’s top Formula Student racing teams. In 2019, its electric formula student race car, the “TH04”, took second place in Formula SAE Japan. In August of 2022, its new and improved, 100% manufactured in Taiwan “TH06” raced for the gold in Formula Student Germany. Tsing Hua University built the “TH06” using GIGABYTE Technology’s W771-Z00 and W331-Z00 Tower Server/Workstation products. From finite element analysis (FEA) and computational fluid dynamics (CFD) modelling and analysis during the design phase, to racing simulations and experimenting with new tech during the testing phase, GIGABYTE servers provided NTHU Racing with the processing power and versatility it needed to engineer a high-performing electric vehicle that can go from 0 to 100 kph in 3.3 seconds—almost on par with Tesla’s Model S, which can go from 0 to 60 mph in 2.6 seconds.
    Japanese Telco Leader KDDI Invents Immersion Cooling Small Data Center with GIGABYTE

    Success Case

    Japanese Telco Leader KDDI Invents Immersion Cooling Small Data Center with GIGABYTE

    Japanese telco giant KDDI Corporation has invented a new class of data centers that are mobile and eco-friendly. These “container-type immersion cooling small data centers” employ “single-phase immersion cooling” to reduce power consumption by 43% and lower the PUE below 1.07. GIGABYTE Technology drew from its years of experience in the telco sector to provide the R282-Z93 and R182-Z91 Rack Servers for KDDI to use as the management and GPU computing nodes in the data center. KDDI benefits from the servers’ powerful 3rd Gen AMD EPYC™ CPUs, the scalable, high-density configuration of NVIDIA® GPUs in small form factors, and the servers’ optimized compatibility with the liquid-based data center cooling solution. GIGABYTE’s participation in KDDI’s project is in line with GIGABYTE’s long-term CSR and ESG efforts, which are focused on working with global industry leaders to “Upgrade Your Life” with high tech while building a greener, more sustainable environment for our future.