AI Inference | 人工智慧推論

  • 人工智慧推論是什麼?
    機器學習深度學習分兩階段,第一階段是人工智慧(AI)訓練,第二階段則是推論。訓練與推論的反覆循環,造就現代世界各種先進的AI產品,例如能產出內容的生成式人工智慧,或是輔助人類駕駛的自駕系統。

    推論階段,AI必須處理陌生的未標籤化資料,AI參考訓練階段所「拜讀」的數據,企圖理解新接收的輸入值(input),產出正確的輸出值(output)。使用生成式AI來舉例,每當使用者詢問ChatGPT問題,或是請Stable Diffusion協助繪圖,AI就是在進行推論。同時,AI也會記錄人類使用者給予的回饋,使用於下一回的訓練,因此人工智慧變得愈來愈聰明、愈善解人意。

  • 為何需要?
    訓練AI的最終目的,當然就是要進行推論,與現實世界發生互動,協助人們提升生活的便利性與舒適。許多先進的AI應用,包括辨識人臉或是手寫字跡,或是產生內容、操作自駕車,都是AI在進行推論。常見的實用範例,包括電腦視覺自然語言處理(NLP)、推薦系統等。

  • 技嘉的特色
    有效進行AI推論的秘訣,就是電腦的運算力夠強大、延遲夠低。理由在於,AI模型大多是由許多用戶同時使用,應用情境包括提升生產力(比如說,幫物流中心進行分貨)或是確保自駕車行車安全,由此可見高算力與低延遲是不可或缺的兩大支柱。

    伺服器產品方面,技嘉科技推出G293-Z43伺服器,提供最高密度的推論加速器配置,2U 規格機殼內安裝十六張AMD Alveo™ V70加速卡,Alveo™ V70採用AMD的XDNA™自適應資料流架構,非常適合人工智慧推論使用。技嘉亦提供Qualcomm人工智慧推論方案,Qualcomm Cloud AI 100加速器在吞吐量與低延遲方面表現優異,支援資料中心雲端運算邊緣運算等多重環境應用,提供高效能表現、高密度加速運算、高擴充性等各項優勢。

    針對不同垂直產業,技嘉提供多樣性解決方案,交通運輸業可使用技嘉自動駕駛控制主機(ADCU),是透過AI加速的嵌入式運算平台,已部署於台灣彰濱工業區的自駕公車商場及學校積極導入的AI人臉辨識,推薦使用技嘉智慧臉部辨識解決方案,這套方案採用「一對多」的辨識模型,在沒有比對資料的前提下,仍可達到99.9%的準確度。

    了解更多:《GIGABYTE AI伺服器為人工智慧加速無限可能

  • WE RECOMMEND
    RELATED ARTICLES
    How to Benefit from AI  In the Healthcare & Medical Industry

    AI & AIoT

    How to Benefit from AI In the Healthcare & Medical Industry

    If you work in healthcare and medicine, take some minutes to browse our in-depth analysis on how artificial intelligence has brought new opportunities to this sector, and what tools you can use to benefit from them. This article is part of GIGABYTE Technology’s ongoing “Power of AI” series, which examines the latest AI trends and elaborates on how industry leaders can come out on top of this invigorating paradigm shift.
    How to Pick the Right Server for AI? Part Two: Memory, Storage, and More

    Tech Guide

    How to Pick the Right Server for AI? Part Two: Memory, Storage, and More

    The proliferation of tools and services empowered by artificial intelligence has made the procurement of “AI servers” a priority for organizations big and small. In Part Two of GIGABYTE Technology’s Tech Guide on choosing an AI server, we look at six other vital components besides the CPU and GPU that can transform your server into a supercomputing powerhouse.
    How to Pick the Right Server for AI? Part One: CPU & GPU

    Tech Guide

    How to Pick the Right Server for AI? Part One: CPU & GPU

    With the advent of generative AI and other practical applications of artificial intelligence, the procurement of “AI servers” has become a priority for industries ranging from automotive to healthcare, and for academic and public institutions alike. In GIGABYTE Technology’s latest Tech Guide, we take you step by step through the eight key components of an AI server, starting with the two most important building blocks: CPU and GPU. Picking the right processors will jumpstart your supercomputing platform and expedite your AI-related computing workloads.
    10 Frequently Asked Questions about Artificial Intelligence

    AI & AIoT

    10 Frequently Asked Questions about Artificial Intelligence

    Artificial intelligence. The world is abuzz with its name, yet how much do you know about this exciting new trend that is reshaping our world and history? Fret not, friends; GIGABYTE Technology has got you covered. Here is what you need to know about the ins and outs of AI, presented in 10 bite-sized Q and A’s that are fast to read and easy to digest!
    How to Benefit from AI in the Automotive & Transportation Industry

    AI & AIoT

    How to Benefit from AI in the Automotive & Transportation Industry

    If you work in the automotive and transportation industry, spend a few minutes to read our in-depth analysis of how artificial intelligence has created new opportunities in this sector, and what tools you can use to get ahead. This article is part of GIGABYTE Technology’s ongoing “Power of AI” series, which examines the latest AI-related trends, and how intrepid visionaries can reap the benefits of this exciting paradigm shift.
    How to Pick a Cooling Solution for Your Servers? A Tech Guide by GIGABYTE

    Tech Guide

    How to Pick a Cooling Solution for Your Servers? A Tech Guide by GIGABYTE

    As CPUs and GPUs continue to advance, they consume more power and generate more heat. It is vital to keep temperature control in mind when purchasing servers. A good cooling solution keeps things running smoothly without hiking up the energy bill or requiring persistent maintenance. GIGABYTE Technology, an industry leader in high-performance servers, presents this Tech Guide to help you choose a suitable cooling solution. We analyze three popular options—air, liquid, immersion—and demonstrate what GIGABYTE can do for you.
    To Harness Generative AI, You Must Learn About “Training” & “Inference”

    Tech Guide

    To Harness Generative AI, You Must Learn About “Training” & “Inference”

    Unless you’ve been living under a rock, you must be familiar with the “magic” of generative AI: how chatbots like ChatGPT can compose anything from love letters to sonnets, and how text-to-image models like Stable Diffusion can render art based on text prompts. The truth is, generative AI is not only easy to make sense of, but also a cinch to work with. In our latest Tech Guide, we dissect the “training” and “inference” processes behind generative AI, and we recommend total solutions from GIGABYTE Technology that’ll enable you to harness its full potential.
    NCHC and Xanthus Elevate Taiwanese Animation on the World Stage with GIGABYTE Servers

    Success Case

    NCHC and Xanthus Elevate Taiwanese Animation on the World Stage with GIGABYTE Servers

    Created by Greener Grass Production, the Taiwanese sci-fi mini-series “2049” made its debut on Netflix and various local TV channels. The animated spin-off “2049+ Voice of Rebirth”, crafted by Xanthus Animation Studio, premiered on the streaming service myVideo. The CGI show was created with the NCHC Render Farm’s GIGABYTE servers, which employ top-of-the-line NVIDIA® graphics cards to empower artists with industry-leading rendering capabilities. The servers can take on multiple workloads simultaneously through parallel computing, and they boast a wide range of patented smart features that ensure stability and availability. With all it has going for it, “2049+ Voice of Rebirth” may garner enough attention to become the breakout hit that will introduce Taiwanese animation to international audiences.