GPU

  • What is it?
    GPUs (graphics processing units) are similar to CPUs (central processing units) in the sense that they are both processors, but different in many other fundamental ways. Compared with a CPU, a GPU tends to have less complicated control units and arithmetic logic units (ALUs), as well as smaller caches. This simpler, more specialized parallel structure allows GPUs to have a much higher number of cores than the more complex CPUs.

    To illustrate, ARM CPUs have more cores than their x86 counterparts because they adopt the RISC architecture, but even they cap out at a couple hundred cores, while a GPU can support thousands of cores. The upshot of this is while a CPU is general-purpose and can tackle just about any computing task with its comprehensive toolset, a GPU is very good at doing some certain tasks very quickly by using its more abundant provision of the simplified versions of same tools. Said tasks include generating the computer graphics we see on our PC displays, or processing the massive amount of graphical data that is used in AI training.

    Historically, GPUs were developed as a cheaper alternative to the expensive CPUs. They were mainly used to render graphics for computer games. Technological advances have led to the rise of discrete or dedicated graphics cards, which are often also called GPUs, but that's a misnomer; these are in fact expansion cards with GPUs at the core. Graphics cards offer GPUs additional support with dedicated memory, heat sinks, and other components. This is why discrete GPUs generally outperform the integrated GPUs that are built into motherboards or CPUs. For this reason, graphics cards have become a mainstay of the esports and gaming industry.

    In recent years, scientists and engineers have discovered that the execution of many computing tasks can be expedited by using GPUs. GPUs used for something other than generating graphics are sometimes called GPGPUsHigh performance computing (HPC)artificial intelligence, and many other astounding breakthroughs have been made possible by using servers that utilize a large number of GPGPUs.

  • Why do you need it?
    In the consumer market, a good GPU (in the form of a top-notch graphics card) has become an indelible part of the immersive gaming or media viewing experience. The mining of cryptocurrency also led to a surge in demand for GPUs.

    As mentioned before, GPUs are essential to gaming and esports because the specialized parallel structure can render high-quality images on the display very quickly, allowing for photorealistic visual effects, higher refresh rates, higher frame rates (FPS), and an ultra-smooth gaming experience at high resolutions. The same attributes are also great for rendering computer graphics and creating visual content; for animators and visual artists, having a powerful GPU can vastly accelerate the creative process. The demand for GPU computing is so pressing, professional creatives either set up their own workstations or servers in their studios, or they hire services from a remote render farm to bring their vision into reality more efficiently.

    For the GPUs (or GPGPUs) that are installed in servers to help with computing tasks, the possibilities are endless. Computer visionmachine learning, and deep learning are just some of the applications that GPUs excel at. Generative AI, the process by which artificial intelligence generates texts or images, was made possible with GPU computing. GPUs can be used in both AI training and AI inference, but especially the former, since the massive amount of big data that must be "studied" by the AI model can be processed more effectively through parallel computing. More and more industry leaders are offering complete solutions that combine hardware and software to help various vertical markets reap the benefits of GPUs, whether it's manufacturing, transportation, healthcare, education, or entertainment.

  • How is GIGABYTE helpful?
    GIGABYTE is an industry leader in the discrete graphics cards market, with an expansive product line that incorporates GPUs from major brands like AMD and NVIDIA. The GPUs used in GIGABYTE's PC products, such as the AORUS and AERO laptops, also boast incredible performance.

    GIGABYTE's graphics cards are mainly separated into four product lines: AORUS, AERO, EAGLE, and GAMING. The AORUS series is designed for high-end PC gaming; it incorporates innovative features to bring the best performance out of the GPUs, such as the Waterforce liquid cooling system, which dissipates the heat generated by the GPUs with liquid coolant. The GAMING and EAGLE series are mainstream graphics cards that strike a balance between performance and affordability. The AERO series, on the other hand, is aimed at creatives who use GPUs to render graphics, edit videos, and create content. In addition to a plethora of features that give users an edge in the creative process, these graphics cards also sport a simple silver-white design that's favored by consumers with an eye for aesthetics.

    What's more, GIGABYTE is dedicated to exploring the potential of heterogeneous computing—the combination of CPUs and GPUs—in servers that are used by enterprises and research institutes. The G-Series GPU Servers are an entire product line that offers scalable, high-density GPU designs well-suited for data analytics and scientific research. To share just a few examples, the European Organization for Nuclear Research (CERN) uses GIGABYTE's G482-Z51 to conduct quantum physics research with the Large Hadron Collider (LHC). Lowell Observatory in Arizona, USA, where Pluto was first discovered in 1894, uses GIGABYTE's G482-Z50 to help look for a "Twin Earth" in outer space. The G593-Series servers are some of the most powerful AI servers on the planet, combining the latest CPUs by AMD (for the G593-ZD2) or Intel (for the G593-SD0) with NVIDIA HGX H100 8-GPU, a powerful computing module that brings GPU acceleration to AI training. Wherever there are groundbreaking discoveries to be made or inventions to be created, GPUs—and the servers that support them—have an important role to play.

    Free Download Tech Guide:《How to Build Your Data Center with GIGABYTE?

  • WE RECOMMEND
    RELATED ARTICLES
    To Harness Generative AI, You Must Learn About “Training” & “Inference”

    Tech Guide

    To Harness Generative AI, You Must Learn About “Training” & “Inference”

    Unless you’ve been living under a rock, you must be familiar with the “magic” of generative AI: how chatbots like ChatGPT can compose anything from love letters to sonnets, and how text-to-image models like Stable Diffusion can render art based on text prompts. The truth is, generative AI is not only easy to make sense of, but also a cinch to work with. In our latest Tech Guide, we dissect the “training” and “inference” processes behind generative AI, and we recommend total solutions from GIGABYTE Technology that’ll enable you to harness its full potential.
    GIGABYTE PILOT: The Autonomous-Driving Control Unit at the Heart of Taiwan’s First Self-Driving Bus

    Success Case

    GIGABYTE PILOT: The Autonomous-Driving Control Unit at the Heart of Taiwan’s First Self-Driving Bus

    Developed by the Automotive Research Testing Center (ARTC), the WinBus is Taiwan’s first self-driving electric bus that has reached SAE Level 4 Driving Automation. GIGABYTE PILOT, GIGABYTE Technology’s Autonomous-Driving Control Unit (ADCU), is the AI Mobile Edge Computing Platform at the heart of the autonomous vehicle. It provides superb processing power to support the deployment of self-driving AI algorithms, versatile connectivity to act as the hub between onboard sensors and the vehicle control system, and a rugged and reliable design that is ready for long-term operations. GIGABYTE PILOT is the ideal choice for autonomous vehicles, vessels, heavy machinery, and autonomous mobile robots (AMRs).
    0 to 100 KPH in 3.3 Seconds! NTHU Builds Electric Formula Student Race Cars with GIGABYTE

    Success Case

    0 to 100 KPH in 3.3 Seconds! NTHU Builds Electric Formula Student Race Cars with GIGABYTE

    Representing Hsinchu’s Tsing Hua University, NTHU Racing is one of Taiwan’s top Formula Student racing teams. In 2019, its electric formula student race car, the “TH04”, took second place in Formula SAE Japan. In August of 2022, its new and improved, 100% manufactured in Taiwan “TH06” raced for the gold in Formula Student Germany. Tsing Hua University built the “TH06” using GIGABYTE Technology’s W771-Z00 and W331-Z00 Tower Server/Workstation products. From finite element analysis (FEA) and computational fluid dynamics (CFD) modelling and analysis during the design phase, to racing simulations and experimenting with new tech during the testing phase, GIGABYTE servers provided NTHU Racing with the processing power and versatility it needed to engineer a high-performing electric vehicle that can go from 0 to 100 kph in 3.3 seconds—almost on par with Tesla’s Model S, which can go from 0 to 60 mph in 2.6 seconds.
    Japanese Telco Leader KDDI Invents Immersion Cooling Small Data Center with GIGABYTE

    Success Case

    Japanese Telco Leader KDDI Invents Immersion Cooling Small Data Center with GIGABYTE

    Japanese telco giant KDDI Corporation has invented a new class of data centers that are mobile and eco-friendly. These “container-type immersion cooling small data centers” employ “single-phase immersion cooling” to reduce power consumption by 43% and lower the PUE below 1.07. GIGABYTE Technology drew from its years of experience in the telco sector to provide the R282-Z93 and R182-Z91 Rack Servers for KDDI to use as the management and GPU computing nodes in the data center. KDDI benefits from the servers’ powerful 3rd Gen AMD EPYC™ CPUs, the scalable, high-density configuration of NVIDIA® GPUs in small form factors, and the servers’ optimized compatibility with the liquid-based data center cooling solution. GIGABYTE’s participation in KDDI’s project is in line with GIGABYTE’s long-term CSR and ESG efforts, which are focused on working with global industry leaders to “Upgrade Your Life” with high tech while building a greener, more sustainable environment for our future.
    CSR and ESG in Action: GIGABYTE Helps NCKU Train Award-Winning Supercomputing Team

    Success Case

    CSR and ESG in Action: GIGABYTE Helps NCKU Train Award-Winning Supercomputing Team

    GIGABYTE Technology is not only a leading brand in high-performance server solutions—it is also an active force for good when it comes to CSR and ESG activities. Case in point: in 2020, GIGABYTE provided four G482-Z50 servers to Taiwan’s Cheng Kung University. The servers were used to train a team of talented students, who went on to take first place in that year’s APAC HPC-AI Competition in Singapore. The parallel computing performance of the servers’ processors, the seamless connectivity between the servers, and the servers’ unrivalled reliability are the reasons why GIGABYTE servers are ideal for educating the next generation of supercomputing experts. GIGABYTE is happy to give back to society and contribute to human advancement through high tech solutions.
    Semiconductor Giant Selects GIGABYTE’s Two-Phase Immersion Cooling Solution

    Success Case

    Semiconductor Giant Selects GIGABYTE’s Two-Phase Immersion Cooling Solution

    GIGABYTE Technology has built a “two-phase immersion cooling solution” for one of Taiwan’s foremost semiconductor giants, to be used in its sustainable, future-proof “green HPC data centers”. Not only does the solution boost the performance of HPC processors by over 10%—which is crucial for the nanometer process technology used in IC foundries—it also reduces data center power consumption by 30% and lowers PUE below 1.08, which turns it into a role model of green computing that may be replicated in data centers around the world. This exemplary project demonstrates how GIGABYTE can support its clients’ CSR, ESG, and SDGs-related initiatives, and how GIGABYTE is working tirelessly to “Upgrade Your Life” with high tech while protecting our environment.
    NCHC and Xanthus Elevate Taiwanese Animation on the World Stage with GIGABYTE Servers

    Success Case

    NCHC and Xanthus Elevate Taiwanese Animation on the World Stage with GIGABYTE Servers

    Created by Greener Grass Production, the Taiwanese sci-fi mini-series “2049” made its debut on Netflix and various local TV channels. The animated spin-off “2049+ Voice of Rebirth”, crafted by Xanthus Animation Studio, premiered on the streaming service myVideo. The CGI show was created with the NCHC Render Farm’s GIGABYTE servers, which employ top-of-the-line NVIDIA® graphics cards to empower artists with industry-leading rendering capabilities. The servers can take on multiple workloads simultaneously through parallel computing, and they boast a wide range of patented smart features that ensure stability and availability. With all it has going for it, “2049+ Voice of Rebirth” may garner enough attention to become the breakout hit that will introduce Taiwanese animation to international audiences.
    Spain’s IFISC Tackles COVID-19, Climate Change with GIGABYTE Servers

    Success Case

    Spain’s IFISC Tackles COVID-19, Climate Change with GIGABYTE Servers

    By using GIGABYTE, Spain’s Institute for Cross-Disciplinary Physics and Complex Systems is pitting the world’s foremost server solutions against some of the world’s most pressing issues, including the effects of climate change, pollution, and COVID-19. GIGABYTE servers are up to the diverse and daunting tasks, because they are designed for high performance computing, intensive numerical simulations, AI development, and big data management.