NVIDIA DGX-2 solidifies leadership in AI development

During the opening two-plus-hour keynote to NVIDIA’s GPU Technology Conference in San Jose this week, CEO Jensen Huang made announcements and proclamations on everything from autonomous driving to medical imaging to ray tracing. The breadth of coverage is substantial now for the company, a dramatic shift from roots in graphics and gaming solely. These kinds of events underlie the value that NVIDIA has created as a company, both for itself and the industry.

In that series of announcements Huang launched a $399,000 server. Yes, you read that right – a machine with a $400k price tag. The hardware is aimed at the highest end, most demanding AI applications on the planet, combining the best of NVIDIA’s hardware stack with its years of software expertise. Likely the biggest customer for these systems will be NVIDIA itself as the company continues to upgrade and improve its deep learning systems to aid in development of self-driving cars, robotics, and more.

The NVIDIA DGX-2 makes the claim of being the world’s first 2 petaFLOPS system, generating more compute power than any competing server in a similar size and density.

The DGX-2 is powered by 16 discrete V100 graphics chips based on the Volta architecture. These sixteen GPUs have a total of 512GB of HBM2 memory (now 32GB per card rather than 16GB) and an aggregate bandwidth of 14.4 TB/s. Each GPU offers 5,120 CUDA cores for a total of 81,920 in the system. The Tensor cores that make up much of the AI capability of the design breach the 2.0 PFLOPS mark. This is a massive compilation of computing hardware.

The previous DGX-1 V100 system, launched just 6 months ago, ran on 8 GPUs with half the memory per GPU. Part of the magic that makes the DGX-2 possible is the development of NVSwitch, a new interconnect architecture that allows NVIDIA to scale its AI integrations further. The physical switch itself is built on 12nm process technology from TSMC and encompasses 2 billion transistors all on its own. It offers 2.4 TB/s of bandwidth.

As PCI Express became a bottleneck for multi-GPU systems that are crunching on enormous data sets typical of deep learning applications, NVIDIA worked on NVLink. First released with the Pascal GPU design and used with Volta as well, the V100 chip has support for 6 NVLink connections and a total of 300 GB/s of bandwidth for cross-GPU communication.

NVSwitch builds on NVLink as an on-node design and allows for any two pairs of GPUs to communicate at full NVLink speed. This facilitates the next level of scaling, moving behind the number of NVLink connections on a per GPU basis and allows for a network to be built around the interface. The switch itself has 18 links and is capable of eight 25 Gbps bi-directional connections. Though the DGX-2 is using twelve NVSwitch chips for connecting 16 GPUs, NVIDIA tells me that there is no technological reason they couldn’t push beyond that. There is simply a question of need and physical capability.

With the DGX-2 system in place, NVIDIA claims to see as much as a 10x speedup in just the 6 months since the release of DGX-1, on select workloads like training FAIRSEQ. Compared to traditional data center servers using Xeon processors, Huang stated that the DGX-2 can provide computing capability at 1/8 the cost, 1/60 the physical space, and 1/18 the power. Though the repeated line of “the more you spend, the more you save” might seem cliché, NVIDIA hopes that those organizations investing in AI applications see value and adopt.

One oddity in the announcement of the DGX-2 was Huang’s claim that it represented the “world’s largest GPU”. The argument likely stems from Google’s branding of the “TPU” as a collection of processors, platforms, and infrastructure into a singular device and NVIDIA’s desire to show similar impact. The company may feel that a “GPU” is too generic a term for the complex systems it builds, which I would agree with, but I don’t think co-opting a term that has significant value in many other spaces is the right direction.

In addition to the GPUs, the DGX-2 does includes substantial hardware from other vendors that act as support systems. This includes a pair of Intel Xeon Platinum processors, 1.5 TB of system memory, eight 100 GigE network connections, and 30TB of NVMe storage. This is an incredibly powerful rackmount server that services AI workloads at unprecedented levels.

The answer that I am still searching for is for the simple question of “who buys these?” NVIDIA clearly has its own need for high performance AI compute capability, and the need to simplify and compress that capability to save money on server infrastructure is substantial. NVIDIA is one of the leading developers of artificial intelligence for autonomous driving, robotics training, algorithm and container set optimization, etc. But other clients are buying in – organizations like New York University, Massachusetts General Hospital, and UC Berkeley have been using the first-generation device in flagship, leadership development roles. I expect that will be the case for the DGX-2 sales targets; that small group on the bleeding edge of AI development.

Announcing a $400k AI accelerator may not have a direct effect on many of NVIDIA’s customers, but it clearly solidifies the company’s position of leadership and internal drive to maintain it. With added pressure from Intel, which is pushing hard into the AI and machine learning fields with acquisitions and internal development, NVIDIA needs to continue down its path and progression. If GTC has shown me anything this week, it’s that NVIDIA is doing just that.

Published by

Ryan Shrout

Ryan is the founder and lead analyst at Shrout Research, consulting and advising leaders in the mobile, graphics, processors and platforms. With more than 17 years of experience evaluating and analyzing hardware and technology as the owner of PC Perspective, Ryan has a breadth of knowledge in nearly all fields of hardware including CPUs, GPUs, SoC design, memory systems, storage, graphics, displays and their integration into smartphones, laptops, PCs and VR headsets. Ryan has worked with nearly every major technology giant and their product management teams including Intel, Qualcomm, AMD, NVIDIA, MediaTek, Dell, Lenovo, Huawei, HTC, Samsung, ASUS, Oculus, Microsoft and Adobe. With a focus on in-depth and real-world testing and with nearly two decades of hands-on experience, he focuses Shrout Research on bringing valuable insight on competitive analysis, consumer product expectations and real-world experience comparisons.

6 thoughts on “NVIDIA DGX-2 solidifies leadership in AI development”

  1. Others could consider this foolish or simply misunderstand you, but you are even able to learn about her ways of carrying makeup or looking for clothes. Secondly, if you see another Russian glamorous chick, you want literally a couple of seconds to scan her and imagine how she seems to be with none cosmetics or clothes on her. Russian women see in foreigners their (form of) saviors, so when you maltreat them, they are going to lose hope in men. Over the previous decade, the energetic group of customers on Meeting Russian Ladies has found assist by means of the site’s honest and open dialogue, plethora of assets, and evaluations of the net dating platforms the place Western men can meet Russian women. All the next platforms have been carefully analyzed and picked by specialists. On-line relationship for them is only a technique to spend an evening along with the chips and a bottle of beer. If you are looking to attract European singles, there are some things you are able to do to make your relationship profile extra appealing. On our listing of finest European dating sites, there are solely premium platforms, or web sites with special paid providers, to be exact.

    Dating a Russian lady is absolute bliss, however you wouldn’t be here if you already knew that! Here to hitch christian dating sites. Ensure that to do your analysis on what the perfect free on-line dating sites are to keep away from wasting your time. The employees of the positioning has accomplished all the pieces to make sure of that. Is there a free dating site in Europe? Nonetheless, in Japan, you might need to be able to spend sooner or later courting, as such observe is widespread in Japanese courting culture, particularly on the weekends. Assembly our one true love wherever or however it occurred is gorgeous sufficient. Nothing can occur to you besides perhaps falling in love! Does it really imply she is okay and there may be nothing to fret about? Although Russian ladies are generally extra onerous-working and accountable than American and European chicks, there are lazy shoppers amongst them too.

    Be severe. On Ukraine dating sites, the majority of women want a man who could be upfront about what he wants. Tips for relationship a Russian woman-how to talk to them? Security tips when using Jap European Dating Websites. They have a habit of coming late when you invite them someplace, and it’s just a typical kind of relationship in Russia, as you’re anticipated to wait. Have enjoyable! Benefit from the means of attending to know somebody new and don’t take issues too seriously. You might need heard that a number of Russian girls, as a result of lack of gentlemen around them, tend to marry alcoholics, lazy guys, or men who beat them. The correspondence resembles a advertising romance rip-off, and though it doesn’t align with the scenario in Ukraine, it does profit from human emotional drivers and the lack charmingdate.com of personal connection experienced by hundreds of thousands of individuals throughout the pandemic. Ukrainian is the official language of Ukraine, about half the inhabitants nonetheless converse Russian as a primary language. Not solely Russian language is complicated! With between 4,000 and 6,000 unique visitors per 30 days, Meeting Russian Women’s reputation is centered on its assets.

    It additionally has common checks of women’s profiles. The ratio of girls to males is 55% to 45%. TheLuckyDate members could edit their profiles at any time, add extra pictures, use tags to point out important info, and add their bios in a free format to attract as many of the right customers as doable. If your date is 10-quarter-hour late, take it easy – she is roughly proper on time according to native requirements. The Russian online relationship scene has change into highly regarded over the last few years, with the arrival of broadband and web it’s now possible to signal as much as a Russian dating site in two minutes and have a date in ten minutes. Paid dating sites, in turn, are usually extra safe, safe and have an ID verification tool which makes it simpler to spot faux profiles. Most women incessantly add faux profiles in these courting web sites to comprehend male curiosity. Furthermore, account verification mitigates fake profiles and rip-off dangers.

  2. 10 Ways to solve your Risk

    manley,MD on nov 10, 2020

    weblog posts On Genital Herpes What Is Genital Herpes? what happens? Symptoms Prevention Diagnostic Tests Treatment what to anticipate Ask Your Doctor This Living With Resources Glossary of Terms


    2. People with a history of STDs will probably have genital herpes.

    rather than awkward, But you have to be honest with each other. your ex may be afraid to tell you the truth if they feara negative reaction. If your spouse feels comfortable talking with you, You’ll be more prone to get straight answers.



    5. as well, if you notice a sore on someone’s genitals, Don’t have relations with that person until you’re sure they don’t have genital herpes. know, not everyone with genital herpes has symptoms, And herpes sores can be very hard to spot.


    7. in that case, just be tested, to.

    8. People tend to be less careful about practicing safer sex while drunk and they often regret it later.

    Show natural resources SOURCE:Health products and solutions from Our Sponsors Penis Curved When Erect? Could could very well CAD? Treat Bent hands and fingers Treat HR+, HER2 MBC sick and tired of Dandruff? benefits associated with CBD Rethink MS Treatment AFib Related Strokes Risk of a Future DVT/PE Is My Penis Normal? Relapsing MS Options Liver Transplants Save Lives Finance latamdate.com plastic surgery Bent Finger Causes Living With Psoriasis? not well-known Teeth?

    More from WebMD 5 Tips to Help With Relapsing MS How to Thrive With Narcolepsy Relief for Blocked associated with hair Psoriatic Arthritis and Your Sleep What Psoriasis Feels Like First Psoriatic Arthritis Flare Talking to Your Doctor About RA Crohn’s: A ‘Full Body’ Disease Avoiding Crohn’s Flares Health Benefits of Hemp Seed Oil Live Better With Psoriatic Disease Types of B Cell Therapy for MS 5 Health Benefits of Hemp Why prostate type of cancer Spreads Living with Advanced Breast Cancer Where Breast Cancer Spreads.

  3. The following are some online dating tips that ought to assist you to enhance your odds of finding your soulmate. They may have a barely various viewpoint of fact than you are doing, or they be deliberately aiming to mislead you about who they actually are and no matter they have actually achieved. The truth is that most people’s first point of interest in one other relies on seems. Internet dating is actually utilizing the Web as a means of communicating to attach to 2 different individuals to share locations of interest and mutual profit. You’ll want to do something to catch the interest of them from the hundreds and 1000’s of other on-line profiles. Help recognizing on-line profiles which might be time wasters, faux profiles, cat fishing, scammers or potential threats. Often, the database of profiles on online dating platforms is huge. In this study we analyze the profit and welfare commerce-offs related to totally different length subscription pricing methods for online dating platforms.

    To a big diploma, this is due to membership gender ratios (more males becoming a member of than ladies), and in addition the truth that on numerous dating websites women can use most of the features totally free, whereas men must pay. There are also a number of dating websites that require customers to pay a big sum of cash before they can entry. If you’re first time make a profile on relationship then you’ll make a unique profile. First impressions are particularly crucial within the online dating world. You’re at liberty to contact the face that interests you. If you publish a photo that is at such a distance the place you can’t see the face clearly then folks looking your profile will both surprise why, or simply move on to the subsequent particular person. Avoid being unenthusiastic or you’ll flip individuals off after they see your backdrop info. However you can embody fairly a bit of knowledge on the opposite apps as nicely. 3) It is attainable that your profile is simply boring and that you must spice it up a bit. They need to get their relationship emails and messages out with no delay.

    1. Men need to establish contact as quickly as doable with a woman or women that they’re attracted to. 1. Use the block facility to stop particularly obnoxious males from contacting you if they are rude and offensive. Ensure that to use a flattering closeup shot of your self. Like all courting services it contains personal pursuits and hobbies however moreover delves into what make a person tick. Online dating success depends on sending properly focused messages – both straight via the dating site’s interface, or direct emails you ship once contact is established with a fellow member. 5. If you’re a paying member of a courting web site, every message you send could value “credits”, another purpose to be super selective about who you send messages and emails to. Some are more energetic than that, however nonetheless have not discovered their true love or even a casual conversation. With internet dating, sometimes individuals will make quick judgement calls primarily based on even a couple of easy words that you write in your headline or profile. Unlike the conventional method to meet new individuals in individual, online dating provides you the opportunity to know your subject before making any move.

    There are prime relationship websites available for you to do your seek for singles on-line and in addition much less standard courting websites as well. If you want to go for relationship on-line, there are a few things that it is best to do to get started. Just a few have discovered important others online, even after months or years of trying. So, even if one is disheartened by one app, they clearly have an choice to seek out somebody on some other app. Nonetheless, it may be strange to meet someone on these internet sites. These days, every little thing seems to be facilitated by the Web. Sending the mistaken forms of messages using Web relationship sites will see you at the underside of the pile, with only a few dates. However some scammers have tried to threaten money out of individuals for not showing footage, webcam footage or messages that they have managed to get out of users on-line. Many people will join, browse the profiles, arrange their own profile, and asiame scam wait. The scam started last year when the girl, from Nottinghamshire, set up an online dating profile on Our Time, a site for individuals over 50, and began speaking to “Adam”. Considered one of the benefits of online dating is that you could set the tempo of your relationship.

Leave a Reply

Your email address will not be published. Required fields are marked *