Chiplets to Drive the Future of Semis

A classic way for engineers to solve a particularly vexing technical problem is to move things in a completely different direction—typically by “thinking outside the box.” Such is the case with challenges facing the semiconductor industry. With the laws of physics quickly closing in on them, the traditional brute force means of maintaining Moore’s Law, by shrinking the size of transistors, is quickly coming to an end. Whether things stall at the current 7nm (nanometer) size, drop down to 5nm, or at best, reach 4nm, the reality of a nearly insurmountable wall is fast approaching today’s leading vendors.

As a result, semiconductor companies are having to develop different ways to keep the essential performance progress they need moving in a positive direction. One of the most compelling ideas, chiplets, isn’t a terribly new one, but it’s being deployed in interesting new ways. Chiplets are key IP blocks taken from a more complete chip design that are broken out on their own and then connected together with clever new packaging and interconnect technologies. Basically, it’s a new version of an SoC (system on chip), which combined various pieces of independent silicon onto a multi-chip module (MCM) to provide a complete solution.

So, for example, a modern CPU typically includes the main compute engine, a memory controller for connecting to main system memory, an I/O hub for talking to other peripherals, and several other different elements. In the world of chiplets, some of these elements can be broken back out into separate parts (essentially reversing the integration trend that has fueled semiconductor advances for such a long time), optimized for their own best performance (and for their own best manufacturing node size), and then connected back together in Lego block-type fashion.

While that may seem a bit counter-intuitive compared to typical semiconductor industry trends, chiplet designs help address several issues that have arisen as a result of traditional advances. First, while integration of multiple components into a single chip arguably makes things simpler, the truth is that today’s chips have become both enormously complex and quite large as a result. Ensuring high-quality, defect-free manufacturing of these large, complex chips—especially while you’re trying to reduce transistor size at the same time—has proven to be an overwhelming challenge. That’s one of the key reasons why we’ve seen delays or even cancellations of moves to current 10nm and 7nm production from many major chip foundries.

Second, it turns out not every type of chip element actually benefits from smaller sizes. The basic argument for shrinking transistors is to reduce costs, reduce power consumption, and improve performance. With elements like the analog circuitry in I/O components, however, it turns out there’s a point of diminishing returns where smaller transistors are actually more expensive and don’t get the performance benefits you might expect from smaller production geometries. As a result, it just doesn’t make sense to try and move current monolithic chip designs to these smaller sizes.

Finally, some of the more interesting advancements in the semiconductor world are now occurring in interconnect and packaging technologies. From the 3D stacking of components being used to increase the capacity of flash memory chips, to the high-speed interfaces being developed to enable both high-speed on-chip and chip-to-chip communications, the need to keep all the critical components of a chip design at the same process level are simply going away. Instead, companies are focusing on creating clever new ways to interconnect IP blocks/components in order to achieve the performance enhancements they used to only be able to get through traditional Moore’s Law transistor shrinks.

AMD, for example, has made its Infinity Fabric interconnect technology a critical part of its Zen CPU designs, and at last week’s 7nm event, the company highlighted how they’ve extended it to their new data center-focused CPUs and new GPUs now as well. The next generation Epyc server CPU, codenamed “Rome,” scheduled for release in 2019, leverages up to 8 separate Zen2-based CPU chiplets interconnected over their latest generation Infinity Fabric to provide 64 cores in a single SoC. The result, they claim, is performance in a single socket server that can beat Intel’s current best two-socket server CPU configuration.

In addition, AMD highlighted how its new 7nm data center-focused Radeon Instinct GPU designs can now also be connected over Infinity Fabric both for GPU-to-GPU connections as well as for faster CPU-to-GPU connections (similar to Nvidia’s existing NVLink protocol), which could prove to be very important for advanced workloads like AI training, supercomputing, and more.

Interestingly, AMD and Intel worked together on a combined CPU/GPU part earlier this year that leveraged a slightly different interconnect technology but allowed them to put an Intel CPU together with a discrete AMD Radeon GPU (for high-powered PCs like the Dell XPS15 and HP 15” Spectre X360) onto a single chip.

Semiconductor IP creator Arm has been enabling an architecture for chiplet-like mobile SoC designs with its CCI (Cache Coherent Interconnect) technology for several years now. In fact, companies like Apple and Qualcomm use that type of technology for their A-Series and Snapdragon series chips, respectively.

Intel, for its part, is also planning to leverage chiplet technology for future designs. Though specific details are still to come, the company has discussed not just CPU-to-CPU connections, but also being able to integrate high-speed links with other chip IP blocks, such as Nervana AI accelerators, FPGAs and more.

In fact, the whole future of semiconductor design could be revolutionized by standardized, high-speed interconnections among various different chip components (each of which may be produced with different transistor sizes). Imagine, for example, the possibility of more specialized accelerators being developed by small innovative semiconductor companies for a variety of different applications and then integrated into final system designs that incorporate the main CPUs or GPUs from larger players, like Intel, AMD, or Nvidia.

Unfortunately, right now, a single industry standard for chiplet interconnect doesn’t exist—in the near term we may see individual companies choose to license their specific implementations to specific partners—but there’s likely to be pressure to create that standard in the future. There are several tech standards for chip-related interconnect, including CCIX (Cache Coherent Interconnect for Accelerators), which builds on the PCIe 4.0 standard, and the system-level Gen-Z standard, but nothing that all the critical players in the semiconductor ecosystem have completely embraced. In addition, standards need to be developed as to how different chiplets can be pieced together and manufactured in a consistent way.

Exactly how the advancements in chiplets and associated technologies relate to the ability to maintain traditional Moore’s law metrics isn’t entirely clear right now, but what is clear is that the semiconductor industry isn’t letting potential roadblocks stop it from making important new advances that will keep the tech industry evolving for some time to come.

Published by

Bob O'Donnell

Bob O’Donnell is the president and chief analyst of TECHnalysis Research, LLC a technology consulting and market research firm that provides strategic consulting and market research services to the technology industry and professional financial community. You can follow him on Twitter @bobodtech.

202 thoughts on “Chiplets to Drive the Future of Semis”

  1. Great post. I was checking constantly this weblog and I am inspired!
    Extremely helpful info specially the ultimate part 🙂
    I deal with such info a lot. I used to be seeking this certain info for a long time.
    Thanks and good luck.

  2. Hi there! This post could not be written any better!
    Reading this post reminds me of my previous room mate! He always
    kept chatting about this. I will forward this post to
    him. Pretty sure he will have a good read. Thank you for sharing!

  3. I’m really impressed with your writing skills
    and also with the layout on your blog. Is
    this a paid theme or did you customize it yourself?

    Anyway keep up the nice quality writing, it’s rare to see a nice blog like this one nowadays.

  4. Hi, i think that i saw you visited my website thus i came
    to “return the favor”.I am attempting to find
    things to enhance my website!I suppose its ok to use some of your ideas!!

  5. magnificent publish, very informative. I’m wondering why the opposite specialists of this sector don’t notice this.
    You must proceed your writing. I’m sure, you’ve a huge readers’ base already!

  6. Hello There. I found your weblog using msn. This is an extremely
    well written article. I’ll be sure to bookmark it and return to read more of your
    useful information. Thank you for the post.
    I will certainly comeback.

  7. Thanks for one’s marvelous posting! I truly enjoyed
    reading it, you may be a great author.I will be sure to bookmark your blog and will eventually come back later in life.

    I want to encourage that you continue your great
    work, have a nice holiday weekend!

  8. Hello! I just wanted to ask if you ever have any problems
    with hackers? My last blog (wordpress) was hacked
    and I ended up losing several weeks of hard work due to no back up.
    Do you have any methods to protect against hackers?

  9. I am really impressed with your writing talents and also with the
    structure on your weblog. Is that this a paid theme or did you
    modify it your self? Anyway keep up the excellent quality writing, it’s uncommon to look a great weblog like
    this one today..

  10. Spot on with this write-up, I seriously believe this web site needs much more attention. I’ll probably be back again to read through more,
    thanks for the information!

  11. Hola! I’ve been following your web site for a long time now and finally got the
    bravery to go ahead and give you a shout out from Lubbock Tx!
    Just wanted to tell you keep up the excellent work!

  12. Hello would you mind letting me know which web host you’re using?
    I’ve loaded your blog in 3 completely different
    internet browsers and I must say this blog loads a
    lot quicker then most. Can you suggest a good web hosting
    provider at a honest price? Kudos, I appreciate it!

  13. Amazing blog! Is your theme custom made or did you download it from somewhere?
    A design like yours with a few simple tweeks would really make my
    blog shine. Please let me know where you got your theme.
    With thanks

  14. Good day! This post could not be written any better!

    Reading this post reminds me of my good old room mate!
    He always kept talking about this. I will forward this page
    to him. Fairly certain he will have a good read.

    Thank you for sharing!

  15. Pretty nice post. I simply stumbled upon your blog and wanted to mention that
    I’ve really enjoyed surfing around your blog posts.

    After all I’ll be subscribing on your rss feed and I’m hoping you write again very soon!

  16. Greetings from California! I’m bored to death at work so I decided to check out your blog
    on my iphone during lunch break. I really like the knowledge you provide here and can’t wait to take a look
    when I get home. I’m shocked at how quick your blog
    loaded on my phone .. I’m not even using WIFI, just 3G .. Anyhow, great blog!

  17. Hey would you mind sharing which blog platform you’re
    working with? I’m going to start my own blog in the near future but I’m having a difficult time deciding
    between BlogEngine/Wordpress/B2evolution and Drupal.
    The reason I ask is because your design seems different then most
    blogs and I’m looking for something unique. P.S Apologies for
    getting off-topic but I had to ask!

  18. I used to be suggested this web site by my cousin.
    I’m not certain whether or not this put up is written by
    means of him as no one else know such certain approximately my
    difficulty. You’re amazing! Thanks!

  19. I like the helpful info you provide in your articles. I will bookmark your blog and check again here frequently.

    I am quite sure I’ll learn plenty of new stuff right here!
    Good luck for the next!

  20. Greetings I am so excited I found your website, I really found
    you by accident, while I was looking on Digg for something else, Regardless
    I am here now and would just like to say kudos for a tremendous post and
    a all round interesting blog (I also love the theme/design), I don’t have time to
    look over it all at the moment but I have bookmarked it
    and also added your RSS feeds, so when I have time I will be
    back to read much more, Please do keep up the awesome job.

  21. Hello! I realize this is kind of off-topic however I needed to
    ask. Does operating a well-established website such
    as yours take a massive amount work? I am brand
    new to running a blog but I do write in my journal on a
    daily basis. I’d like to start a blog so I will be able to share my personal
    experience and feelings online. Please let me know if you have
    any ideas or tips for new aspiring blog owners. Thankyou!

  22. I just couldn’t go away your website before
    suggesting that I extremely enjoyed the standard info a person provide for your
    guests? Is gonna be back often to investigate cross-check new posts

  23. Hi, i read your blog from time to time and i own a similar one and i
    was just curious if you get a lot of spam comments?
    If so how do you protect against it, any plugin or anything you can recommend?

    I get so much lately it’s driving me crazy so any assistance is very much appreciated.

  24. Great post. I was checking constantly this weblog and I am inspired!
    Extremely helpful information specifically the closing section :
    ) I deal with such information a lot. I was looking for this certain info for a
    very lengthy time. Thanks and best of luck.

  25. Can I just say what a comfort to discover someone who really knows what they’re talking about online.
    You definitely realize how to bring a problem to light and make it important.
    A lot more people should look at this and understand this side of the story.
    I was surprised you aren’t more popular since you definitely have
    the gift.

  26. Hi! I’m at work browsing your blog from my new iphone! Just wanted to say I
    love reading your blog and look forward to all your posts!
    Keep up the fantastic work!

  27. Simply desire to say your article is as surprising.
    The clarity for your submit is just excellent and i can think you’re knowledgeable on this subject.
    Well with your permission let me to grab your
    RSS feed to keep up to date with imminent post. Thanks one million and please
    keep up the rewarding work.

  28. An impressive share! I’ve just forwarded this onto a colleague who had been doing a little research on this.
    And he in fact ordered me breakfast because I stumbled upon it for him…
    lol. So allow me to reword this…. Thanks for the meal!!
    But yeah, thanks for spending time to talk about this subject
    here on your internet site.

  29. It’s the best time to make some plans for the future
    and it’s time to be happy. I have read this post and if I could I desire to suggest you
    some interesting things or advice. Perhaps you can write next
    articles referring to this article. I want to read more things about it!

  30. Hi there! This is kind of off topic but I need some guidance from an established blog.
    Is it very difficult to set up your own blog? I’m not very
    techincal but I can figure things out pretty fast. I’m thinking about creating my own but
    I’m not sure where to begin. Do you have any tips or suggestions?

    Cheers

  31. I have been surfing on-line greater than three
    hours nowadays, but I by no means discovered any interesting
    article like yours. It is lovely price sufficient for me.

    Personally, if all site owners and bloggers made good content as you probably did, the internet will be much more helpful than ever before.

  32. Great site you have here but I was curious about if you knew of any user discussion forums that cover the same topics
    discussed here? I’d really like to be a part of community where I can get comments from other experienced people that
    share the same interest. If you have any suggestions,
    please let me know. Kudos!

  33. I am not sure where you’re getting your information, but good
    topic. I needs to spend some time learning more or understanding more.
    Thanks for fantastic info I was looking for this information for my mission.

  34. Howdy, I think your web site may be having web browser compatibility issues.
    When I take a look at your web site in Safari, it looks
    fine but when opening in I.E., it’s got some overlapping issues.

    I merely wanted to give you a quick heads up! Apart from that,
    fantastic site!

  35. Good day! This is kind of off topic but I need some guidance from
    an established blog. Is it very difficult to set up your own blog?

    I’m not very techincal but I can figure things out pretty quick.
    I’m thinking about making my own but I’m not sure where to begin. Do you have any tips
    or suggestions? With thanks

  36. Thank you for any other informative site. Where
    else could I get that kind of information written in such
    an ideal way? I’ve a undertaking that I’m just now running on, and I’ve been at the look out for
    such information.

  37. Today, while I was at work, my cousin stole my apple
    ipad and tested to see if it can survive a 25 foot drop, just
    so she can be a youtube sensation. My apple ipad is now broken and she has 83
    views. I know this is totally off topic but I had to share it with someone!

  38. Hey I know this is off topic but I was wondering if you knew of any widgets I could add to my
    blog that automatically tweet my newest twitter updates.
    I’ve been looking for a plug-in like this for quite some time and was hoping maybe you would have some
    experience with something like this. Please let me know if you run into anything.
    I truly enjoy reading your blog and I look
    forward to your new updates.

  39. I like the valuable info you provide in your articles.

    I’ll bookmark your weblog and check again here regularly.
    I’m quite certain I will learn lots of new stuff right here!
    Best of luck for the next!

  40. I’m extremely impressed with your writing
    skills as well as with the layout on your blog. Is this a paid theme or did you customize it yourself?

    Either way keep up the excellent quality writing,
    it’s rare to see a nice blog like this one today.

  41. Hello, i think that i saw you visited my site so i came to “return the favor”.I’m attempting to find things to
    improve my site!I suppose its ok to use a few of your ideas!!

  42. I was suggested this website by way of my cousin. I am not certain whether or not this put up is written via him as no one else recognise such distinctive approximately my problem.
    You’re incredible! Thanks!

  43. May I just say what a comfort to discover somebody that genuinely
    understands what they’re talking about on the web. You
    definitely understand how to bring an issue to light and make it important.
    More and more people ought to read this and understand this side of the story.
    It’s surprising you are not more popular given that you
    certainly have the gift.

  44. Hello very nice site!! Man .. Beautiful ..
    Superb .. I will bookmark your web site and take the feeds also?
    I am satisfied to search out so many helpful information here in the post, we’d like
    work out extra techniques on this regard, thank you for sharing.
    . . . . .

  45. It is the best time to make some plans for the future and it is
    time to be happy. I’ve read this post and if I could I want to suggest you some interesting things or
    suggestions. Maybe you could write next articles referring to
    this article. I want to read more things
    about it!

  46. Excellent beat ! I would like to apprentice while you amend your site, how can i subscribe for a blog web
    site? The account aided me a acceptable deal. I had been a little bit acquainted of this your
    broadcast offered bright clear idea

  47. What’s up everyone, it’s my first visit at this website,
    and piece of writing is truly fruitful in support of me, keep up posting such articles or reviews.

  48. Hmm is anyone else having problems with the pictures on this blog loading?
    I’m trying to find out if its a problem on my end or if it’s the blog.
    Any feed-back would be greatly appreciated.

  49. Hi there this is kinda of off topic but I was wanting to know if blogs use WYSIWYG editors or if you have to manually code with HTML.

    I’m starting a blog soon but have no coding experience so
    I wanted to get advice from someone with experience. Any help would be
    greatly appreciated!

  50. My spouse and I stumbled over here from a different web address and thought I might as well check things
    out. I like what I see so now i am following you. Look forward to going over your web page repeatedly.

  51. Excellent blog here! Also your website so much up fast! What web host are you the use of?
    Can I am getting your associate hyperlink to your
    host? I wish my site loaded up as quickly as yours lol

  52. Greetings, There’s no doubt that your site might be having internet browser compatibility issues.
    Whenever I look at your site in Safari, it looks fine but when opening in Internet Explorer,
    it has some overlapping issues. I simply wanted to provide you with a quick heads up!
    Aside from that, great blog!

  53. I absolutely love your website.. Excellent colors & theme.
    Did you develop this web site yourself? Please reply back as I’m attempting to
    create my very own site and would love to find out where you got this from
    or what the theme is called. Many thanks!

  54. Awesome blog! Do you have any tips and hints for aspiring writers?

    I’m planning to start my own site soon but I’m a little lost on everything.

    Would you suggest starting with a free platform like WordPress or go for
    a paid option? There are so many choices out there that I’m totally
    overwhelmed .. Any recommendations? Thanks a lot!

Leave a Reply

Your email address will not be published. Required fields are marked *