Bringing Vision to the Edge

In case you haven’t been paying attention recently, one of the hottest topics in the tech industry is the concept of “the edge.” Virtually every major tech company has been talking about their strategic approach to this new method of computing recently, and the announcements are bound to keep coming.

Standalone PCs are an example of edge devices, but when most companies talk about the edge, they really mean things like drones, smart home gadgets, sensor-based industrial devices, autonomous cars, and so on. While these devices can—and often do— connect to the Internet, they can also compute independently, courtesy of built-in x86 processors or Arm-based microcontrollers, and embedded software.

At Microsoft’s Build developer conference in Seattle, the company had a particularly strong focus on what they term the “intelligent edge” and touted it as one of the next major revolutions in computing. The “intelligent” moniker stems from the use of AI, machine learning and other advanced computing concepts in these edge devices, bringing a whole new level of capability—and attention—to them.

As appealing as the concept of intelligent edge computing may be, however, there have been some real challenges in enabling the potential of these new devices. The biggest issue is around creating software to run on the often novel architectures used inside of them. To that end, Microsoft has been making a great deal of effort both on the platform side, as well as the application development side.

Because there are a wide range of different devices with various levels of sophistication and diverse amounts of hardware, Microsoft now has several platform choices, including Windows 10 IoT Core, Windows 10 IoT Enterprise, and Azure IoT Edge Runtime, which the company is now open-sourcing. The Azure Runtime offering, in particular, is ideally suited for the enormous array of smart products appearing everywhere from our homes to hospitals to factories, farms and more.

Technically, the Runtime is collection of programs that runs on top of the various types of Linux, Windows or other embedded operating systems found in these smart devices, hence the name. What it does is create a common platform for which applications can be created. Without the consistent capabilities enabled by the Azure IoT Edge Runtime, developers would have to create new or different versions of their applications for each potential hardware/software combination—an impossible task.

In addition to this common base, Microsoft’s Azure IoT Edge Runtime leverages the same cloud-based computing platform offered by “regular” Azure that the company uses in its cloud computing offerings. This is very important for developers because it means they can use the same development tools and methodologies that they use for cloud-based programming models, including containers, to create software for these intelligent edge devices. This, in turn, makes it much easier for companies to build edge applications without needing people with entirely new types of programming skills.

Microsoft used their Azure platform approach to build and release a set of AI-based computer vision processing tools called Custom Vision that can leverage cameras and Qualcomm-based image processing silicon on edge devices. Part of what Microsoft calls Azure Cognitive Services, Custom Vision essentially brings “eyes” to the edge, letting companies build applications that react to visual information that these smart edge devices see—without needing a connection to the cloud.

A great example of this showed off Microsoft’s new partnership with DJI, the world’s largest drone maker. Using a DJI drone running Custom Vision on Azure Edge IoT Runtime, the two companies showed how you could create an app that would be capable of seeing and visually annotating (in real time) anomalies or other faults on a pipe that was being inspected by a drone. Microsoft is also working with DJI to build a Software Development Kit (SDK) for Windows 10 devices that allows for the creation of flight control and real-time vision or sensor-based applications for DJI drones.

With Qualcomm, Microsoft announced a vision AI developer kit that uses Azure Machine Learning services to create vision-aware applications for edge devices that can be accelerated by Qualcomm silicon and the Qualcomm Vision Intelligence Platform and Qualcomm AI Engine software tools that they have created. In practical terms, this means that developers could create applications such as smart home visual doorbells or security cameras equipped with certain Qualcomm chips to recognize specific objects, or individuals, and react appropriately—such as providing security notifications only if a person isn’t “known” to the household, and so on.

What’s particularly intriguing about this example, is that it’s one of the first of what will likely be many AI edge applications that can take advantage of the unique characteristics of certain types of silicon. Look for many more accelerated AI edge applications to come.

The potential opportunities with intelligent edge computing are already enormous, and that’s why there is now tremendous excitement within the tech industry about how these technologies can be applied. There’s still several hurdles ahead and a fair amount of work involved, but real progress is being made. As Microsoft demonstrated, we’re starting to see some critical strategic steps towards simplification on what can be a very complex topic. As a result, it shouldn’t be long before a much broader range of developers can start leveraging capabilities such as vision on the edge. When they do, the kinds of applications and services we can enjoy are going to be amazing.

Published by

Bob O'Donnell

Bob O’Donnell is the president and chief analyst of TECHnalysis Research, LLC a technology consulting and market research firm that provides strategic consulting and market research services to the technology industry and professional financial community. You can follow him on Twitter @bobodtech.

1,086 thoughts on “Bringing Vision to the Edge”

  22. Heya terrific website! Does running a blog similar to this
    require a great deal of work? I have very little expertise in coding however I had been hoping to
    start my own blog soon. Anyhow, if you have any recommendations or tips for new blog owners please share.
    I know this is off topic nevertheless I just wanted to ask.
    Appreciate it!

    Reply

  28. Having read this I thought it was rather enlightening. I appreciate
    you finding the time and effort to put this information together.

    I once again find myself personally spending way too
    much time both reading and commenting. But so what, it was
    still worthwhile!

    Reply

  78. I do not know whether it’s just me or if perhaps everybody else encountering problems
    with your site. It appears as if some of the written text in your content are running off the screen. Can somebody else please provide feedback
    and let me know if this is happening to them as well? This could be a problem with my
    browser because I’ve had this happen previously.
    Appreciate it

    Reply

  102. Thanks for helping me to achieve new concepts about computer systems. I also possess the belief that one of the best ways to maintain your notebook computer in prime condition is with a hard plastic-type case, and also shell, that suits over the top of your computer. A lot of these protective gear usually are model distinct since they are manufactured to fit perfectly across the natural housing. You can buy them directly from the seller, or from third party sources if they are for your notebook computer, however not all laptop will have a shell on the market. Once again, thanks for your tips.

    Reply

  106. What an insightful and meticulously-researched article! The author’s thoroughness and capability to present complicated ideas in a digestible manner is truly praiseworthy. I’m totally enthralled by the breadth of knowledge showcased in this piece. Thank you, author, for sharing your expertise with us. This article has been a game-changer!

    Reply

  237. Hi there would you mind sharing which blog platform you’re working
    with? I’m looking to start my own blog soon but I’m having
    a hard time selecting between BlogEngine/Wordpress/B2evolution and Drupal.
    The reason I ask is because your layout seems different then most blogs and I’m looking for something unique.
    P.S My apologies for getting off-topic but I had to ask!

    Reply

  248. I?ve read several good stuff here. Definitely value bookmarking for revisiting. I wonder how much attempt you place to make any such magnificent informative site.

    Reply

  330. Thank you for every other informative web site.

    Where else may I am getting that kind of info written in such a perfect means?
    I have a venture that I’m simply now operating on, and
    I’ve been at the glance out for such info.

    Reply

  595. Hey! This is kind of off topic but I need some advice from an established blog.

    Is it difficult to set up your own blog? I’m not very techincal but I can figure things out
    pretty quick. I’m thinking about making my own but I’m not sure
    where to begin. Do you have any points or suggestions?
    Appreciate it

    Reply

  1048. I?m not sure where you are getting your info, but great topic. I needs to spend some time learning more or understanding more. Thanks for great info I was looking for this information for my mission.

    Reply

Leave a Reply

Your email address will not be published. Required fields are marked *