Last week, I attended Microsoft’s BUILD conference in Anaheim, where, among other things, Windows 8 details were rolled out to the Microsoft ecosystem. One of the most talked-about items was the Metro User Interface (UI), the end user face for the future of Windows. The last few days, I have been thinking about the implications of Metro on user interfaces beyond the obvious physical touch and gestures. I believe Metro UI has as much to do with voice control and air gestures as it does with physical touch.
Voice Control
Voice command and control has been a part of Windows for many generations. So why do I think Metro has anything to do with enabling widespread voice use in the future, and why do I think people would actually use this version? It’s actually quite simple. First, only a few voice command and control implementations and usage scenarios have been successful, and they all adopt a similar methodology and all come from the same company. Microsoft Auto voice solutions have found their way into Ford and Lincoln automobiles, branded SYNC, and drivers actually are using it. Fiat uses MS Auto technology as well. Microsoft Kinect implements a very accurate implementation for the living room using some amazing audio beamforming algorithms and a hardware four microphone array.
None of these implementations would be successful without establishing an in-context and limited dictionary. Let’s use Kinect as an example. Kinect allows you to “say what you see” on the TV screen, limiting the dictionary of words required to recognize. That is key. Pattern matching is a lot easier when you are matching 100s of objects versus 100K. Windows 8 Metro UI limits what users see on the screen, compared with previous versions of Windows, making that voice pattern matching all the easier. One final, interesting clue comes with the developer tablets distributed at BUILD. The tablets had dual microphones, which greatly assists with audio beam forming.
Air Gestures
Air gestures are essentially what Kinect users do with their hands and arms instead of using the XBOX controller. When players want to click on a “tile” in the XBOX environment, they place your hand in the air, hover over the tile for a few seconds, and it selects it. Kinect uses a camera array and an IR sensor to detect what your “limbs” are doing and associates it with a tile location on the screen. Note that no more than 8 tiles are shown on the screen at one time, increasing user accuracy.
Hypothetically, air gestures on Metro could take a few forms, and they could be guided by form factor. In “stand-up” environments with large displays, they would take a similar approach as Kinect does. In the future, displays will be everywhere in the house and air gestures would be used when touching the display just isn’t convenient or desired. I would like this functionality today in my kitchen as I am cooking. I have food all over my hands and I want to turn the cookbook page or even start up Pandora. I can’t touch the display, so I’d much rather do a very accurate air gesture.
In desk environments, I’d like to ditch the trackpad and mouse and just use my physical hand as a gesture methodology. It’s a virtual trackpad or gesture mouse. I use all the standard Metro gestures on a flat surface, a camera tracks exactly what my hand is doing and translates that into a physical touch gesture.
Conclusion
Microsoft introduced Metro as the next generation user interface primarily for physical touch gestures and secondarily for keyboard and mouse. Metro changes the interface from a navigation-centric environment with hundreds of elements on the screen to content-first with a very clean interface. Large tiles replace multitudes of icons and applets and the amount of words, or dictionary is drastically reduced. Sure this is great for physical touch, but also significantly improves the capability to enhance voice control and even air gestures. Microsoft is a leader in voice and air gesture with MS Auto and Kinect, and certainly could enable this in Windows 8 for the right user environments.
See Pat’s bio here or past blogs here.
Follow @PatrickMoorhead on Twitter and on Google+.
You have noted very interesting details! ps decent web site.
There is definately a lot to find out about this subject. I like all the points you made
Definitely, what a great blog and instructive posts, I definitely will bookmark your site.All the Best!
I think the admin of this site is really working hard for his website, since here every stuff is quality based data.
As I website owner I believe the content material here is really good , appreciate it for your efforts.
This website was… how do I say it? Relevant!! Finally I’ve found
something which helped me. Appreciate it!
whoah this blog is excellent i like studying your posts.
Stay up the great work! You realize, lots of
people are looking around for this information, you could help them
greatly.
Thank you for the auspicious writeup. It in fact was a amusement account it.
Look advanced to far added agreeable from you! However, how can we communicate?
Everyone loves what you guys tend to be up too.
This sort of clever work and coverage! Keep up the wonderful works guys I’ve incorporated you
guys to blogroll.
Hi everyone, it’s my first pay a quick visit at this web site, and paragraph is in fact fruitful in favor of me, keep
up posting these content.
Pretty section of content. I just stumbled upon your web site and in accession capital to say that I get in fact enjoyed
account your weblog posts. Anyway I will
be subscribing for your augment or even I achievement you get admission to
consistently fast.
Right away I am going to do my breakfast, later than having my breakfast coming over again to read further
news.
Hello there, You’ve done a great job. I will definitely digg it
and personally suggest to my friends. I’m confident they will be benefited from this web
site.
Wow, this piece of writing is fastidious, my sister is
analyzing such things, thus I am going to inform her.
Fantastic blog you have here but I was curious if you knew of any forums that cover the
same topics talked about here? I’d really like to be a part of online community where I can get advice from other experienced people that share the same interest.
If you have any suggestions, please let me know. Thanks!
Hiya! I know this is kinda off topic however , I’d figured
I’d ask. Would you be interested in trading links or maybe guest writing a blog post or vice-versa?
My website covers a lot of the same subjects as yours and I
believe we could greatly benefit from each other.
If you happen to be interested feel free to shoot me an e-mail.
I look forward to hearing from you! Fantastic blog
by the way!
Hey there! This is my first visit to your blog!
We are a team of volunteers and starting a new project in a community in the same
niche. Your blog provided us useful information to work on. You have done
a marvellous job!
Its like you read my mind! You seem to know a lot about this,
like you wrote the book in it or something. I
think that you could do with some pics to
drive the message home a little bit, but instead of that, this is fantastic blog.
A fantastic read. I will certainly be back.
Hey There. I found your weblog the usage of
msn. That is an extremely smartly written article.
I will make sure to bookmark it and come back to read extra of your helpful
information. Thank you for the post. I will definitely return.
magnificent publish, very informative. I wonder why the opposite specialists of this sector don’t understand this.
You should proceed your writing. I am sure, you have a great
readers’ base already!
If you desire to obtain a good deal from this paragraph then you have to apply such techniques to your won webpage.
Like other IDR options, the remaining balance of your
student lon is forgiven just after 20 to 25 years of payments.
Feel free to visit my site … 무서류대출
Wow, marvelous weblog format! How long have you ever been blogging for?
you made blogging look easy. The whole look of
your website is great, as well as the content!
Does your blog have a contact page? I’m having a tough
time locating it but, I’d like to shoot you an email.
I’ve got some creative ideas for your blog you might be interested in hearing.
Either way, great website and I look forward to seeing it improve over time.
Every weekend i used to go to see this web page, for
the reason that i want enjoyment, for the reason that this this site conations in fact fastidious funny information too.
Great article, just what I was looking for.
I read this paragraph completely regarding the resemblance of hottest and previous technologies, it’s awesome article.
It’s awesome to pay a quick visit this web site and reading the views of all friends regarding this post, while I am also
eager of getting familiarity.
It’s an amazing piece of writing designed for all the internet visitors; they will get
benefit from it I am sure.
Thanks for the good writeup. It if truth be told was once a enjoyment account it.
Glance complicated to more delivered agreeable from you!
However, how could we be in contact?
I am really loving the theme/design of your web site.
Do you ever run into any browser compatibility problems?
A number of my blog audience have complained about
my site not operating correctly in Explorer but looks great in Opera.
Do you have any recommendations to help fix this problem?
Hi there, I found your site by way of Google whilst searching for a similar subject, your site came up, it
appears great. I have bookmarked it in my google bookmarks.
Hi there, just was aware of your weblog thru Google, and located that
it is really informative. I’m gonna be careful for brussels.
I’ll appreciate for those who continue this in future.
A lot of other folks will probably be benefited out of your writing.
Cheers!
Hello! Someone in my Myspace group shared this website with
us so I came to take a look. I’m definitely loving the information. I’m bookmarking and
will be tweeting this to my followers! Fantastic blog
and superb style and design.
I’ve been exploring for a bit for any high-quality articles or blog posts in this kind of house .
Exploring in Yahoo I ultimately stumbled upon this web site.
Reading this info So i am satisfied to convey that I’ve an incredibly good uncanny feeling I came upon just what
I needed. I such a lot certainly will make sure to don?t disregard this website and provides it
a glance on a continuing basis.
Ahaa, its fastidious discussion on the topic of this article here at this weblog,
I have read all that, so now me also commenting here.
I know this if off topic but I’m looking into starting my
own weblog and was curious what all is needed to get setup?
I’m assuming having a blog like yours would cost a pretty
penny? I’m not very web smart so I’m not 100% positive.
Any tips or advice would be greatly appreciated. Kudos
Hi, yup this article is genuinely good and I have learned lot of things from
it concerning blogging. thanks.
Hi to all, how is all, I think every one is getting more from this website, and your views are
fastidious in favor of new visitors.
Hey there, You have done a fantastic job. I will definitely digg it and personally suggest to
my friends. I’m sure they will be benefited from this website.
hi!,I rеally like your writing so much! share we kеep
ᥙр a correspondence extra approximately your post on AOL?
I need a spеcialist in this space to ѕolve my problem.
May be that is you! Loοking ahead to peer you.
Players double their money almost 48% of thee time when bettibg
on red/black, odd/even, or higher/low.
Here is my website … 카지노사이트순위
Hi there to every body, it’s my first pay a visit of this web site; this
website carries remarkable and really good information in support of visitors.
Thankfulness to my father who stated to me regarding this webpage, this website is actually remarkable.
It’s impressive that you are getting ideas from this piece of
writing as well as from our argument made at this
place.
This website was… how do you say it? Relevant!!
Finally I’ve found something that helped me.
Thanks a lot!
excellent publish, very informative. I’m wondering why the opposite experts of this sector do not understand this.
You should proceed your writing. I’m sure, you have a huge readers’ base already!
Oh my goodness! Awesome article dude! Thank you, However
I am encountering difficulties with your RSS. I don’t know why
I am unable to join it. Is there anyone else getting identical RSS problems?
Anyone that knows the solution will you kindly respond?
Thanx!!
Sweet blog! I found it while surfing around on Yahoo News.
Do you have any suggestions on how to get listed
in Yahoo News? I’ve been trying for a while but I never seem to get there!
Cheers
Incredible points. Sound arguments. Keep up the great effort.
Pretty! This has been a really wonderful article.
Many thanks for supplying this information.
I like the valuable information you provide in your articles.
I’ll bookmark your blog and check again here frequently.
I am quite sure I’ll learn many new stuff right here!
Good luck for the next!
Thank you for the good writeup. It in fact was a amusement account it.
Look advanced to far added agreeable from you! However,
how can we communicate?
I loved as much as you will receive carried out right here.
The sketch is tasteful, your authored material stylish.
nonetheless, you command get got an shakiness over that you wish be delivering
the following. unwell unquestionably come more formerly again since exactly the same nearly very often inside case you
shield this increase.
It’s going to be end of mine day, however before finish I am reading this wonderful paragraph to improve my knowledge.
For latest information you have to go to see world wide web and on internet I
found this web page as a finest site for hottest updates.
Hmm is anyone else encountering problems with the images on this
blog loading? I’m trying to find out if its a problem on my end or if it’s the blog.
Any responses would be greatly appreciated.
My brother recommended I might like this web site.
He was entirely right. This post actually made my day. You
can not imagine just how much time I had spent for this information! Thanks!
Nice post. I learn something new and challenging on sites
I stumbleupon every day. It will always be helpful to read through content from other writers
and practice a little something from their web sites.
Hi friends, pleasant paragraph and good arguments commented at this place, I
am really enjoying by these.
Highly energetic blog, I liked that a lot. Will there
be a part 2?
You really make it appear so easy along with your presentation but I in finding this topic to be actually
one thing which I believe I would never understand.
It sort of feels too complicated and very huge for me. I’m taking a look forward for
your next put up, I’ll attempt to get the cling of it!
At this time it sounds like Expression Engine is the best blogging platform available right now.
(from what I’ve read) Is that what you are using on your blog?
It’s great that you are getting thoughts from this paragraph as well as from our
argument made at this time.
Thank you a lot for sharing this with all folks you actually understand what
you are speaking about! Bookmarked. Kindly additionally talk
over with my site =). We can have a link change contract between us
I visited many sites however the audio feature for audio songs current at this website is really
wonderful.
Hey there, You have done an excellent job.
I will certainly digg it and personally
recommend to my friends. I am sure they will be benefited
from this website.
Ahaa, its pleasant conversation concerning this paragraph at this place at this blog, I have read all that,
so now me also commenting at this place.
Thanks for the auspicious writeup. It in reality used
to be a amusement account it. Look complex to more delivered agreeable from you!
By the way, how can we communicate?
If some one needs expert view on the topic of blogging and site-building afterward i advise him/her to pay a quick visit this blog, Keep
up the nice work.
Hey there I am so grateful I found your webpage, I really found you
by error, while I was looking on Askjeeve for something else, Anyhow I am here now and would just like to say cheers for
a fantastic post and a all round thrilling blog (I also love the theme/design), I don’t have time to browse it
all at the minute but I have bookmarked it and also included your RSS feeds,
so when I have time I will be back to read much more, Please do
keep up the awesome b.
Hi, for all time i used to check weblog posts here in the early hours in the dawn, because i love to find
out more and more.
Yesterday, while I was at work, my sister stole my iphone and tested
to see if it can survive a thirty foot drop, just so she can be a
youtube sensation. My apple ipad is now broken and she has 83 views.
I know this is entirely off topic but I had to share it with someone!
Remarkable! Its genuinely amazing piece of writing, I have got much clear idea on the topic of from this piece of writing.
I don’t even know how I stopped up here, but I assumed this submit was once great.
I do not recognize who you’re but definitely you’re going to a well-known blogger should
you aren’t already. Cheers!
Hello! I know this is kinda off topic but I’d figured I’d ask.
Would you be interested in exchanging links or maybe guest writing a blog post or vice-versa?
My blog addresses a lot of the same subjects as yours and I think we could greatly benefit from each
other. If you happen to be interested feel free
to send me an email. I look forward to hearing from you!
Superb blog by the way!
Hi there! Quick question that’s totally off topic. Do you know how
to make your site mobile friendly? My weblog looks weird when viewing from my apple iphone.
I’m trying to find a theme or plugin that might be able to fix this problem.
If you have any suggestions, please share. Thank you!
What’s Taking place i’m new to this, I stumbled upon this I’ve found
It absolutely helpful and it has aided me out loads.
I’m hoping to contribute & aid other customers
like its aided me. Great job.
Do you have any video of that? I’d care to find out more details.
Hello to all, how is the whole thing, I think every one is getting more from this web page, and your
views are good in favor of new viewers.
Fantastic website. Plenty of helpful information here.
I am sending it to some pals ans also sharing in delicious.
And obviously, thanks to your effort!
I wanted to thank you for this very good read!! I definitely loved every little
bit of it. I have you saved as a favorite to check out new stuff you post…
I’m curious to find out what blog platform you’re using?
I’m experiencing some small security issues with my
latest site and I’d like to find something
more risk-free. Do you have any solutions?
Fantastic items from you, man. I’ve bear in mind your stuff previous to and you’re just too great.
I actually like what you’ve received here, really like what you are saying and the way in which by which you say it.
You make it entertaining and you continue to care for to stay it wise.
I cant wait to learn far more from you. That is actually a wonderful web site.
Hello very cool blog!! Man .. Beautiful .. Wonderful ..
I will bookmark your site and take the feeds additionally?
I’m satisfied to seek out so many useful information here within the
submit, we’d like work out extra strategies on this regard, thanks
for sharing. . . . . .
I have been browsing online more than 3 hours today, yet I never found any
interesting article like yours. It’s pretty worth enough for me.
In my view, if all web owners and bloggers made good content
as you did, the internet will be a lot more useful than ever before.
The Fair Labor Requirements Actt (FLSA) does not
define complete-time employment or part-time employment.
My web page – Bitcoin-Chargeback.Net
The советы чрезвычайно полезный.
Посетите также мою страничку глаз бога телеграмм
I simply could not go away your web site before suggesting that I
really loved the standard info an individual supply
to your guests? Is gonna be back steadily in order to
investigate cross-check new posts