Microsoft researchers pursue the big questions about what the world will be like in the future and the role technology will play. Not only do they take on the responsibility of exploring the long-term vision of their research, but they must also be ready to react to the immediate needs of the present. This year in particular, they were asked to use their roles as futurists to address pressing societal challenges.
In early 2020, as countries began responding to COVID-19 with stay-at-home orders and business operations moved from offices into homes, researchers sprang into action to identify ways their skills and projects could help while also making personal and professional adjustments of their own. In some cases, they pivoted to directly address the pandemic. A team from Microsoft Research Asia developed the COVID Insights website to promote scientific analysis and understanding of the disease, while the Socially Intelligent Meetings program expanded its work in telepresence technologies to include the Meetings During COVID-19 project. From responses provided by employee volunteers, these researchers are piecing together the effects of taking meetings almost entirely via screens.
Researchers also turned to the wider research community in their pursuit of solutions that would allow people to persevere in these challenging times and prosper beyond them with academic collaboration around topics related to pandemic preparedness andin Augustthe New Future of Work symposium. A series of reports conducted by Microsoft considers a variety of information, including research from throughout the company, in studying worker productivity and well-being. The insights are leading to enhancements in Microsoft productivity tools that are available now and in the near future, such as Together mode, virtual commutes, and meditation experiences in Teams (the latter two features roll outnext year).
When a major crisis strikes the world, science and technology research is almost always of paramount importance in response, rehabilitation, andultimatelycreating resilience for the future. Today, the people of Microsoft Research are proving to be critical in dealing with climate calamities, such as famines and major wildfires; global health threats, such as that posed by the COVID-19 pandemic; the weakening of democratic institutions posed by misinformation and insecure voting infrastructure; wildlife extinction caused by pollution and illegal poaching; and more. While our main mission continues to be grounded in fundamental, long-term research, contributing to societal resilience is also a growing element in how we ensure a good future for all.
Meanwhile, research started before the pandemic feels increasingly significant. In April, two papers with implications on workplace well-being and hybrid scenarios, respectively, were presented on the conference circuit. Researchers from the productivity group developed models that leverage digital activities and other data to suggest appropriate times for workers to switch tasks and take breaks, while researchers in the United Kingdom and Canada built a two-way telepresence system to enhance collaboration among remote and local individuals. In December, Eyal Ofek shared how advances in virtual reality could be used to maximize our workspaceswherever they may beduring a Microsoft Research webinar.
And while a lot has been said about work in these unprecedented times, research into the dynamics of epidemics themselves moved forward. In September, it was announced that Microsoft Premonition, a system leveraging robotics and genomics to track pathogens responsible for widespread disease, is being made available to additional partners.
While research relevant to the pandemic has been of the highest importance this year, Microsoft researchers took their research in a broad range of directionsprogress in AI, healthcare technology, and security advanced rapidly. Below is a selection of highlights that came out of Microsoft Research in 2020.
This year saw significant breakthroughs for creating AI that is substantially more powerful, scalable, and readily integrated into Microsoft products. The AI at Scale initiative, born from a cornucopia of work in the area in 2020, combines large-scale models, AI supercomputing, and teams of researchers and product engineers working together to implement AI in a variety of Microsoft products and infrastructure.
The Microsoft Turing teams natural language generation and natural language representation models went from being announced in February to implementation into products like Microsoft Word and Bing, ultimately with one model setting a record on the Xtreme benchmark for cross-lingual transfer learning in October.
Helping to power large AI models, the DeepSpeed library with Zero Redundancy Optimizer (ZeRO) also underwent major transformations since its introduction in February. The library initially included support for training models up to 100 billion parameters in size, but by the end of the year, the library was capable of training models up to 1 trillion parameters while also introducing new methods to train models with lower resource costs. On the testing side of natural language generation and understanding, researchers released XGLUE, a benchmark dataset for gauging models zero-shot cross-lingual transfer capabilities across 19 different languages.
In the realm of vision and language pretraining (VLP), Microsoft researchers released OSCAR (Object-Semantics Aligned Pretraining) in May, leading to a novel framework with state-of-the-art performance on six different vision-and-language tasks. In October, researchers collaborating with Azure Cognitive Services created VIVO (Visual Vocabulary Pretraining), which resulted in a framework for novel object captioning that achieved state of the art and even surpassed human performance on the novel object captioning (nocaps) benchmark.
Technologies like Microsoft Floating Point, used in the Project Brainwave architecture, are helping to lower the cost of deep neural network (DNN) inference. Improvements like this allow Microsoft to power large AI models on the scale needed to empower Microsoft users around the world. Head over to the AI at Scale page to learn about some of the many other projects undertaken at Microsoft Research to advance large-scale AI this year.
As AI techniques have made leaps and bounds, researchers are undertaking the crucial task of examining responsible practices in AI, which include accessibility, fairness, and interpretability. Methods for understanding and explaining what AI does, as well as assessing fairness at all stages of development, are big trends in this area.
Building and fielding AI responsibly is a challenging, cross-disciplinary research area. Our progress over the last year builds on insights from previous years with an emphasis on applying our research and learnings to developing usable methods and tools that can help engineers design and develop trustworthy AI systems. Weve made strong progress, but our journey is far from over.
In January, researchers shared their insights into how societal bias in historical data used to train algorithmic decision-making systems could be reinforced by future data and explored two interventions that could help to correct this bias. Meanwhile, another team of researchers developed a framework and open-source library for generating explanations that individuals adversely impacted by system decisionssuch as those whove been denied a loan or insurancecan use to work toward a positive determination. These counterfactual explanations can also be used for system evaluation, becoming a tool for practitioners. Builders of AI tech are at the center of two papers recognized at CHI 2020. Hanna Wallach, Jennifer Wortman Vaughan, and their co-authors sought to empower the group with an actionable checklistco-designed with practitionersfor discussing and addressing fairness throughout the AI life cycle and an examination into the effectiveness of available interpretability tools based on an interview study and survey with practitioners. Wortman Vaughan explored understanding AI systems in a January webinar.
Collaboration with and inclusion of those closest to the tech was also happening on the accessibility front, where advances in computer vision and natural language processing (NLP) are allowing researchers to improve AI for alt text generation and object identification. Researchers worked with people who are blind or have low vision to understand how to improve the alt text generated by automated systems and to develop a dataset for personalized object recognition. In a March webinar, Dr. Danna Gurari and Dr. Ed Cutrell discussed developing impactful vision systems and the role dataset challenges play. Meanwhile, a partnership with people living with and affected by amyotrophic lateral sclerosis (ALS) laid the groundwork for Expressive Pixels, a platform for creating LED-display animations that simultaneously offers opportunities for creating, learning, and communicating in new ways.
Responsible AI requires that the talent, knowledge, and experiences of those developing it are as diverse as the people using it. Microsoft is committed to clearing a path into the industry for underrepresented groups, including sponsoring and participating in events like the Black in AI, Queer in AI, and Women in Machine Learning NeurIPS workshops and creating professional and academic opportunities through Microsoft Research. To have your work supported or to join the Microsoft Research team, see our Academic Programssuch as the Dissertation Grant for PhD students from underrepresented groups (proposals will start to be accepted in February)and open research positions and internships.
As technology becomes more embedded in and essential to peoples lives, creating new technologies for 2020 and beyond demands deeper consideration of peoples privacy, security of the web and internet-connected devices, and safeguards on human rights. This year, researchers introduced ElectionGuard, a system that applies homomorphic encryption to both secure peoples votesso that no one else can see how they votedand allow voters to verify their votes are properly counted. The system was piloted in Fulton, Wisconsin, in February, where election officials tested machines running ElectionGuard; the final tally was gathered through traditional paper ballot methods. The code for ElectionGuard was made open source, and Josh Benaloh presented on the technology in a webinar in April.
Cryptography was also explored from a post-quantum angle. Future quantum computers could decipher even the most secure current cryptographic techniques, so researchers in this space have begun to investigate new methods for making the cryptography of the future equal to the task of protecting peoples privacy and information in a world where quantum computers far exceed the power of supercomputers now. These methods can also keep information more secure in the present computing landscape. To learn more about the world of post-quantum cryptography, check out webinars from Craig Costello and Christian Paquin below.
Researchers and engineers released resources and technologies to uncover security vulnerabilities and identify potential attacks. In March, Patrice Godefroid made a case for developers adding fuzzing to their toolkit to detect vulnerabilities in software through automated testing, and in November, a team introduced RESTler, the first stateful REST API fuzzing tool for automatically testing and finding security and reliability bugs in cloud/web services through their REST APIs. Researchers also released Project Freta, a service for Linux systems that detects evidence of OS and sensor sabotage by analyzing a memory snapshot to find rootkits and other malware.
The importance of healthcare technology came into especially strong focus as this year progressed. In many instances, projects already underway were particularly timely, as was the case with investigations into making online mental health interventions more effective through data analysis, the potential for personalizing those mental health interventions via subtyping, improving mental health helpline technology, and using chat apps to help facilitate patient care in hospitals.
In late August, researchers announced a method for biomedical NLP pretraining that could enable researchers to stay up to date with the continually increasing amount of new scientific knowledge in the field by using NLP to quickly identify and cross-reference important findings. Their model, PubMedBERT, obtained state-of-the-art results in several biomedical applications.
As medical and mental health professionals adapt how they provide care for people in the 21st century, researchers intend to continue to create technology that complements experts skills.
Reinforcement learninga framework in which ML systems learn via interactions with their environmenthas long been an active area at Microsoft Research, and the drive to advance RL has increased thanks to the approachs success in Microsoft products and services. Researchers are tackling RL both empirically and theoretically, and their enthusiasm and efforts were on full display in 17 NeurIPS-accepted papers that pursued a variety of promising avenues.
Two papers designed methods for leveraging existing logged datasets in an area of RL that uses past experience to give agents a leg up prior to deployment, while separate work brought strategic exploration to the popular gradient decentbased approaches for RL. Other work highlighted a trend in learning good representations for agents observations. In their respective papers, Akshay Krishnamurthy, Devon Hjelm, and their coauthors incorporated auxiliary prediction problems to discover representations that simplify downstream learning tasks. Earlier in the year, researchers deployed Transformers in several ways to develop Working Memory Graph, an RL agent capable of more efficient learning when advanced reasoning is involved, such as future planning in the game Sokoban.
Games make great arenas in which to train agents for use in gaming or in more general applications. In August, Sam Devlin and Katja Hofmann shared work done as part of a new collaboration with game developer Ninja Theory around enhancing gaming with RL agents capable of teamwork with human counterparts. Also during the summer, researchers kicked off the second iteration of MineRL, a sample-efficient RL challenge based on the platform Project Malmo, which uses Minecraft as a playground for AI experimentation.
For an overview of RL, check out Hofmanns webinar, and to learn about one RL framework in particular, multi-armed bandits, read this introductory text on the subject. And if you can hardly wait to learn more, fret notyou can start the new year off strong with Reinforcement Learning Day 2021 in January. Until then, check out content, including videos, from last years event.
On the winding road of this year in technology research, its only fitting that we loop back to AI, which researchers sought to optimize from multiple perspectives. One perspective considered how AI has evolved alongside the game of chess. In the last few decades, AI has advanced to a point where it can spar with and succeed against the best players in the world. This led researchers to shift their focus from how to make AI better at chess to how chess-playing AI can be refined to better match human playing styles and skill levels. As a result, researchers created Maia, a Leela Chess Zerobased engine that matches human play more closely than previously achieved.
To ramp up neural architecture search (NAS) research, ARCHAI was introduced to make work in this area more usable, reproducible, and unified. The framework allows standard NAS algorithms to be executed with a single command line, making it easy to experiment with and add new algorithms and datasets. Researchers also proposed an autoML approach to compare any two classification datasets, even if their labels arent directly comparable, called Optimal Transport Dataset Distance. If youre interested in learning more about autoML, check out the Directions in ML Speaker Series, which kicked off in July.
The Semantic Machines research team introduced a new framework for conversational AI in which dialogues represented as dataflow graphs make AI more flexible in its ability to adapt to the natural flow of conversation. Along with this, they released the largest, most complex task-oriented dialogue dataset to help advance conversational AI research more broadly.
Computer vision moved forward on many fronts in 2020. Researchers created a visual question answering (VQA) evaluation score in their work to understand the connection between visual understanding and neuro-symbolic reasoning. The score betters prior evaluation methods by isolating reasoning from perception in VQA models with a differentiable first-order logic framework. Researchers also investigated how two concepts integral to human reasoning, locality and compositionality, can help to enhance zero-shot representation learning.
Researchers out of Microsoft Research Asia developed methods to improve visual recognition with HRNet and boost photo enhancement with two AI techniquesone that transfers high-resolution texture information to low-resolution images and another that uses variational autoencoders (VAEs) to restore old photos. Other advances in deep generative networks by included Optimus, FQ-GAN, and Prevalent, while researchers also found ways to extend adversarial robustness and training, concepts closely associated with GANs, to transfer learning and causal inference.
Finally, researchers are looking at a future AI landscape that is increasingly multimodal and interactive. However, engineering AI that uses multimodal streaming data in real time is time consuming because programming infrastructures in this area are lacking. Researchers built Platform for Situated Intelligence to provide an open-source framework for experimentation, development, and research in this area.
The above research represents a small portion of the great work that was enthusiastically pursued by dedicated researchers at Microsoft Research in 2020, and even if we were to consider all the work produced this year, it would still tell only part of a bigger research story at Microsoft.
In a new series of posts this year, we began connecting the dots to provide an overview of how the individual contributions of researchers and their collaborators are coming together to have a profound impact on customers and society at large. Our collection on responsible AI shows how researchers are upholding and advancing the Microsoft commitment to AI grounded in principles that put people first and benefit society, while our collection on reinforcement learning recounts the history of work in the field and its application to Microsoft products and services. Visit our collections archive for more.
2020 has been a year like no other, underscoring the importance of the relationship between research and resilience. As we look to the future, researchers are an important part of answering the big questions that will shape the direction of society. We have been inspired by the research communitys continued commitment to technological advancementsthose in direct response to these unprecedented times and those keeping research on all fronts moving forward. We wish you and yours a safe and healthy new year.
To stay up to date on all things research at Microsoft, follow ourblogand subscribeto ournewsletterand theMicrosoft Research Podcast. You can also follow us onFacebook,Twitter,YouTube, andInstagram.
- Overthinking the silence - Chessbase News - June 11th, 2021
- Jan Werle: Beat the King's Indian - Chessbase News - June 11th, 2021
- Alethea AI and artist Robert Alice launch Sothebys auction of the first intelligent NFT - VentureBeat - June 11th, 2021
- How Philipp Grubauer used blood, sweat and technology to launch the Avalanches Stanley Cup run: Ive never seen a goalie do that - The Denver Post - June 11th, 2021
- NBA playoffs 2021 - What could shift Jazz-Clippers and every conference semifinal series - ESPN - June 11th, 2021
- The Supercar/Hypercar Wars Continue, But The Roadster Still Has An Ace Up Its Sleeve - CleanTechnica - May 30th, 2021
- Slitherine announces a plethora of new wargames at 'Home of Wargamers 2021' - The Next Web - May 18th, 2021
- How Stupid Does Governor Whitmer Think Michiganders Are? - wbckfm.com - May 18th, 2021
- Mad pawns can save the day - Chessbase News - Chessbase News - May 5th, 2021
- Reality is irreversible - The Monthly - May 5th, 2021
- ASTRA Reveals 2021 Best Toys for Kids Finalists The Toy Book - The Toy Book - May 5th, 2021
- Is Bioelectricity the Key to Limb Regeneration? - The New Yorker - May 5th, 2021
- The ultimate staycation treat - charter a 1m superyacht, and it's based here in Gosport - Portsmouth News - May 5th, 2021
- Chess.com's New Events Feature, The Perfect Platform To Follow The Candidates - Chess.com - April 21st, 2021
- Turing AI: 'We can help develop a product in an eighth of the time, minimum' - FoodNavigator.com - April 21st, 2021
- The Machines Gambit - The Good Men Project - April 5th, 2021
- A sandwich, a beer and ... here's what you see on TV (and what to avoid) - Prudent Press Agency - April 5th, 2021
- Spurning the morsel - Chessbase News - April 5th, 2021
- Is AI Next in REI Education? - Think Realty - April 5th, 2021
- The IBM 305 Ramac: The secret grandfather of Deep Blue? - Chessbase News - March 9th, 2021
- Feeding the flames - Chessbase News - March 9th, 2021
- NEW - Andrew Martin: The Grnfeld Formula - Chessbase News - March 9th, 2021
- War Of The Wingmen: New Robot Fighters Promise To Transform Aerial Combat - Forbes - March 9th, 2021
- Businesses offer help as problems remain in Texas from winter storm - Yahoo News - February 20th, 2021
- Wet Start To The Weekend - Yahoo News - February 20th, 2021
- Chess and Artificial Intelligence (2) - Chessbase News - February 17th, 2021
- What is the secret of Wesley So's success? An interview - Chessbase News - February 17th, 2021
- Five Issues Washington Should Consider In Reviewing A Lockheed-Aerojet Merger - Forbes - February 17th, 2021
- Artificial Intelligence And The End Of Work - Forbes - February 17th, 2021
- Why Ricciardo said 'yes' to McLaren the second time they asked RaceFans - RaceFans - February 17th, 2021
- Opera Euro Rapid SF: Carlsen and So reach the final - Chessbase News - February 15th, 2021
- Letters: 'Darlington Borough Council has a terrible record of looking after heritage sites, maybe they shouldn't keep Locomotion No 1' - The Northern... - February 12th, 2021
- Fat Fritz 2.0 - The new number 1 - Chessbase News - February 10th, 2021
- 25 Years Ago, Chess Changed Forever When Deep Blue Beat Garry Kasparov - Slate - February 10th, 2021
- Chess In The COVID Era | Webster Kirkwood Times | timesnewspapers.com - Webster-Kirkwood Times, Inc. - February 10th, 2021
- 10 Things We Want From The Legend Of Zelda's 35th Anniversary - TheGamer - February 7th, 2021
- Travis Kelce is the best tight end in football. Just ask any NFL player. - The Union Leader - February 7th, 2021
- 120 things you probably didn't know were created by Black inventors | Venture - Daily Hive - February 6th, 2021
- Red Sox Truck Day approaches and theres a different feeling in the air - BoSox Injection - February 4th, 2021
- The future is augmented - The Bookseller - February 4th, 2021
- How to Use a Chess Engine? Your Quick & Effective Guide - February 3rd, 2021
- Stockfish+NNUE, Strongest Chess Engine Ever, To Compete In ... - February 3rd, 2021
- Top Chess Engine Championship - Wikipedia - January 30th, 2021
- Building My Own Chess Engine Andrew Healey - January 30th, 2021
- Stockfish Chess Engine Download - softpedia - January 30th, 2021
- Play Online Chess at Caissa's Web - January 30th, 2021
- Alto AMT Should it be back? - MotorOctane - MotorOctane - January 30th, 2021
- Does the rift in AI matter to marketing? - MarTech Today - January 30th, 2021
- Scientists say dropping acid can help with social anxiety and alcoholism - The Next Web - January 28th, 2021
- Meet Yash Aradhya, a Bengaluru Formula 4 racer and a recipient of the Pradhan Mantri Rashtriya Bal Puraskar - EdexLive - January 25th, 2021
- Dancing, vacuuming, learning: What's next for robots and their creators? - ASU Now - January 23rd, 2021
- Signature Theatre announces cast and dates for 'Simply Sondheim' review - DC Metro Theater Arts - January 23rd, 2021
- SwitchArcade Round-Up: 'Scott Pilgrim vs. The World', 'Shadow Gangs', and Today's Other New Releases and Sales - Touch Arcade - January 15th, 2021
- Their Uniforms Say Ohio State and Alabama. The Players Are From Everywhere. - The Wall Street Journal - January 13th, 2021
- Ziggurat Interactive Releases First Retro First Friday Pack Of 2021 - Bleeding Cool News - January 9th, 2021
- TV tonight: another day in paradise for detective Ralf Little - The Guardian - January 9th, 2021
- The Board Games Global Market is Expected to Grow at a CAGR of 13% Between 2021 to 2026 - Yahoo Finance - January 6th, 2021
- 50 Best TV Shows To Watch In 2021 - Highest Rated Television Series - OtakuKart - OtakuKart - December 29th, 2020
- Red Bull think they have secret weapon to catch Lewis Hamilton and Valtteri Bottas | F1 | Sport - TechnoCodex - December 23rd, 2020
- HBO's Industry creators and Myha'la Herrold break down season 1 finale - Entertainment Weekly - December 22nd, 2020
- Deals of the Week, December 11 to 18 Growth Business roundup - GrowthBusiness.co.uk - December 18th, 2020
- Turns Out Its Pretty Good: Doomscrolling - The Cut - December 18th, 2020
- A Letter to My Kids - The Good Men Project - December 15th, 2020
- Yakuza Remastered Collection On The Way For Xbox & PC - Bleeding Cool News - December 13th, 2020
- Hitman 3 Gets A New Trailer Showing Off The Features - Bleeding Cool News - December 9th, 2020
- Reflections on 40 years: thanks for the memories (we can remember) - NOLA.com - December 9th, 2020
- AMD Ryzen 7 5800X Review: The Pricing Conundrum - Tom's Hardware - December 8th, 2020
- AI has almost solved one of biologys greatest challenges how protein unfolds - ThePrint - December 8th, 2020
- Demis Hassabis interview: the kid from the comp who founded DeepMind and cracked a mighty riddle of science - The Times - December 6th, 2020
- Online Chess and Working from Home - Chessbase News - December 5th, 2020
- Full Fischer film in YouTube - Chessbase News - December 5th, 2020
- New C360 CEO Howard Wright Sees Broadcast Tech Putting Fans on the Field of Play - Sports Video Group - December 5th, 2020
- This is what would happen if a Hind took on a Cobra - We Are The Mighty - December 5th, 2020
- Hyundai Takes The Wraps Off Its E-GMP Electric Car Platform - CleanTechnica - December 3rd, 2020
- Top 9 Reasons to Rent an RV when you traveling - The Dubrovnik Times - December 3rd, 2020
- Akron flashback: Some childhood toys you never forget - Akron Beacon Journal - December 1st, 2020
- 24 Comments on GM is Paying Cadillac Dealers to Ditch the Brand... - The Truth About Cars - November 29th, 2020
- Skilling Open QF2: Day of the Comebacks - chess24 - November 27th, 2020
- Jelurida Announces Bridge Champ, an On-Chain Version of the Famous Card Game - IT News Online - November 27th, 2020
- The 37 Best Black Friday Smart Home and Kitchen Deals (2020) - WIRED - November 27th, 2020