VIDUR: LLM Simulator
Vidur is a high-fidelity and extensible LLM inference simulator. It can help you with capacity planning and finding the best deployment configuration for your LLM deployments, test new research ideas like new scheduling algorithms, optimizations…
Large Scale Intelligent Microservices – IEEE Big Data 2020 Paper Presentation
Deploying Machine Learning (ML) algorithms within databases is a challenge due to the varied computational footprints of modern ML algorithms and the myriad of database technologies each with their own restrictive syntax. We introduce an…
Interactive Intelligence (I.I. Group)
Advancing human-Al co-creation through interactive intelligence. Interactive Intelligence (I.I. Group) is a research engineering team dedicated to advancing human–AI co-creation through interactive intelligence. We investigate how humans and intelligent systems can think, explore, and create…
MetaOpt: A Comprehensive Heuristic Analysis and Optimization Tool
We use heuristics all the time across many systems including those that are critical to production services. Production systems use heuristics because they are faster or scale better than their optimal counterparts. But practitioners often…
Research Focus: Week of November 8, 2023
Welcome to Research Focus, a series of blog posts that highlights notable publications, events, code/datasets, new hires and other milestones from across the research community at Microsoft. Generating both plausible and accurate full body avatar…