the power of [AI] models […] to client devices,” explains Microsoft in the press release. Foundry Local, which supports macOS in addition to Windows, comes with a set of modules to run AI models and tools directly on-device, leveraging the ONXX Runtime, an open source project aimed at accelerating AI across platforms.
Foundry Local also ships with command-line interface support, letting developers use prompts like “Foundry model list, Foundry model run” to browse, test, and interact with models running on a local server.
Join us at TechCrunch Sessions: AI
Secure your spot for our leading AI industry event with speakers from OpenAI, Anthropic, and Cohere. For a limited time, tickets are just $292 for an entire day of expert talks, workshops, and potent networking.
Exhibit at TechCrunch Sessions: AI
Secure your spot at TC Sessions: AI and show 1,200+ decision-makers what you’ve built — without the big spend. Available through May 9 or while tables last.
REGISTER NOW
“Foundry Local will automatically detect device hardware — CPU, GPU, and NPU — and list compatible models for developers to try,” Microsoft writes. “Developers will be able to leverage the Foundry Local SDK to easily integrate Foundry Local in their app.”