OpenVINO

OpenVINO converts, optimizes, and deploys both generative and conventional AI models across cloud, edge, and AI PC hardware, with runtimes, model serving, and compression tools built in. It's Intel's answer to getting efficient inference out of its own hardware, and it supports the common model frameworks teams already use rather than requiring a proprietary format.