SambaNova

SambaNova builds custom hardware and software for running large foundation models with extremely fast inference, aimed at organizations that need low-latency responses at a scale where standard GPU cloud inference gets too slow or too expensive. It also offers a free API tier for developers to test fast inference against Llama and other open models before committing to enterprise deployment.