In a significant development for the AI industry, the creators of the vLLM open-source project have formed a new startup called Inferact. The company recently secured $150 million in seed funding, valuing it at $800 million. The funding round was co-led by Andreessen Horowitz and Lightspeed Venture Partners, underscoring the growing interest in AI deployment technologies.
The shift in AI focus from model training to deployment has brought technologies like vLLM to the forefront. These tools, which enhance the speed and affordability of AI applications during the inference process, are gaining traction among investors seeking to capitalize on the expanding AI market.
Notably, vLLM and another project, SGLang, both originating from UC Berkeley’s Databricks lab, have seen successful commercialization efforts. Inferact’s CEO, Simon Mo, highlighted that major players like Amazon’s cloud service and popular shopping apps are already leveraging vLLM’s capabilities, signaling the practical relevance of these technologies in real-world applications.
This strategic move by Inferact aligns with the industry trend towards enhancing AI deployment efficiency, reflecting a broader push towards making AI tools more accessible and cost-effective for businesses across various sectors.
Source: TechCrunch