Tag: VentureBeat

Baseten, the AI infrastructure company valued at $2.15 billion, has introduced Baseten Training, a platform designed to revolutionize model training for enterprises. This move aims to reduce reliance on closed-source AI providers like OpenAI and enhance customization of open-source models. The platform offers a solution to the operational challenges of managing GPU clusters and cloud capacity planning, empowering companies to fine-tune AI models independently.

Driven by customer demand, Baseten’s expansion beyond inference services focuses on providing companies with full control over their training code, data, and model weights. The platform’s technical capabilities include multi-node training support, sub-minute job scheduling, and integration with Baseten’s Multi-Cloud Management system, setting it apart from hyperscalers like AWS and Google Cloud.

Early adopters have reported significant cost savings and latency improvements, showcasing the platform’s effectiveness for custom models. Baseten’s strategy of owning both training and inference stages aims to optimize the AI lifecycle, offering performance enhancements and operational efficiencies for enterprises.

As the industry shifts towards fine-tuning open-source models, Baseten’s developer-centric approach and commitment to technical excellence position it as a key player in the evolving AI infrastructure landscape.

Source: VentureBeat

Meta has announced the release of its Omnilingual ASR models, a groundbreaking advancement in speech technology. These multilingual automatic speech recognition systems support over 1,600 languages, far exceeding existing models like OpenAI’s Whisper. The key feature of Omnilingual ASR is its innovative zero-shot in-context learning, which allows users to expand language support to over 5,400 languages without the need for retraining.

By transitioning from fixed model capabilities to a flexible framework, Meta’s Omnilingual ASR empowers communities to customize the system according to their needs. This open-source initiative, under the Apache 2.0 license, enables researchers and developers to freely utilize the technology in various projects, including commercial applications.

The technical capabilities of Omnilingual ASR lie in its diverse model family, ranging from self-supervised speech representation learning to state-of-the-art transcription features. This comprehensive suite, accompanied by a vast speech corpus, represents a significant advancement in speech-to-text technology.

Omnilingual ASR’s emphasis on inclusivity and extensibility is particularly noteworthy. By directly supporting over 1,600 languages and facilitating adaptation to thousands more, the system addresses the long-standing issue of linguistic diversity in AI technologies.

Enterprises stand to benefit from Meta’s Omnilingual ASR, as it offers a cost-effective and customizable solution for deploying multilingual speech recognition systems. This shift towards community-driven, open-source infrastructure signals a new era in speech technology, focused on linguistic inclusivity and accessibility.

Source: VentureBeat

monday.com, a cloud project tracking software, faced challenges as its engineering team scaled. To address the overload of code reviews, the VP of R&D, Guy Regev, turned to Qodo, an AI tool specializing in context engineering. Qodo’s focus on understanding the ‘why’ behind code changes, aligning with business logic and internal practices, proved crucial for monday.com.

Unlike code generation tools, Qodo doesn’t write new code but excels at reviewing it. With over 800 issues prevented monthly, including potential security vulnerabilities, Qodo became an essential part of monday.com’s software delivery process.

Integrating AI into code review at scale, monday.com leveraged Qodo’s ability to learn from the codebase, team conventions, and historical patterns. The result? Improved code quality, catching subtle bugs that could evade human reviewers.

Qodo’s ‘context engineering’ approach involves analyzing not just code differentials but also prior discussions, documentation, and test results. This thorough process led to the discovery of critical issues like exposed environment variables, enhancing monday.com’s security posture.

By saving developers an average of an hour per pull request, Qodo streamlined monday.com’s development workflow, fostering a culture of learning and code ownership. The platform’s tailored, data-driven suggestions aligned with the company’s conventions, driving impactful changes in code quality.

Looking ahead, monday.com plans deeper integrations with Qodo, aiming to merge business context with code reviews for more holistic assessments. Qodo’s roadmap includes various developer agents like context-aware code generation and automated PR analysis, signaling a shift towards AI-driven software development practices.

As Qodo expands its platform under a freemium model, partnering with tech giants like Google Cloud, the era of ‘context engines’ in AI systems is set to revolutionize enterprise software development, emphasizing the importance of context-aware AI tools for efficient code building and scaling.

Source: VentureBeat

Recent advancements in AI coding, including techniques like generative AI and swarm intelligence, have disrupted the market, with the AI Code Tools sector now valued at $4.8 billion and projected to grow at a 23% annual rate. As enterprises grapple with the emergence of AI coding agents, debates have arisen around the potential replacement of human engineers with AI counterparts.

Key industry figures have made claims about AI’s capabilities, suggesting that AI could perform over 50% of human engineers’ tasks and even write 90% of code. However, recent high-profile failures, such as the incident where an AI coding platform deleted an entire company database during a code freeze, highlight the importance of human expertise in engineering.

The exposure of sensitive user data due to preventable security errors in the Tea app incident underscores the significance of disciplined engineering processes in safeguarding against breaches. While AI offers productivity gains, traditional software engineering best practices like version control, code review, and separating development and production environments remain crucial.

The blend of AI efficiency and human experience emerges as a compelling approach to engineering challenges, as enterprises navigate the adoption of AI coding agents.

Source: VentureBeat

Researchers at New York University have introduced a groundbreaking AI architecture that promises to revolutionize high-quality image generation. This innovative technology, known as Diffusion Transformer with Representation Autoencoders (RAE), aims to enhance the semantic representation of generated images, challenging traditional diffusion models.

The core innovation of RAE lies in its integration of representation encoders, departing from the conventional variational autoencoder approach. This novel autoencoder design combines a pretrained representation encoder with a trained vision transformer decoder, resulting in superior reconstructions compared to standard models without added complexity.

One of the key implications of this advancement is the potential for more reliable and powerful features in enterprise applications. The enhanced diffusion architecture of RAE enables faster convergence and higher-quality generation, significantly outperforming previous models in terms of training speed and efficiency. The model’s impressive performance on benchmarks like ImageNet underscores its potential to revolutionize generative AI models, offering a more cost-effective and capable solution for various applications.

The future applications of RAE extend to areas like RAG-based generation and video generation, showcasing its versatility and impact on generative modeling. This innovative technology from NYU has the potential to unlock a realm of previously challenging or expensive applications, transforming the landscape of image generation.

Source: VentureBeat

Recent trends among top AI engineers reveal a shift in priorities from cost concerns to deployment speed, as highlighted in a VentureBeat article. While rising compute expenses were once a barrier to AI adoption, leading companies like Wonder and Recursion are now emphasizing factors like latency, flexibility, and capacity.

Wonder, a food delivery company, showcases how the cost per order for AI is minimal compared to the focus on cloud capacity to meet increasing demands. Recursion, a biotech firm, has strategically balanced training and deployment across on-premises clusters and the cloud to enable agile experimentation.

The emphasis on rapid deployment and sustainability in the AI space is evident as companies like Wonder and Recursion share their experiences. Budgeting challenges, infrastructure management, and the balance between on-premises and cloud setups are pivotal considerations for AI leaders as they navigate the evolving landscape.

AI leaders from these companies recently discussed these strategies with VentureBeat, shedding light on the evolving dynamics of AI implementation at scale.

Source: VentureBeat

The developers of Terminal-Bench, a benchmark suite for evaluating the performance of autonomous AI agents on real-world terminal-based tasks, have introduced version 2.0 alongside Harbor, a new framework focused on enhancing the testing, improvement, and optimization of AI agents within containerized environments. This dual launch aims to address challenges in testing and optimizing AI agents, especially those designed to function independently in realistic developer settings.

Terminal-Bench 2.0 sets a higher standard for assessing cutting-edge model capabilities by presenting a more challenging and meticulously validated task set, replacing its predecessor as the go-to benchmark in the field. Harbor complements this by allowing developers and researchers to scale evaluations across numerous cloud containers, integrating with both open-source and proprietary agents and training workflows.

Harbor, described as a vital tool for evaluating and enhancing agents and models, provides a unified platform for running and assessing agents in cloud-deployed containers, supporting large-scale rollout infrastructures and a variety of agent architectures. The framework supports scalable supervised fine-tuning and reinforcement learning pipelines, custom benchmark deployment, and seamless integration with Terminal-Bench 2.0.

The release of Terminal-Bench 2.0 and Harbor represents a significant step towards establishing a standardized and scalable agent evaluation infrastructure. As AI agents become more prevalent in developer and operational environments, the necessity for controlled, reproducible testing mechanisms has become increasingly crucial. These tools lay the foundation for a cohesive evaluation stack, promoting model enhancement, environment simulation, and benchmark standardization throughout the AI landscape.

Source: VentureBeat

AI is undergoing a significant transformation, moving from centralized cloud and data centers to operate directly at the edge where data is generated – in devices, sensors, and networks. This shift towards on-device intelligence is driven by concerns over latency, privacy, and cost, prompting companies to invest in AI platforms that offer real-time responsiveness and data security.

According to Chris Bergey, SVP and GM of Arm’s Client Business, embracing AI-first platforms that complement cloud services can provide organizations with a competitive advantage by enhancing efficiency, trust, and innovation. Edge AI is revolutionizing industries by enabling local data processing for instant decision-making, reducing reliance on the cloud, and ensuring privacy and cost-effectiveness.

Enterprises across various sectors are leveraging edge AI to optimize operations. For example, factories are using on-site analysis to prevent downtime, hospitals are running diagnostic models securely, retailers are employing in-store analytics, and logistics companies are enhancing fleet operations with on-device AI.

Consumer expectations for immediacy and trust are being met through products like Alibaba’s Taobao on-device recommendations and Meta’s Ray-Ban smart glasses that blend cloud and on-device AI. Additionally, AI assistants like Microsoft Copilot and Google Gemini are integrating cloud and on-device intelligence to offer faster and more secure user experiences.

The evolution of AI at the edge necessitates advanced hardware infrastructure that aligns compute power with workload demands, enhancing energy efficiency and performance. Technologies like Arm’s Scalable Matrix Extension 2 (SME2) and KleidiAI software ensure optimal performance for a range of AI workloads on Arm-based edge devices.

As AI transitions from pilot projects to widespread deployment, success lies in integrating intelligence across all infrastructure layers to enable autonomous processes that deliver instant value. Companies that prioritize becoming AI-first will lead the next era of technological advancement.

Source: VentureBeat

Google has introduced a tool that simplifies the setup of retrieval augmented generation (RAG) pipelines for enterprises. The File Search Tool, part of Google’s Gemini API, abstracts the retrieval pipeline, eliminating the need for complex engineering tasks such as storage solutions and embedding creators. This tool offers a more standalone and less orchestrated solution compared to similar products from OpenAI, AWS, and Microsoft.

File Search leverages Google’s Gemini Embedding model, known for its high performance on the Massive Text Embedding Benchmark. By handling file storage, chunking strategies, and embeddings, File Search streamlines the complexities of RAG, making it easier for developers to integrate within existing APIs.

Using vector search, File Search can understand query context and provide accurate responses even with inexact search terms. It supports various file formats and includes built-in citations for transparency and verification. Enterprises can access certain features for free initially, with indexing fees set at $0.15 per 1 million tokens.

While other platforms like OpenAI’s Assistants API and AWS’s Bedrock offer similar functionalities, Google’s File Search abstracts the entire RAG pipeline creation process, enhancing efficiency and productivity for users. Phaser Studio, a game generation platform, reported significant time savings and improved productivity using File Search.

Source: VentureBeat

Moonshot AI, a Chinese open-source AI provider, has released their new Kimi K2 Thinking model, which has surpassed both proprietary and open-weight competitors in various benchmarks. The model, built around one trillion parameters, demonstrates superior performance in reasoning, coding, and agentic-tool evaluations. Kimi K2 Thinking’s open-source nature marks a significant milestone, as it outperforms well-known models like OpenAI’s GPT-5 and Anthropic’s Claude Sonnet 4.5.

Developers can access the model through Moonshot AI’s platform and Hugging Face, with APIs available for chat, reasoning, and multi-tool workflows. Moonshot AI has released Kimi K2 Thinking under a Modified MIT License, allowing for commercial and derivative rights with a light-touch attribution requirement for high-usage scenarios.

The model’s efficiency and accessibility, despite its massive scale, make it a cost-effective option for users. Its technical advancements, including native INT4 inference and support for 256 k-token contexts, showcase its capabilities in long-horizon reasoning and structured tool use.

Kimi K2 Thinking’s benchmark performance, exceeding proprietary systems like GPT-5 and Claude Sonnet 4.5, highlights the evolving landscape of AI models, where open-weight systems can rival or exceed closed frontier models in performance and efficiency. This shift may impact enterprises’ choices in AI solutions, emphasizing the importance of high-end capability over capital expenditure.

Source: VentureBeat

Google Cloud has announced the introduction of the Ironwood, its latest custom AI accelerator chip. The Ironwood chip offers over four times better performance for both training and inference workloads compared to its predecessor, marking a significant advancement in AI capabilities.

Google’s strategic move has been further validated by Anthropic, an AI safety company, which has committed to accessing up to one million of these cutting-edge TPU chips in a deal worth tens of billions of dollars. This partnership underscores the growing competition among cloud providers to dominate the AI infrastructure market.

The tech giant’s focus on building custom silicon, such as the Ironwood chip, represents a long-term investment in creating superior economics and performance through vertical integration. By developing specialized AI accelerators and general-purpose processors like the Axion family, Google aims to meet the rising demand for AI model deployment and usher in the age of inference.

As the industry transitions towards serving AI models to billions of users, the underlying infrastructure’s importance cannot be overstated. Google’s approach to custom silicon design and infrastructure optimization may reshape the landscape of AI computing, challenging Nvidia’s dominance and setting new standards for performance and efficiency.

Source: VentureBeat

Modern IT environments face a deluge of data, making issue detection a significant challenge. Elastic’s new feature, Streams, leverages AI to transform noisy logs into actionable insights, offering a breakthrough in observability. Traditionally, logs have overwhelmed engineers with unstructured data, leading to costly tradeoffs. Streams automatically parses logs, extracts relevant fields, and highlights critical events, enhancing SREs’ efficiency in issue resolution.

Elastic’s Ken Exner emphasizes the shift from manual to automated observability workflows. By proactively using logs for issue resolution, AI-powered Streams streamlines troubleshooting, reducing human intervention. Large language models (LLMs) are poised to drive observability’s future, automating remediation steps. This AI-driven approach not only addresses skill shortages but also accelerates novice practitioners’ expertise in IT management.

Automated runbooks generated by LLMs are set to become industry standards, with humans verifying and implementing fixes. This AI-centric strategy promises to enhance IT infrastructure management by augmenting human capabilities with advanced AI tools. Elastic’s Streams in Observability is already available, marking a significant advancement in AI-driven log analysis.

Source: VentureBeat

The AI industry is facing a capacity crunch, shifting the focus from model size to scalability challenges. At a recent AI Impact event covered by VentureBeat, Val Bercovici, Chief AI Officer at WEKA, discussed the hurdles in scaling AI amidst increasing latency, cloud dependency, and growing expenses.

Bercovici highlighted the potential for AI to adopt surge pricing models, similar to Uber’s, emphasizing the need for real market rates to sustain the industry. The economics of AI tokens play a crucial role, balancing latency, cost, and accuracy. With accuracy being paramount, maintaining cost-efficiency without compromising performance poses a significant challenge.

Furthermore, Bercovici shed light on the importance of reinforcement learning in advancing AI capabilities. Reinforcement learning has emerged as a pivotal approach, combining training and inference into a unified workflow to drive innovation.

Regarding AI profitability, Bercovici stressed the significance of understanding unit economics to drive efficiency and impact. As organizations navigate the complex landscape of AI infrastructure, optimizing unit economics and transaction-level efficiency are key to sustainable AI deployment and growth.

Source: VentureBeat

Google Cloud has unveiled significant updates to its AI Agent Builder on the Vertex AI platform, aimed at streamlining the process of creating, testing, and deploying AI agents for enterprise applications. The latest features include enhanced governance tools, simplified agent creation, accelerated build times, and managed services for seamless scaling and evaluation support.

Agent Builder, introduced last year, offers a user-friendly platform enabling enterprises to develop agents and integrate them with orchestration frameworks like LangChain. The newly added capabilities are designed to facilitate faster agent development by enabling enterprises to incorporate orchestration throughout the agent construction process. Noteworthy updates include SOTA context management layers, customizable plugins, expanded language support, and streamlined deployment through the ADK command line interface.

Moreover, Google has introduced a governance layer to ensure high accuracy, security, observability, and auditability for production-grade AI agents. This layer includes features like Agent Identities, Model Armor, and Security Command Center to enhance security and control over agent actions.

With the evolving landscape of agent builders, Google’s enhanced Agent Builder is positioned to compete with offerings from other tech giants. The focus remains on attracting developers by providing advanced features for building and managing AI agents within their platforms.

Source: VentureBeat

Zendesk, a prominent player in the AI landscape, has been making significant advancements in integrating advanced AI technologies to enhance customer support experiences. Shashi Upadhyay, Zendesk’s President of Engineering, AI, and Product, highlights the unique challenge of deploying autonomous AI agents in customer support scenarios. The company’s implementation of AI agents has shown impressive results, with these agents autonomously resolving nearly 80% of customer requests.

Zendesk’s recent focus on improving usability, insight depth, and value delivery led to the adoption of cutting-edge technologies like ChatGPT-5 and HyperArc. By leveraging ChatGPT-5, Zendesk has enhanced its Resolution Platform, enabling AI agents to not only answer queries but also take proactive actions based on customer intent. This advancement has significantly improved workflow efficiency and customer satisfaction.

Moreover, Zendesk’s acquisition of HyperArc, an AI-native analytics platform, has revolutionized support analytics by enabling the integration of structured and unstructured data. This merger has empowered Zendesk to extract actionable insights from support interactions, anticipate issues, and provide proactive solutions. With HyperArc’s capabilities, Zendesk is driving a shift towards continuous learning in customer service, paving the way for predictive and proactive AI-driven support strategies.

Source: VentureBeat

SAP has introduced a new AI model, RPT-1, designed to simplify enterprise AI adoption by offering ready-to-use capabilities for business tasks without the need for extensive fine-tuning. Known as a Relational Foundation Model, RPT-1 comes pre-trained with business and enterprise knowledge, enabling it to perform predictive analytics and other tasks right out of the box.

Unlike traditional large language models (LLMs) that learn from text and code, RPT-1 is a tabular or relational model that understands structured data like spreadsheets. This unique approach allows RPT-1 to provide precise answers and insights for tasks such as financial analysis and enterprise predictions.

With the release of RPT-1, SAP aims to streamline the process of AI integration for enterprises, offering a model that can be directly deployed without extensive customization. The model’s ability to learn and adapt based on usage further enhances its utility for various business use cases.

Industry-specific AI models have been gaining traction, with companies moving towards tailored solutions like RPT-1 that offer more targeted and efficient outcomes. SAP’s emphasis on providing a model that requires minimal additional information about a business sets RPT-1 apart from other offerings in the market.

Source: VentureBeat

Market researchers have rapidly embraced artificial intelligence (AI), with 98% now utilizing AI tools, according to a recent industry survey by QuestDIY, a research platform owned by The Harris Poll, as reported by VentureBeat. While 56% report time savings of at least five hours per week, 4 in 10 express concerns about the errors AI occasionally generates, leading to increased validation work to ensure accuracy.

The research sector faces a dual challenge of leveraging AI’s efficiency benefits while navigating its reliability pitfalls. The survey reveals that AI adoption has accelerated, with 80% of researchers using AI more than six months ago and 71% planning to increase usage further. Despite tangible quality enhancements reported by 89% of researchers, issues like data privacy and accuracy concerns hinder broader AI adoption.

AI’s role in market research signifies a shift from experimental to foundational use, with researchers increasingly relying on AI for various tasks including data analysis, report automation, and insight synthesis. However, the industry grapples with the paradox of saving time through AI while also creating additional validation work due to the technology’s occasional errors.

Researchers are striving to strike a balance between AI-driven efficiency and the need for human oversight to ensure the accuracy and reliability of insights. As AI becomes more deeply integrated into research workflows, professionals are evolving into ‘Insight Advocates,’ emphasizing the importance of judgment, context, and storytelling alongside AI-generated findings.

While AI’s transformative potential in research is evident, concerns around data privacy, accuracy, and transparency present significant barriers to wider adoption. Researchers are navigating this landscape by developing frameworks that prioritize responsible AI use, positioning AI as a supportive tool rather than a replacement for human expertise.

Source: VentureBeat

Snowflake, a prominent player in the data analytics space, has introduced a new platform strategy at its BUILD 2025 conference that aims to address the limitations of traditional retrieval augmented generation (RAG) systems. These systems, while effective for retrieval and summarization, struggle with analyzing and aggregating data across vast document repositories. Snowflake’s response to this challenge comes in the form of Snowflake Intelligence, an enterprise intelligence platform designed to seamlessly merge structured and unstructured data analysis.

A key feature of Snowflake Intelligence is the introduction of Agentic Document Analytics, a capability that empowers enterprises to analyze thousands of documents simultaneously. This shift enables organizations to move beyond basic queries to complex analytical tasks, offering unprecedented insights into their data repositories.

Unlike traditional RAG systems that rely on predefined answers within published content, Snowflake’s approach treats documents as queryable data sources. By leveraging AI to extract, structure, and index document content, Snowflake enables SQL-like analytical operations across a multitude of documents, eliminating the need for separate analytics pipelines for structured and unstructured data.

With Agentic Document Analytics, businesses can now perform intricate analytical queries across their entire document corpus, unlocking new possibilities for data-driven decision-making and operationalizing AI at scale. Snowflake’s innovative architecture not only enhances analytical capabilities but also ensures data governance and security, paving the way for accelerated enterprise AI adoption.

Source: VentureBeat