Search

Showing top 5 results for "Memory costs surge"

Filtered by topic: NVIDIA Clear ✕

People also ask

How Did Healthcare Platform Sully.ai Cut Inference Costs by 10x With Baseten, Open Source Models and Blackwell?

In healthcare, tedious, time-consuming tasks like medical coding, documentation and managing insurance forms cut into the time doctors can spend with patients. Sully.ai helps solve this problem by developing “AI employees” that can handle routine tasks like medical coding and note-taking. As the company’s platform scaled, its proprietary, closed source models created three bottlenecks: unpredictable latency in real-time clinical workflows, inference costs that scaled faster than revenue and insufficient control over model quality and updates. To overcome these bottlenecks, Sully.ai uses Basete

Leading Inference Providers Achieve Lowest Token Cost With Open Source Models on NVIDIA Blackwell
How Did Fireworks AI and Sentient Foundation Lower AI Costs for Agentic Chat by up to 50%?

Sentient Labs is focused on bringing AI developers together to build powerful reasoning AI systems that are all open source. The goal is to accelerate AI toward solving harder reasoning problems through research in secure autonomy, agentic architecture and continual learning. Its first app, Sentient Chat, orchestrates complex multi-agent workflows and integrates more than a dozen specialized AI agents from the community. Due to this, Sentient Chat has massive compute demands because a single user query could trigger a cascade of autonomous interactions that typically lead to costly infrastruct

Leading Inference Providers Achieve Lowest Token Cost With Open Source Models on NVIDIA Blackwell
How Did Together AI and Decagon Drive Down AI Costs for Customer Service by 6x?

Customer service calls with voice AI often end in frustration because even a slight delay can lead users to talk over the agent, hang up or lose trust. Decagon builds AI agents for enterprise customer support, with AI-powered voice being its most demanding channel. Decagon needed infrastructure that could deliver sub-second responses under unpredictable traffic loads with tokenomics that supported 24/7 voice deployments. Together AI runs production inference for Decagon’s multimodel voice stack on NVIDIA Blackwell GPUs. The companies collaborated on several key optimizations: speculative decod

Leading Inference Providers Achieve Lowest Token Cost With Open Source Models on NVIDIA Blackwell