Improving AI model evaluation

Bito implemented AI-powered developer agents by integrating Anthropic's Claude and leveraging Claude 3.7 Sonnet for advanced reasoning into its code review and coding workflows. They utilized Anthropic’s robust API and developer-friendly infrastructure to embed an AI Code Review Agent and Bito Wingman directly within developers’ Git workflows and popular IDEs, enabling automated analysis of pull request diffs and code architecture. This integration streamlined code review, error detection, and code generation processes while upholding security standards.

Augment code integrated Anthropic's Claude within Google Cloud's Vertex AI to develop an AI-powered code assistant that provides expert-level contextual understanding of complex software systems. By automating code comprehension, debugging, documentation, and change propagation within development workflows, the solution dramatically reduced project timelines and sped up developer onboarding while ensuring SOC 2 Level 2 compliant security protocols.

Tata Elxsi integrated Microsoft GitHub Copilot into its video distribution platform development and testing processes to provide intelligent code suggestions, optimize existing code, assist in both manual and automated testing, simplify documentation, and enable smoother code translation. The integration streamlined coding and debugging workflows across the development cycle, enhancing productivity and ensuring compliance with strict security standards.

TCS partnered with Google Cloud to integrate advanced AI and generative AI capabilities into retail service offerings. They launched the Google Cloud Gemini Experience Center at their Retail Innovation Lab in Chennai, enabling retail clients to ideate, prototype, and co-develop tailored AI solutions that optimize supply chain, warehouse receiving, customer insights, and content creation. This approach automated processes using tools like Vertex AI Vision for warehouse receiving and leveraged Vertex AI with Gemini 1.5 Pro and speech-to-text to transform service centers.

Deutsche Bank developed DB Lumina, an AI-powered research agent built on Gemini and Vertex AI through a partnership with Google Cloud. The solution automates the creation of financial research reports by rapidly condensing extensive market data—such as converting a 400-page report into a three-page summary—thereby streamlining analysis workflows while maintaining rigorous data privacy standards.

NVIDIA partnered with Google Cloud to enable on-premises agentic AI by integrating Google Gemini models with NVIDIA Blackwell platforms and Confidential Computing, ensuring data sovereignty and regulatory compliance for sensitive enterprise operations. The solution further optimizes AI inference and observability by deploying a GKE Inference Gateway alongside NVIDIA Triton Inference Server, NVIDIA NeMo Guardrails, and NVIDIA Dynamo to enhance secure routing and load balancing for enterprise workloads.

Cox Automotive integrated Claude via Amazon Bedrock into its portfolio by first creating a sandbox environment to evaluate performance metrics and then selecting Claude 3.5 Sonnet for complex tasks and Claude 3.5 Haiku for high-volume content generation. They automated personalized dealer-consumer communications, generated engaging vehicle listing descriptions, and produced SEO-optimized blog posts, while also streamlining internal data governance through automated metadata generation. This integration optimized operational efficiency across marketing and internal data processes.

Intuit integrated Google Cloud’s Document AI and Gemini models into its GenOS platform to automate the autofill of ten common U.S. tax forms, including complex 1099 and 1040 forms. The solution extracts and categorizes data from uploaded documents, drastically reducing manual data entry for TurboTax customers. This integration streamlines tax preparation workflows and improves speed and accuracy.

Block implemented Anthropic’s Claude models (Claude 3.5 Sonnet and Claude 3.7 Sonnet) on its Databricks platform to power its internal AI agent, codename goose. They integrated the LLM using secure OAuth-enabled connections and a custom MCP server to connect internal databases and tools, enabling employees across all roles to auto-generate SQL queries, analyze complex data, and automate workflows. This agentic integration streamlined software development, design prototyping, and data analysis by translating user intents into actionable insights.