Welcome to Agentic examples for LiteLLM and SAP Gen AI Hub’s documentation!
The examples showcase how to easily leverage various Agent Development Kits (ADKs) via the “SAP provider” in LiteLMM.
SAP customers can access LLMs across all vendors (OpenAI, Google, Amazon, Mistral, SAP, etc.) available in the SAP Generative AI Hub.
The Sap Generative AI Hub
The SAP Generative AI Hub enables customers to access large language models (LLMs) from various providers e.g., Gemini, ChatGPT, Claude, Mistral in a centralized manner.
LiteLMM
LiteLLM is an open-source library which supports 100+ LLMs from various providers. LiteLLM acts as the bridge to use standard open-source frameworks via the OpenAI api. LiteLLM integrates with various LLM providers. The “SAP provider” is recently added to LiteLLM to support the SAP Generative AI Hub.
Watch the 🎥 Devtoberfest Talk 🎥 on LiteLLM & SAP Generative AI Hub.
Prerequisites
SAP AI Core Gen AI subscription via SAP BTP tenant:
https://help.sap.com/docs/sap-ai-core/sap-ai-core-service-guide/enabling-service-in-cloud-foundry
Agent Framework Examples:
- Langgraph example connecting to Sap Generative AI Hub via LiteLLM
- CrewAI example connecting to Sap Generative AI Hub via LiteLLM
- CrewAI Proxy example connecting to Sap Generative AI Hub via LiteLLM
- PydanticAI example connecting to Sap Generative AI Hub via LiteLLM
- Google ADK example connecting to Sap Generative AI Hub via LiteLLM
- OpenAI ADK example connecting to Sap Generative AI Hub via LiteLLM
- AWS Strands Agents example connecting to Sap Generative AI Hub via LiteLLM
- LlamaIndex example connecting to Sap Generative AI Hub via LiteLLM
- Smolagents example connecting to Sap Generative AI Hub via LiteLLM
- Microsoft Agents example connecting to Sap Generative AI Hub via LiteLLM
- AgentScope example connecting to Sap Generative AI Hub via LiteLLM
- AG2 example connecting to Sap Generative AI Hub via LiteLLM Proxy
- LiteLLM Proxy example connecting to Sap Generative AI Hub