{"slug": "bypass-ai-api-rate-limits-achieve-100-uptime-with-smartcore-llm-proxy", "title": "Bypass AI API Rate Limits & Achieve 100% Uptime with SmartCore LLM Proxy", "summary": "Developer Ahmed Adel (Abo Adel) released SmartCore LLM Proxy, an open-source local gateway built with LiteLLM that automatically load-balances requests and routes to fallback models when primary API keys hit rate limits from providers like Google Gemini, DeepSeek, or OpenAI. The tool aims to prevent HTTP 429 errors from crashing AI backends or assistants.", "body_md": "Hitting **HTTP 429 Rate Limits** on Google Gemini, DeepSeek, or OpenAI can crash your AI backend or assistant (like Hermes AI).\n\n**SmartCore LLM Proxy** is a lightweight local gateway built with LiteLLM that automatically load-balances requests and routes to fallback models whenever your primary key hits a limit.\n\nInstead of calling LLM APIs directly, your app points to `http://127.0.0.1:4000`\n\n:\n\nInstead of calling LLM APIs directly, your app points to `http://127.0.0.1:4000`\n\n:\n\n[ App / Hermes AI ] ──▶ [ SmartCore LLM Proxy ] │ ┌───────────────────────┴───────────────────────┐ ▼ ▼ [ Gemini 1.5 Pro ](https://dev.toPrimary) ──(On 429)──▶ [ Gemini 1.5 Flash / DeepSeek ](https://dev.toFallback)\n\n```\nbash\ngit clone https://github.com/aaserag1/SmartCore-LLM-Proxy.git\ncd SmartCore-LLM-Proxy\npip install \"litellm[proxy]\"\n2. Configure Keys (config.yaml)\nAdd your API keys and fallbacks in config.yaml:\n\nyaml\n\nmodel_list:\n  - model_name: gemini-1.5-pro\n    litellm_params:\n      model: gemini/gemini-1.5-pro\n      api_key: \"YOUR_GOOGLE_KEY\"\n  - model_name: deepseek-coder\n    litellm_params:\n      model: deepseek/deepseek-chat\n      api_key: \"YOUR_DEEPSEEK_KEY\"\nrouter_settings:\n  cooldown_time: 60\n  fallbacks: \n    - gemini-1.5-pro: [\"deepseek-coder\"]\n3. Run Gateway\nDouble-click Run_LiteLLM.bat or run:\n\nbash\n\npython -m litellm --config config.yaml --port 4000 --host 127.0.0.1\n4. Connect Your App\nSet your app's Base URL to http://127.0.0.1:4000.\n\n🔗 Open Source & Contribution\nCheck out the project and leave a ⭐ on GitHub!\n\n🐙 GitHub: https://github.com/aaserag1/SmartCore-LLM-Proxy\n👨‍💻 Author: Ahmed Adel (Abo Adel)\n5:09 AM\n```\n\n", "url": "https://wpnews.pro/news/bypass-ai-api-rate-limits-achieve-100-uptime-with-smartcore-llm-proxy", "canonical_source": "https://dev.to/aaserag1/bypass-ai-api-rate-limits-achieve-100-uptime-with-smartcore-llm-proxy-1kcl", "published_at": "2026-07-28 02:11:43+00:00", "updated_at": "2026-07-28 03:02:39.976215+00:00", "lang": "en", "topics": ["developer-tools", "ai-infrastructure", "large-language-models"], "entities": ["Ahmed Adel", "SmartCore LLM Proxy", "LiteLLM", "Google Gemini", "DeepSeek", "OpenAI"], "alternates": {"html": "https://wpnews.pro/news/bypass-ai-api-rate-limits-achieve-100-uptime-with-smartcore-llm-proxy", "markdown": "https://wpnews.pro/news/bypass-ai-api-rate-limits-achieve-100-uptime-with-smartcore-llm-proxy.md", "text": "https://wpnews.pro/news/bypass-ai-api-rate-limits-achieve-100-uptime-with-smartcore-llm-proxy.txt", "jsonld": "https://wpnews.pro/news/bypass-ai-api-rate-limits-achieve-100-uptime-with-smartcore-llm-proxy.jsonld"}}