🧪 Skills

Astrai Inference Router

Route all LLM calls through Astrai for 40%+ cost savings with intelligent routing and privacy controls

v1.0.1
❤️ 2
⬇️ 441
👁 2
Share

Description


name: astrai-inference-router description: Route all LLM calls through Astrai for 40%+ cost savings with intelligent routing and privacy controls version: 1.0.0 homepage: https://github.com/beee003/astrai-openclaw metadata: clawdbot: emoji: "⚡" requires: env: ["ASTRAI_API_KEY", "ANTHROPIC_API_KEY"] primaryEnv: "ASTRAI_API_KEY" files: ["plugin.py", "config.example.toml"] tags: [inference, routing, privacy, cost-optimization, gdpr, eu, savings, llm-gateway]

Astrai Inference Router

Route every LLM call through Astrai's intelligent router. Save 40%+ on API costs. Privacy controls built in.

What it does

  • Smart routing: Classifies each task (code, research, chat, creative) and picks the optimal model
  • Cost savings: Bayesian learning finds the cheapest provider that meets your quality threshold
  • Auto-failover: Circuit breaker switches providers when one goes down
  • PII protection: Personally identifiable information stripped before reaching any provider
  • EU routing: GDPR-compliant European-only routing with one setting
  • Budget caps: Set daily spend limits to prevent runaway costs
  • Real-time tracking: See exactly how much you're saving per request

Setup

  1. Get a free API key at as-trai.com
  2. Set ASTRAI_API_KEY in your environment or skill config
  3. Choose your privacy mode (default: enhanced)
  4. Done — all LLM calls now route through Astrai

Privacy Modes

  • standard: Full routing intelligence, normal logging
  • enhanced: PII stripped, metadata-only logging, region enforced
  • max: Zero data retention, EU-only, all PII stripped, no prompt logging

Environment Variables

Variable Required Description Default
ASTRAI_API_KEY Yes Your API key from as-trai.com
PRIVACY_MODE No standard, enhanced, max enhanced
REGION No any, eu, us any
DAILY_BUDGET No Max daily spend in USD (0 = unlimited) 10

External Endpoints

Endpoint Purpose Data Sent
https://as-trai.com/v1/chat/completions LLM inference routing Prompts (with PII stripped if enhanced/max mode)
https://as-trai.com/v1/signup Free API key registration Email address

Security & Privacy

  • All requests authenticated via API key in Authorization header
  • PII stripping runs locally before any data leaves your machine (enhanced/max modes)
  • EU routing mode ensures prompts never leave European infrastructure
  • Zero data retention available in max privacy mode
  • No credentials are stored by the skill — only your API key in environment variables
  • Source code is fully open: github.com/beee003/astrai-openclaw

Model Invocation

This skill intercepts outgoing LLM API calls and reroutes them through the Astrai gateway. The gateway selects the optimal provider and model based on task type, cost, and quality. Your prompts are processed by third-party LLM providers (Anthropic, OpenAI, Google, Mistral, etc.) according to your region and privacy settings.

Pricing

  • Free: 1,000 requests/day, smart routing, failover
  • Pro ($49/mo): Unlimited requests, EU routing, PII stripping, analytics
  • Business ($199/mo): Multi-agent dashboards, compliance exports, SLA

Reviews (0)

Sign in to write a review.

No reviews yet. Be the first to review!

Comments (0)

Sign in to join the discussion.

No comments yet. Be the first to share your thoughts!

Compatible Platforms

Pricing

Free

Related Configs