Ask HN: How to manage AI APIs for SaaS application?

I want to build an AI app. My idea is to support BYOK (bring your own key) or to manage one API key for each user.

What are the solutions to issue a lot of API keys for commercial apps? I would love to hear from the community.

4 分 | 作者 sbinnee 1天前

7 条评论

  • mmarian 17小时前
    I've used LiteLLM for my 1k-user service https://LibreThinker.com Works okay-ish, but some vendors now default to MFA on API keys (eg OpenAI) which makes things tricky; I decided to simply let those fail for now.
    [-]
    • sbinnee 12小时前
      I am a bit familiar with litellm. Do you proxy server?
  • warrenshi 7小时前
    Honestly the API key part ended up being the easy part for me.

    The messy stuff was abuse prevention, retries/fallbacks, and sudden cost spikes once real users started using different workflows.

  • jaspanglia 1天前
    BYOK is becoming more common for AI SaaS. Interested to know how people handle rate limiting and key security at scale.
  • warren455 1天前
    [flagged]
  • volume_tech 22小时前
    [dead]
  • mockbolt 1天前
    [flagged]