Skip to main content

Fireworks AI

Fast inference on open models (Llama, Qwen, DeepSeek, image models) through Fireworks AI's API.

Connect it with: API key. Fireworks AI's own documentation: https://docs.fireworks.ai/api-reference/introduction.

What agents can do​

Connect Fireworks AI so the agents working your tasks can reach it. With it connected, they can:

  • Call open chat, code and vision models through Fireworks' OpenAI-compatible API.
  • Generate images with the hosted image models.
  • Create embeddings and rerank results for search features.
  • Use your own fine-tuned or deployed models in the account.

Before you start​

  • A Fireworks AI account; add a payment method or credits to lift the free rate limit.
  • A Jaah account. Anyone can add a personal secret; an organization secret needs an Org Owner or Admin.

Connect with Fireworks AI​

Jaah connects to Fireworks AI with an API key, not with a sign-in button.

Connect with an API key​

Find each value first:

  • API key: In the Fireworks AI app open Settings > Users > API keys (app.fireworks.ai/settings/users/api-keys) and select Create API key; copy it at once, it is shown only once.

Then add it to Jaah:

  1. In Jaah, open Secrets, select New, and pick the Fireworks AI card.
  2. Name the secret and choose who can use it.
  3. Fill in API key.
  4. Select Save. Jaah tests the secret straight away (see Test the connection).

Jaah encrypts what you type and never shows it again — not to you, and not to an admin.

Use your own OAuth app​

Not used: Jaah connects to Fireworks AI with an API key, not through an OAuth app.

Test the connection​

Select Test on the secret. Jaah calls Fireworks AI's API once (GET https://api.fireworks.ai/inference/v1/models) with the stored values, and shows whether Fireworks AI accepted it, or which value Fireworks AI refused and the status it answered. Jaah also tests automatically when you save or reconnect.

The last result and its time stay on the secret's page, so you can see whether it still works without testing again.

Who can use it​

Every secret has an owner, and the owner decides who can use it:

  • Personal — only your own tasks can use it. This is the default.
  • Organization — every task in the organization can use it. Only Org Owners and Admins can choose this.
  • Attached to a project — every task on that project can use it, whoever started the task. See Attach a secret to a project.

More on owners and access: How secrets work.

Use it in an agent session​

An agent asks for the secret with its credential_get tool, by the secret's path, when it needs it, and gets the values for that one call. The path is the owner's prefix and the secret's name:

  • org/<name> for an organization secret,
  • projects/<project>/<name> for one attached to a project,
  • me/<name> for your personal one.

A key connection hands the agent its fields: api_key.

Tell the agent in your task description which secret to use, for example “use the Fireworks AI secret org/fireworks-ai”.

Manage, rotate or disconnect​

Everything is on the secret's page under Secrets:

  • Rotate a key: create a new key at the vendor first, then select Replace on the secret and paste it. Revoke the old key at Fireworks AI once the test passes. Steps: Replace or delete a secret.
  • Disconnect: select Delete. The stored values are destroyed and agents lose access on their next call. To end access at Fireworks AI's side too, revoke or delete the key at Fireworks AI.

Limitations​

  • Without a payment method or credits Fireworks limits the account to about 10 requests per minute.
  • Inference is billed per token or per image by Fireworks; the Test only lists the models and spends nothing.
  • Agents can do only what the connected Fireworks AI account allows.

Troubleshooting​

The Test says Fireworks AI rejected the API key (401)

The key was deleted or mistyped. Create a new one under Settings > Users > API keys and select Replace.

Agents get 429 Too Many Requests

The account has no payment method or credits, or hit its spend limit. Add billing details in the Fireworks app, or raise the monthly spend limit.

Agents get 404 for a model

The model id is wrong or the model is not served serverlessly. Use the id shown on the model's page, for example accounts/fireworks/models/<name>.

Still stuck? Select Test and read the result: it names the value Fireworks AI refused and the status it answered.

FAQ​

Can an agent use the OpenAI SDK with this key?

Yes. Point the SDK's base URL at https://api.fireworks.ai/inference/v1 and pass the key.

Can Jaah or an admin see the key or token?

No. Jaah stores it encrypted and never shows it again. Only the tasks allowed to use the secret receive it, at the moment they ask for it.

Can I connect more than one Fireworks AI account?

Yes. Add one secret per account, each with its own name, and tell the agent which one to use.