Tools

promptfoo

Open-source testing and eval harness for LLM apps — write test cases, run them across models, and catch regressions before they ship.

  • Open source
  • Maintained by Promptfoo (open source)
Open resourcepromptfoo.dev · opens in a new tab

Why it matters

Marketing prompts drift the moment a model or a template changes. promptfoo turns "it seemed fine when I tried it" into a test suite you can rerun — the same discipline as any other production system, applied to the agent layer.

What to try

Write five test cases for your highest-stakes prompt — the one that writes customer-facing copy — and run them against two models to see where behavior diverges.

Tagged under

  • AI agents
  • Experimentation

Related resources

More from the same categories.

  • Activepieces

    Open source

    Open-source automation platform whose 280+ integrations double as MCP tools — agents call the same pieces your workflows use.

    • Marketing automation
    • AI agents

  • Langfuse

    Open source

    Open-source LLM observability — traces, evals, and prompt management for the agents you run in production.

    • AI agents

  • n8n

    Free tier

    Source-available workflow automation with first-class AI nodes — the engineering-friendly backbone for production marketing agents.

    • Marketing automation
    • Data pipelines
    • AI agents