AutoResearch + PromptFoo = AutoPrompter. Run it with Neo AI Engineer
-
Updated
Apr 16, 2026 - Python
#
promptfoo
Here are 123 public repositories matching this topic...
Your guide to the Agentic AI evolution. **Prompting Blueprints** offers a curated collection of concepts and tactics for building autonomous AI workflows. Master tool-specific playbooks, backed by structured prompt packs and rigorous evaluations for the latest AI models.
mkdocs gemini llm prompt-engineering generative-ai chatgpt prompt-library promptfoo context-engineering
-
Updated
Sep 14, 2026 - HTML
This repository contains the code snippets used in "LLM Prompt Engineering For Developers"
react python nlp natural-language-processing openai gpt perplexity few-shot-learning gpt-4 llm prompt-engineering chain-of-thought chatgpt langchain chatgpt-api azure-prompt-flow promptfoo general-knowledge-prompting betterprompt
-
Updated
Apr 22, 2024
prompt-evaluator is an open-source toolkit for evaluating, testing, and comparing LLM prompts. It provides a GUI-driven workflow for running prompt tests, tracking token usage, visualizing results, and ensuring reliability across models like OpenAI, Claude, and Gemini.
electron react typescript datascience developer-tools ai-evaluation llm prompt-engineering prompt-testing promptfoo ai-evaluation-tools ai-evaluation-metrics ai-evaluation-framework
-
Updated
Dec 4, 2025 - TypeScript
Community Plugin for Genkit to use Promptfoo
plugin testing firebase ai evaluation prompt prompts evaluation-framework llm llmops prompt-testing llm-eval llm-evaluation llm-evaluation-framework promptfoo genkit genkitx genkit-plugin
-
Updated
Jan 3, 2025 - TypeScript
面向开发者的中文 Eval Harness 源码教材：解析 lm-evaluation-harness、Inspect AI、OpenAI Evals、Promptfoo、DeepEval 与 Harbor，覆盖任务、运行、评分、统计与发布门禁。
benchmark chinese source-code-analysis llm lm-evaluation-harness openai-evals promptfoo llm-as-a-judge deepeval inspect-ai eval-harness
-
Updated
Aug 27, 2026 - Python
Orchestrator/sub-agent RCA system with a production-grade eval and observability harness — LangGraph agents, Ragas/Promptfoo evals, OTel tracing.
observability root-cause-analysis pydantic opentelemetry ai-product-management llm-evaluation promptfoo langgraph ragas agentic-ai
-
Updated
Sep 2, 2026 - Python
Agent 测试转型手册：资深自动化测试工程师的 AI QE 学习路径 + 练手代码
qa benchmark test-automation pytest chinese quality-gate evals langfuse llm-evaluation promptfoo ragas llm-as-judge agentic-ai deepeval agent-testing agent-eval ai-qe
-
Updated
Sep 16, 2026 - Python
VCL VibeBench — open frontier-model comparisons you can fork and re-run. By Vibe Coder's Life.
-
Updated
Aug 25, 2026 - JavaScript
Compare models across prompts, test domains, and scenarios.
-
Updated
Apr 5, 2026 - Python
Python + SQL toolkit for LLM threat intelligence — flags prompt injection, jailbreaks, and data exfiltration mapped to OWASP LLM Top 10 (2025) & MITRE ATLAS.
python sql threat-intelligence red-teaming ai-security detection-engineering pyrit adversarial-ml mitre-atlas prompt-injection llm-security promptfoo owasp-llm-top-10 garak
-
Updated
Aug 17, 2026 - Python
kotlin testing mcp moderation chatbot demo-app rag quarkus langchain4j llm-evaluation promptfoo rag-chatbot mcp-client
-
Updated
Sep 17, 2026 - Kotlin
Sample project demonstrates how to use Promptfoo, a test framework for evaluating the output of generative AI models
testing evaluation prompts evaluation-framework llm llmops prompt-testing llm-eval llm-evaluation llm-evaluation-framework promptfoo
-
Updated
Sep 10, 2024
AI Testing Framework using Promptfoo for automated LLM evaluation, red teaming, and CI/CD integration with Jenkins. Supports prompt validation, security testing, custom assertions, API-based model testing, and quality gates for enterprise GenAI applications.
jenkins framework ai ci-cd cicd jenkins-pipeline evaluation-framework llm prompt-engineering generative-ai ai-testing llmops prompt-injection llm-security llm-tools llm-evaluation llm-agents promptfoo
-
Updated
Sep 12, 2026
Quickstart guide for using PromptFoo to evaluate LLM prompts via CLI or Colab.
-
Updated
Nov 23, 2025
Real DuckDB Quack infrastructure for multi-agent Werewolf: containerized player nodes, Quack gateway federation, browser runner, and local/hosted LLM evals.
typescript werewolf multi-agent-systems quack duckdb local-llm evals llm-agents promptfoo openai-compatible inspect-ai omlx browser-runner
-
Updated
Aug 12, 2026 - JavaScript
Prompt optimization and benchmarking for local LLMs: picks the right prompt technique for your task and measures it on Ollama. DSPy-compatible.
python nlp benchmarking ai structured-output mlops dspy llm prompt-engineering chain-of-thought llmops prompt-testing local-llm ollama llm-evaluation prompt-optimization promptfoo prompt-techniques llm-benchmark prompt-compiler
-
Updated
Sep 1, 2026 - Python
Add this topic to your repo
To associate your repository with the promptfoo topic, visit your repo's landing page and select "manage topics."