I build RL environments, agent benchmarks and the verifiers that grade them, plus the agents and RAG systems themselves. The part of AI I care about most is whether a number is actually true: deterministic checks, decoy paths that must fail, and systems that are hard to fake.
- 400+ agent benchmark tasks in Harbor format: Terminal-Bench, multi-agent (SwarmBench) and enterprise-tool tasks over MCP
- Pod lead, LLM evaluation at Turing (Terminal Bench, OS Bench, SWE-Bench)
- Kaggle: provisional silver (~top 1% of 10,246 teams) in an RL simulation competition, with a C++ simulator and a PPO policy
- Merged open source: Rhesis #2173, OGX / Llama Stack #6341
class Aaweg:
role = "Applied AI Engineer"
focus = ["RL environments", "agent benchmarks", "LLM evaluation", "agents"]
philosophy = "is it actually good, or just demo-good?"
currently = "building Harbor tasks with deterministic verifiers"
stack = ["Python", "Docker", "Harbor", "pytest", "LangGraph", "C++", "GCP"]| Project | What it is | Try it |
|---|---|---|
nibblecore |
4-bit (Q4_0) quantization kernels in C++ / ARM NEON with a GGUF loader · 3.4x faster dequantization than llama.cpp scalar, 4.8x faster SDOT dot product, bit-identical | Repo |
priorityjudge |
Multi-pass LLM-as-judge for plans/PRDs with a deterministic citation verifier · 9887/10000, perfect rank correlation with a human grader on a 6-plan calibration set | Quickstart |
mcp-arena |
Reliability scorecard for MCP servers (conformance, tool reliability, hygiene) · WIP | Repo |
swarmbench-codespaces-harness |
Run Harbor multi-agent benchmark tasks (oracle / single / multi) on free GitHub Codespaces | Repo |
mosaicmind-rag |
Multimodal RAG (PDF/image/audio/video) with LangGraph + LlamaIndex + Chroma · FastAPI · MLflow · Docker | Live demo |
also: Harbor · Terminal-Bench · SWE-Bench · MCP · LangGraph · LlamaIndex · ChromaDB · MLflow · Airflow · pytest · ARM NEON · PPO