Arclyx
An AI agent platform for teams, built at Arc10: describe a job in one sentence and Arclyx builds the agent, picks its tools, tries it on a dry run, then runs it on chat, schedules, webhooks and Slack, answering from the company’s own documents with citations. It launched as AuraMind and was renamed Arclyx in October 2026.
I built the eval harness that gates every agent change, rebuilt in October 2026 with LLM-judge checks, a human review queue, multi-turn scenarios and run-to-run comparison, and the observability behind every run: detail pages, analytics, LLM-written run stories, and a record of every model request with its purpose and its actual cost, which feeds Stripe usage billing. Underneath sit the agent loop, triggers and the new-agent flow, which I also built.
It is a team build: I am one of four engineers, with over 320 merged pull requests authored since March 2026. The code sandbox, tenant isolation, MCP client and original routing layer are teammates’ work.
- 320+
- Merged PRs authored since Mar 2026
- LLM judge
- Eval checks with a human review queue
- Multi-turn
- Eval scenarios with a cost cap on every run
- Run stories
- An LLM-written account of every agent run
- Baseline · judge · review · compare
- The eval harness every agent change goes through
- Every call
- Model requests recorded with purpose and cost
- Sentry
- Errors traced alongside run analytics
- Auto mode
- An LLM picks the model for each request
