A developer who criticizes Apple's built-in foundation-model eval and tracing tooling open-sourced Foundation Eval Labs, an app for evaluating and tracing foundation models. The tool ships with an MCP server so agents can run the evals themselves. It is available on GitHub.
Lys is an open-source, less bloated Xcode alternative designed for coding agents. It lets agents use existing harnesses like Codex or Claude Code to build iOS apps, with built-in simulator testing, runtime issue detection, and evidence collection. It also includes a testing SDK for Swift and Expo/React Native, plus TestFlight integration.
Lys is an open-source, less bloated Xcode alternative designed for coding agents. It lets agents use existing harnesses like Codex or Claude Code to build iOS apps, with built-in simulator testing, runtime issue detection, and evidence collection. It also includes a testing SDK for Swift and Expo/React Native, plus TestFlight integration.
Anduryl is a free iOS app that implements Cooke's classical model for structured expert judgment. It allows users to create experts, input quantile assessments, and calculate calibration, information, and combined scores. The app is built with OpenAI Codex and includes an integrated help system for learning the methodology.
Anduryl is a free iOS app that implements Cooke's classical model for structured expert judgment. It allows users to create experts, input quantile assessments, and calculate calibration, information, and combined scores. The app is built with OpenAI Codex and includes an integrated help system for learning the methodology.
MCPfy Pulse is a new open-source telemetry package that provides observability for any MCP server, addressing the black-box problem of tool calls. It tracks health, protocol health, result quality, client compatibility, usage patterns, and error rates, giving developers visibility into server behavior.
MCPfy Pulse is a new open-source telemetry package that provides observability for any MCP server, addressing the black-box problem of tool calls. It tracks health, protocol health, result quality, client compatibility, usage patterns, and error rates, giving developers visibility into server behavior.
Own Your App is an open-source Agent Skill that helps developers understand their AI-generated codebases. It uses an LLM to guide users through an interactive learning journey, mapping architecture, tracing user actions, and examining security, privacy, and performance using real files and code paths.
Own Your App is an open-source Agent Skill that helps developers understand their AI-generated codebases. It uses an LLM to guide users through an interactive learning journey, mapping architecture, tracing user actions, and examining security, privacy, and performance using real files and code paths.
AgentsProof is a side-project for testing and evaluating AI agents. It allows users to trace agent runs, create evaluation cases, and generate publicly shareable reports to understand where an agent succeeds or fails. It solves the problem of agent observability and debugging for developers building AI agents.
AgentsProof is a side-project for testing and evaluating AI agents. It allows users to trace agent runs, create evaluation cases, and generate publicly shareable reports to understand where an agent succeeds or fails. It solves the problem of agent observability and debugging for developers building AI agents.