Changelog

Initial public release. A local-first desktop workbench for testing and benchmarking LLMs.

• Prompt Explorer: Version control for prompts with support for dynamic {{variables}}.
• Providers Vault: Connect OpenAI, Anthropic, Mistral, Gemini, and xAI securely using local OS keyring encryption.
• LLM Task Explorer: Send prompts to multiple models concurrently and compare raw API outputs side-by-side.
• Eval Task Explorer: Upload CSV datasets to run bulk evaluations, utilize deterministic manual grading with diagnostic tags (e.g., Hallucination, Format Error), and generate performance leaderboards.
• Local Storage: All prompt history, configuration, and evaluation data is stored entirely in a local SQLite database.