Catalyst – LLM Evaluation Platform

The Challenge

Enterprises needed a secure, compliant way to evaluate and optimize LLMs for their specific use cases while meeting HIPAA and SOC-2 requirements.

The Solution

Led frontend development of a secure, scalable platform for evaluating LLMs. Built Interactive Playground supporting LLMs, tools, agents, and rerankers with prompt testing. Developed Custom Metrics Builder with drag-and-drop interface and built-in visualization using Chart.js and Plotly.js.

Impact

• HIPAA, SOC-2 compliant
• Interactive Playground for testing
• Custom Metrics Builder
• Enterprise-grade security