The process of using the Scorecard platform consists of three general steps:
The Overall Scorecard Workflow
As first step, you add the data and interesting Testcases that are representative of your LLM use case in the Scorecard platform.
Ingesting Testcases into Scorecard
As second step, you run the defined Testcases against your LLM application.
Executing Your LLM App With Scorecard
As third and final step, the inputs and LLM-produced outputs for each Testcase will be scored - either automatically via Scorecard AI models or manually via your subject-matter experts.
Scoring Your LLM App With Scorecard