Show HN: Waffie, an LLM API automated testing tool

Hey yall,

Very early release but wanted to get the idea out there.

Waffie is built for developers looking to operationalize LLM APIs into their solutions.

The first thing I'm tackling is automated testing of LLMs in the context of unstructured to structured data interpretation. For example, sentiment analysis.

Specify what you want in a YAML file and a test.csv and run waffie against your test cases.

Looking to bridge the gaps between software development and machine learning engineering.