Measure a model

Once you have a model running in production, you can use the suite of eval and measurement tools to measure your model's performance and user feedback.

Logging API

You can log outputs generated in production and a score (this can be user feedback) associated to the output to Glaive using the logging API endpoints as defined here

Soon you will be able to visualise the logged scores on graphs, run automated evals on all logged outputs and also automatically define improvements based on patterns in the logged outputs.