Monitor GPT4All using OpenTelemetry - OpenLIT (original) (raw)
OpenLIT uses OpenTelemetry Auto-Instrumentation to help you monitor LLM applications built using models from GPT4All. This includes tracking performance, token usage, and how users interact with the application.
Auto-instrumentation means you don’t have to set up monitoring manually for different LLMs, frameworks, or databases. By simply adding OpenLIT in your application, all the necessary monitoring configurations are automatically set up.
The integration is compatible with
- GPT4All Python SDK client
>=2.6.0