Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

Great question and I see you already got a similar answer but I'll add some of my thoughts on this. We are actively promoting OpenLLMetry as a vendor agnostic way of observing LLMs (see some examples [1], [2]). We believe that people may start with whatever vendor they work with today and may gradually shift or use something like Traceloop because of specific features we have - for example the ability to take the raw data that we output with OpenLLMetry and add another layer of "smart metrics" (like qa relevancy, faithfulness, etc.) that we calculate on our backend / pipelines; or better tooling around observability of LLM calls, agents, etc.

[1] https://docs.newrelic.com/docs/opentelemetry/get-started/tra...

[2] https://docs.dynatrace.com/docs/observe-and-explore/dynatrac...



Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: