Data Science Wire

langfuse alternative with evals and governance: langsmith, orqai, helicone compared after 2 months of llmops

Reddit r/MLOps1mo5 min read

have been doing llmops for a small team for around 2 -2.5 months now. we use langfuse for tracing. its fine but we needed evals and some kind of governance layer. and langfuse really doesnt do that well. so i started looking around. noticed most tools either are doing tracing or evals. not both. the ones that claim to do both feel like 1 feature is an add on and integration isnt upto the mark. langsmith came up a lot. good tracing, decent eval support, but ties only with langchain system well. if youre not already in that stack it will feel weierd. governance side is still pretty. orqai came u

Read the full story at Reddit r/MLOps

More in MLOps / LLMOps