😲 We've been impressed with Mirascope AI since we first met them a week ago!
🫳 A pythonic way to build LLM apps just got more even better: a native, decorator-based integration with Langfuse just dropped.
👇 Video Walkthrough below
youtube.com/watch?v=3ikeOa…
Mirascope now integrates with langfuse.com! Class methods, calls and extractors can now easily be sent to Langfuse for all your trace, eval and metric needs. Check out out walkthrough post here: mirascope.io/post/langfuse-…
If you're building with LLMs, definitely check out langfuse.com (and Mirascope AI if you haven't already 😉)
Mirascope is a really nice abstraction built by William Bakst, now fully observable via with_langfuse
+ as ever, head to the langfuse.com changelog to see how to get your hands dirty
langfuse.com/changelog/2024…
Introducing: 💡 Model-based Evaluation in langfuse.com
🫳 Final drop of Langfuse Launch Week: Model-based Evaluations within Langfuse allows for continuous evaluation across various dimensions like hallucinations, toxicity, relevance, and more.
With Langfuse-managed templates and
For those who have never heard of Langfuse (YC W23), how would Marc Klingen describe langfuse.com to someone who might not be familiar?
The core link is observability and analytics for AI engineers building complex LLM applications.
Can Marc Klingen walk us through the typical use case scenario of a langfuse.com user?
Yeah, it really depends on the kind of application that you're running.
Most of them are more like LangChain use cases, conversational, or like agents.
Introducing Dynamite Dogs - built during Burning Heroes's hackathon to generate docs & posts from GitHub repos.
Stack LlamaIndex 🦙, ollama, langfuse.com & Gradio
Claude 3 Haiku prompted by Opus for same quality at ~$0.01/request (40x cheaper).
Code: github.com/diicellman/dyn…
💥Thrilled to launch groq/llama3 on LiteLLM (YC W23) docs.litellm.ai/docs/providers…
🆕 langfuse.com - Add LLM location logging, and add cache_hit to metadata
🐞 Fix exception when using the 'gemini/gemini-pro-1.5-latest' model
🐞 Fix streaming of completion responses from Anthropic
📝 Log
Emerging Open-Source AI Startups.
Predibase | TruEra | CodiumAI | langfuse.com | LiteLLM (YC W23) | Roboflow
Congrats on the launch, Clemens Rawert, @marcklingen & Max Deichmann!
@Langfuse (YC W23) is building open-source product analytics for LLM apps, helping companies to track and analyze the quality, cost, and latency of LLMs, chains & agents in granular detail.
ycombinator.com/launches/J2s-l…
