Skip to content

latitude-dev/latitude-llm

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

4,252 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Issue detection for AI Agents

Sentry, but for agents and LLMs.

Docs  ·   Slack  ·   X

Warning

You are viewing the Latitude v2 Alpha branch (main). This branch is in active development and is not ready for production use. APIs, features, and data formats may change without notice.

For production use, please use the stable release on the latitude-v1 branch.

Demo of the Latitude UI showing LLM observability, issue tracking, and evals

🌈 Why Latitude?

Latitude shows you what will break next in your AI Agent and helps you fix it before users notice.

  • Issue-centric: failed traces grouped into tracked issues, with status, size, and trend.
  • Human-aligned evals: evals built automatically from your team's judgments, with an alignment score that tracks drift from human judgment over time.
  • Agent-native traces: multi-turn sessions, tool calls, and full execution paths in one view.
  • Semantic search (coming soon): find traces by meaning, even when the exact words don't match.
  • Simulations (coming soon): replay agents against saved scenarios before shipping.

📚 Table of contents

⚡ Quick start

Sign up at latitude.so and grab your API key and project slug.

Install

npm install @latitude-data/telemetry

Instrument

import { initLatitude } from "@latitude-data/telemetry"

initLatitude({
  apiKey: process.env.LATITUDE_API_KEY!,
  projectSlug: process.env.LATITUDE_PROJECT_SLUG!,
  instrumentations: ["openai"],
})

Every LLM call now shows up as a trace in Latitude.

Python, Go, and other languages are also supported. Full setup, OTel passthrough, and self-hosting in the getting started guide.

🔌 Integrations

Latitude is provider-agnostic. Telemetry works out of the box with most model providers and frameworks (OpenAI, Anthropic, Bedrock, Vercel AI SDK, LangChain, and more), plus any OTLP-compatible backend.

See the full integration list for setup instructions.

✳️ With Claude Code

Building inside Claude Code? We have a dedicated package that captures full session transcripts as traces.

npx -y @latitude-data/claude-code-telemetry install

Works in the terminal, the Desktop app, and IDE extensions.

Roadmap

  • OTel ingest, traces, sessions
  • Issue discovery + clustering
  • Issue-to-eval generation with alignment optimization
  • Eval alignment tracking (MCC, coverage)
  • Semantic search: find traces by meaning (in progress)
  • Potential issues: track failure modes you already know about
  • Stable v2 release

👥 Community

Join the Slack community to ask questions, share feedback, and show what you're building.

🤝 Contributing

Contributions are welcome. For an overview of the repo and its architecture, see the contributor guide.

If you want to help, join the Slack community, open an issue, or submit a pull request.

📄 License

Latitude is licensed under the LGPL-3.0.

We also offer a more permissive commercial license for those who need it. Contact licensing@latitude.so for details.

🔗 Links

Made with love by the Latitude Team

About

Latitude is the open-source agent engineering platform

Resources

License

Security policy

Stars

Watchers

Forks

Packages

 
 
 

Contributors