Splyntra

Engineering & Research

AI Agent Observability & Security Blog

Field notes, OpenTelemetry benchmarks, threat analysis, and FinOps guides for running autonomous AI agents safely in production.

·13 min read

OpenTelemetry GenAI Semantic Conventions: The Definitive Reference Guide

An in-depth technical reference to the OpenTelemetry GenAI Semantic Conventions for AI agents and LLMs. Learn the official attributes, span hierarchies, metrics, and OTLP payload specifications.

opentelemetrygenai
Alex RiveraRead →
·12 min read

Evaluating AI Agents in CI/CD: How to Build Automated Regression Gates

A practical guide to evaluating autonomous AI agents in CI/CD pipelines. Learn how to convert production traces into test datasets, run deterministic and LLM-as-a-judge scorers, and fail pull requests on agent quality regressions.

evaluationci-cd
Marcus FeldtRead →
·11 min read

CrewAI Observability: How to Trace and Monitor Multi-Agent Crews

A production guide to observability for CrewAI multi-agent systems. Learn how to trace hierarchical delegations, monitor inter-agent latency, debug tool failures, and track sub-agent LLM costs with OpenTelemetry.

crewaiobservability
Alex RiveraRead →
·12 min read

LangGraph Observability: How to Monitor and Trace State Graphs in Production

A complete production guide to LangGraph observability. Learn how to trace cyclic state graphs, monitor node latency, debug conditional edges, track token spend, and attach OpenTelemetry spans to LangGraph workflows.

langgraphobservability
Alex RiveraRead →
·12 min read

AI Agent Observability: What You Need to Monitor in Production

A comprehensive engineering guide to monitoring autonomous AI agents in production. Learn how to track graph state transitions, distributed tool calls, non-deterministic loops, cost spikes, and security risks on OpenTelemetry.

observabilityai-agents
Alex RiveraRead →
·11 min read

How to Track LLM Costs in AI Agents

A practical FinOps guide to tracking, attributing, and controlling LLM costs in autonomous AI agents. Learn how to calculate per-span token pricing, account for prompt cache discounts, and implement hard budget circuit breakers.

finopscost
Marcus FeldtRead →
·12 min read

AI Agent Monitoring: Metrics You Should Track

The 12 Golden Signals for monitoring autonomous AI agents in production. Learn which metrics to measure for execution reliability, loop traps, token velocity, tool errors, cost attribution, and security risk.

observabilitymetrics
Alex RiveraRead →
·11 min read

How to Detect Prompt Injection in AI Agents

A deep technical dive into detecting indirect prompt injection in autonomous tool-calling AI agents. Learn the 3-chokepoint inspection architecture, structural and behavioral anomaly detection, and how to attach risk scores to OpenTelemetry traces.

securityprompt-injection
Priya NairRead →
·13 min read

AI Agent Security: A Practical Guide

A comprehensive guide to securing autonomous AI agents in production. Learn how to defend against indirect prompt injection, tool privilege escalation, SSRF exfiltration, and unauthorized state mutations using runtime trace risk scoring.

securityai-agents
Priya NairRead →
·10 min read

How to Trace AI Agents with OpenTelemetry

Master distributed tracing for multi-agent workflows. Learn how to propagate W3C TraceContext across agent nodes, trace LangGraph and CrewAI graphs, and debug complex multi-turn execution bottlenecks with OpenTelemetry.

opentelemetrytracing
Alex RiveraRead →
·11 min read

How to Monitor AI Agents with OpenTelemetry

A step-by-step technical guide to instrumenting AI agents with OpenTelemetry (OTel). Covers GenAI semantic conventions, OTLP exporters, span batching, baggage propagation, and full Python and TypeScript implementations.

opentelemetryai-agents
Alex RiveraRead →
·7 min read

Detecting prompt injection in tool-calling agents

Prompt injection stops being a curiosity and becomes a real threat the moment your agent can call tools. A practical look at where injection hides and how per-trace scoring surfaces it.

securityprompt-injection
Priya NairRead →
·6 min read

Why agent observability and security belong on one pipeline

Bolting a security scanner onto a separate tracing tool leaves you correlating incidents by hand. Here's the case for scoring risk on the same pipeline that captures every agent run.

observabilitysecurity
Anand KumarRead →
·6 min read

Controlling AI agent costs before they control your bill

Autonomous agents can loop, retry, and fan out in ways that turn a rounding-error API bill into a five-figure surprise. How per-run cost analytics, budgets, and gates keep spend predictable.

costfinops
Marcus FeldtRead →