Add Agent Observability data retention and billing pages

hugo/config/_default/menus/main.en.yaml

@@ -5784,16 +5784,21 @@ menu:
       parent: llm_obs
       identifier: llm_obs_data_security_and_rbac
       weight: 7
+    - name: Data Retention
+      url: llm_observability/data_retention
+      parent: llm_obs
+      identifier: llm_obs_data_retention
+      weight: 8
     - name: Lapdog
       url: llm_observability/lapdog
       parent: llm_obs
       identifier: llm_obs_lapdog
-      weight: 8
+      weight: 9
     - name: Guides
       url: llm_observability/guide/
       parent: llm_obs
       identifier: llm_obs_guide
-      weight: 9
+      weight: 10
     - name: GPU Monitoring
       url: gpu_monitoring/
       pre: gpu-monitoring-wui
@@ -10670,51 +10675,56 @@ menu:
       url: account_management/billing/incident_response/
       parent: account_management_billing
       weight: 1513
+    - name: Agent Observability
+      identifier: account_management_billing_llm_observability
+      url: account_management/billing/llm_observability/
+      parent: account_management_billing
+      weight: 1514
     - name: AWS Integration
       identifier: account_management_billing_aws
       url: account_management/billing/aws/
       parent: account_management_billing
-      weight: 1514
+      weight: 1515
     - name: Azure Integration
       identifier: account_management_billing_azure
       url: account_management/billing/azure/
       parent: account_management_billing
-      weight: 1515
+      weight: 1516
     - name: Google Cloud Integration
       identifier: account_management_billing_google_cloud
       url: account_management/billing/google_cloud/
       parent: account_management_billing
-      weight: 1516
+      weight: 1517
     - name: OCI Integration
       identifier: account_management_billing_oci
       url: account_management/billing/oci/
       parent: account_management_billing
-      weight: 1517
+      weight: 1518
     - name: Alibaba Integration
       identifier: account_management_billing_alibaba
       url: account_management/billing/alibaba/
       parent: account_management_billing
-      weight: 1518
+      weight: 1519
     - name: vSphere Integration
       identifier: account_management_billing_vsphere
       url: account_management/billing/vsphere/
       parent: account_management_billing
-      weight: 1519
+      weight: 1520
     - name: Workflow Automation
       identifier: account_management_billing_workflow_automation
       url: account_management/billing/workflow_automation/
       parent: account_management_billing
-      weight: 1520
+      weight: 1521
     - name: AI Credits
       identifier: account_management_billing_ai_credits
       url: account_management/billing/ai_credits/
       parent: account_management_billing
-      weight: 1521
+      weight: 1522
     - name: AI Credit Limits
       identifier: account_management_billing_ai_credit_limits
       url: account_management/billing/ai_credit_limits/
       parent: account_management_billing
-      weight: 1522
+      weight: 1523
     - name: Multi-org Accounts
       identifier: account_management_multi_org_accounts
       url: account_management/multi_organization/

hugo/content/en/account_management/billing/_index.md

@@ -108,6 +108,7 @@ If you pay by check, ACH, or wire, invoices are emailed to the billing email add
     {{< nextlink href="account_management/billing/serverless/" >}}Serverless{{< /nextlink >}}
     {{< nextlink href="account_management/billing/rum/" >}}Real User Monitoring{{< /nextlink >}}
     {{< nextlink href="account_management/billing/ci_visibility/" >}}CI Visibility{{< /nextlink >}}
+    {{< nextlink href="account_management/billing/llm_observability/" >}}Agent Observability{{< /nextlink >}}
     {{< nextlink href="account_management/billing/aws/" >}}AWS integration{{< /nextlink >}}
     {{< nextlink href="account_management/billing/azure/" >}}Azure integration{{< /nextlink >}}
     {{< nextlink href="account_management/billing/alibaba/" >}}Alibaba integration{{< /nextlink >}}

hugo/content/en/account_management/billing/llm_observability.md

@@ -0,0 +1,138 @@
+---
+title: Agent Observability Billing
+algolia:
+  tags: ['agent observability billing', 'llm observability billing', 'agent observability pricing', 'llm observability pricing', 'llm spans']
+further_reading:
+- link: "/llm_observability/"
+  tag: "Documentation"
+  text: "Learn about Agent Observability"
+- link: "/llm_observability/data_retention/"
+  tag: "Documentation"
+  text: "Learn how long Agent Observability retains your data"
+---
+
+[Agent Observability][1] is metered and billed on the number of LLM spans ingested, at the rates below.
+
+| Billing Parameter            | Price                                       | Included                                                                                                  | Billing                                                                                                                                                        |
+|------------------------------|---------------------------------------------|-----------------------------------------------------------------------------------------------------------|----------------------------------------------------------------------------------------------------------------------------------------------------------------|
+| Free tier                    | $0                                          | Up to 40,000 LLM spans per month                                                                          | Organizations at or below 40,000 LLM spans in a calendar month are not billed for Agent Observability. Retention add-ons are not available on the free tier.    |
+| LLM spans, first 100,000     | $240 per month                              | All indexed LLM spans, [Experiments][3], and 1 GB of [Sensitive Data Scanner][10] usage per 10,000 LLM spans | Datadog counts the LLM spans ingested into the Agent Observability service during the calendar month. Exceeding 40,000 LLM spans moves the organization onto the paid plan. [More Agent Observability pricing information.][2] |
+| Additional LLM spans         | $5 per 10,000 LLM spans per month           | Same as above                                                                                             | Billed on LLM spans beyond the first 100,000 in the calendar month, in blocks of 10,000 spans.                                                                  |
+
+The rates above are on-demand rates. Committed monthly and annual plans offer lower rates, and enterprise pricing is custom.
+
+## Billing scenarios
+
+**Sample cases illustrate on-demand billing rates with the default 15-day span retention. Contact [Sales][11] or your [Customer Success][12] Manager to discuss committed pricing and volume discounts for your account.**
+
+### Usage within the free tier
+
+Sending 30,000 LLM spans in a month.
+
+| Billable Unit | Quantity | Price                                     | Formula | Subtotal          |
+|---------------|----------|-------------------------------------------|---------|-------------------|
+| LLM spans     | 30,000   | First 40,000 LLM spans included at no cost | —       | $0                |
+| Total         | 30,000   |                                           |         | **$0 per month**  |
+
+### Usage above the free tier
+
+Sending 80,000 LLM spans in a month.
+
+| Billable Unit | Quantity | Price                                            | Formula | Subtotal            |
+|---------------|----------|--------------------------------------------------|---------|---------------------|
+| LLM spans     | 80,000   | $240 per month for the first 100,000 LLM spans   | $240    | $240                |
+| Total         | 80,000   |                                                  |         | **$240 per month**  |
+
+### Usage above 100,000 LLM spans
+
+Sending 250,000 LLM spans in a month.
+
+| Billable Unit            | Quantity | Price                                          | Formula     | Subtotal            |
+|--------------------------|----------|------------------------------------------------|-------------|---------------------|
+| LLM spans, first 100,000 | 100,000  | $240 per month for the first 100,000 LLM spans | $240        | $240                |
+| Additional LLM spans     | 150,000  | $5 per 10,000 LLM spans                        | 15 * $5     | $75                 |
+| Total                    | 250,000  |                                                | $240 + $75  | **$315 per month**  |
+
+## What counts as an LLM span?
+
+An LLM span represents a single request to an LLM provider. A trace containing seven LLM requests therefore contains seven billable LLM spans, regardless of how many workflow, tool, or retrieval spans surround them.
+
+## What is included in the base price?
+
+All Agent Observability features are included in the base price. Datadog charges only for the LLM spans you ingest.
+
+You can connect your own [LLM provider account][15] for [Evaluations][13] and [Patterns][14].
+
+[Sensitive Data Scanner](#is-sensitive-data-scanner-included) is included within a usage allotment.
+
+## How can I estimate my LLM span usage?
+
+Each request your application makes to an LLM provider corresponds to one LLM span, so provider-side request counts are a good starting point. Most providers report request counts in their own console, and Datadog integrations expose the same counts as metrics:
+
+| Provider          | Where to find request counts                                                                                        |
+|-------------------|---------------------------------------------------------------------------------------------------------------------|
+| OpenAI            | Total requests in the OpenAI admin UI, or sum the `*.num_model_requests` metrics                                     |
+| AWS Bedrock       | Invocations by model in CloudWatch, or the `aws.bedrock.invocations` metric                                           |
+| Google Vertex AI  | Usage metrics in the Google Cloud console, or the `gcp.aiplatform.online_prediction_requests_per_base_model` metric   |
+| Vercel            | Requests by provider and model in the Vercel dashboard, or the `vercel.requests` metric                               |
+| Anthropic         | Request totals are not reported; use your own application metrics as a proxy                                          |
+
+Keep the following in mind when using provider request counts:
+
+- They are closer to an upper bound than an exact figure, because not every request is instrumented as an LLM span.
+- If you [sample][4] your traces, your billable spans are a fraction of your total requests.
+- Counting inbound requests to your own application undercounts if each one triggers several LLM calls. An agent that makes five LLM calls per user query produces five times the spans.
+
+If your application uses a supported provider, the Agent Observability SDK captures these requests automatically. See the [Python SDK][5] and [Node.js SDK][6] documentation for supported providers.
+
+## How can I see my billable usage?
+
+In Datadog, go to [{{< ui >}}Plan & Usage{{< /ui >}}][7] and open the {{< ui >}}Agent Observability{{< /ui >}} tab.
+
+## Does extending my data retention period affect billing?
+
+Yes. Longer retention is a paid add-on, because it increases how much data Datadog stores for you. Add-ons extend span retention to 30, 60, or 90 days, along with a correspondingly longer period for experiment traces. Add-ons are not available on the free tier. For the periods each add-on provides and how to request one, see [Data Retention][8].
+
+## Is Agent Observability a standalone product?
+
+Yes. Agent Observability does not require you to purchase any other Datadog product.
+
+## Is Sensitive Data Scanner included?
+
+Yes. As with the other capabilities [included in the base price](#what-is-included-in-the-base-price), you do not purchase Sensitive Data Scanner separately. Agent Observability uses [Sensitive Data Scanner][10] Library Rules to identify and redact sensitive information in your LLM application traffic, including personal information, financial data, and health records.
+
+Your Sensitive Data Scanner allotment scales with your LLM span usage: every 10,000 LLM spans includes 1 GB of Sensitive Data Scanner usage.
+
+| LLM spans | Included Sensitive Data Scanner usage |
+|-----------|---------------------------------------|
+| 40,000    | 4 GB                                  |
+| 100,000   | 10 GB                                 |
+| 300,000   | 30 GB                                 |
+
+This allotment applies to every plan, including the free tier. Usage beyond your allotment is billed as Sensitive Data Scanner usage.
+
+## Troubleshooting
+
+For technical questions, contact [Datadog support][9].
+
+Contact [Sales][11] or your [Customer Success][12] Manager to discuss pricing or billing for your account.
+
+## Further reading
+
+{{< partial name="whats-next/whats-next.html" >}}
+
+[1]: /llm_observability/
+[2]: https://www.datadoghq.com/pricing/?product=agent-observability#products
+[3]: /llm_observability/improve/experiments/
+[4]: /llm_observability/instrument/sdk/
+[5]: /llm_observability/instrument/agentic/python
+[6]: /llm_observability/instrument/agentic/nodejs
+[7]: https://app.datadoghq.com/billing/usage
+[8]: /llm_observability/data_retention/
+[9]: /help/
+[10]: /security/sensitive_data_scanner/
+[11]: mailto:sales@datadoghq.com
+[12]: mailto:success@datadoghq.com
+[13]: /llm_observability/investigate/evaluations/
+[14]: /llm_observability/investigate/patterns/
+[15]: /llm_observability/investigate/evaluations/llm_as_a_judge_evaluations/connect_to_account/

hugo/content/en/account_management/billing/pricing.md

@@ -106,6 +106,15 @@ You can put controls in place for both Indexed and Ingested span volumes. For mo
   * In the event that a pipeline is not associated with a git repository, or git metadata is unavailable, the username of the person triggering the pipeline execution is used as the billable committer.
 * For Pipeline Visibility, every pipeline, pipeline stage, and pipeline job counts as a **pipeline span**. For Testing Visibility, every individual test run counts as a **test span**.
 
+## Agent Observability
+
+* Datadog charges based on the number of **LLM spans** ingested by the Agent Observability service. An LLM span represents a single request to an LLM provider, such as OpenAI or Anthropic.
+* One agent workflow can make several LLM requests, and each request produces its own LLM span. Datadog bills only on LLM spans, not on the surrounding workflow, tool, and retrieval spans in the same trace.
+* [Experiments][13] are billed the same way, on the number of LLM spans ingested.
+* Indexed LLM spans are included in the base price.
+* On-demand plans include an allotment of LLM spans each month at no cost, and are billed in blocks of LLM spans beyond it. Committed and enterprise pricing is negotiated separately.
+* For rates, worked examples, and usage estimation, see [Agent Observability Billing][14].
+
 ## Troubleshooting
 
 For technical questions, contact [Datadog support][7].
@@ -124,3 +133,5 @@ Contact [Sales][8] or your [Customer Success][9] Manager to discuss hourly prici
 [10]: /real_user_monitoring/rum_without_limits/
 [11]: https://www.datadoghq.com/pricing/?product=real-user-monitoring#products
 [12]: /account_management/billing/metric_name_pricing/
+[13]: /llm_observability/improve/experiments/
+[14]: /account_management/billing/llm_observability/