Runtime Configuration

Updated

September 10, 2026

Harness Security Testing Agent vs Datadog Feature Flags | Harness Comparisons | Runtime Configuration

Harness FME delivers predictable per-user pricing, built-in experimentation, OPA governance, and platform independence — without MFCR billing layered on top of your existing Datadog observability spend.

Predictable per-user pricing vs. opaque MFCR billing layered on top of host, APM, and RUM costsPricing
Works alongside any observability tool vs. requires Datadog APM and RUM for core valuePlatform Independence
Built-in and included vs. a separate Datadog productExperimentation
Unified CI, CD, IDP, IaCM, CCM vs. observability and security onlyDevOps Platform

Feature Comparison

FeatureHarnessDatadog Feature Flags
Pricing and Packaging
Predictable pricing model
SupportedFlat per-user, no overages
Not supportedMFCR billing layered on host/APM/RUM costs
Experimentation included in base price
Supported
Not supportedDatadog Experiments is a separate product
Events shared across monitoring and experiments
SupportedOne event charge
Not supportedSeparate product billing
No overage charges
Supported
Not supportedUsage-based MFCR billing
All capabilities at one tier
Supported
Not supportedModular, per-product billing
Platform-independent (no observability lock-in)
SupportedStandalone, works with any monitoring tool
Not supportedCore value requires Datadog APM/RUM
Feature Management
Boolean and multi-variant flags
Supported
Supported
Percentage rollouts
Supported
Supported
Targeted audience rules
Supported
Supported
Scheduled rollouts
Supported
Supported
No-code dynamic configurations
Supported
Partially supportedDynamic config tied to Datadog telemetry
Custom SDK flag retrieval
Supported
Not supported
Flag archiving with preserved history
SupportedMarch 2026
Not supportedDeletion removes history
Rollout board
Supported
Not supported
Stale flag cleanup (AI-assisted)
SupportedOPA policies and Pipelines
SupportedBits AI and MCP integrations
Automated canary releases
Supported
SupportedDriven by Datadog monitors
Circuit-breaker automated rollbacks
Supported
SupportedDriven by Datadog SLOs
On-device SDK evaluation
Supported
SupportedLocal flag rule evaluation
Governance and Approvals
Policy As Code (OPA) at flag save time
SupportedNative OPA (March 2026)
Not supported
Advanced approval flows
Supported
Partially supportedStandard approval controls
RBAC with fine-grained permissions
Supported
Supported
SCIM provisioning
Supported
Supported
SSO / SAML
Supported
Supported
Audit logs
Supported
Supported
Flag archive with preserved audit trail
Supported
Not supported
Release Monitoring
Release monitoring
Supported
Supported
Native APM/trace correlation
Partially supportedVia Datadog integration
SupportedNative, no integration needed
Native RUM/session correlation
Partially supportedVia Datadog integration
SupportedNative
Out-of-the-box metrics (auto-created)
Supported
SupportedCore Web Vitals, error rates, latency
Enforced guardrail monitoring
SupportedIncluded
SupportedVia Datadog monitors
Automated rollback on regression
Supported
SupportedCircuit breakers via Datadog
Works without vendor observability stack
Supported
Not supportedRequires Datadog for full value
Experimentation
A/B and multi-variant testing
Supported
SupportedVia Datadog Experiments
Sequential testing
Supported
Supported
Multiple comparison correction
Supported
Partially supportedNot publicly documented
Multi-armed bandits
Not supported
Not supported
AI for results interpretation
Supported
Partially supportedGuardrail metrics and diagnostics
Warehouse-native experimentation
SupportedSnowflake, Redshift (GA April 2026)
SupportedWarehouse plus Datadog telemetry combined
LLM/AI offline experimentation
Not supported
SupportedDatasets, evaluators, human review, prompt playground
Experimentation in base price
Supported
Not supportedDatadog Experiments is separate
Data Architecture and Privacy
On-device flag evaluation (SDK)
Supported
SupportedLocal evaluation from cached rules
No user data sent to vendor cloud for evaluation
Supported
SupportedLocal SDK evaluation
Platform-independent (no observability lock-in)
Supported
Not supportedCore value requires Datadog
Broad SDK support
Supported
Supported
Integrations: data import
SupportedGA, mParticle, Segment, Sentry
SupportedNative Datadog ecosystem
Integrations: monitoring tools
SupportedDatadog, Dynatrace, New Relic, etc.
Partially supportedDatadog native only
AI Capabilities
AI for experiment results interpretation
Supported
Partially supportedGuardrail diagnostics
LLM offline experimentation (datasets, evaluators)
Not supported
SupportedDatadog LLM Observability
AI-assisted stale flag cleanup
SupportedVia OPA and Harness Pipelines
SupportedBits AI and MCP
AI-powered CI/CD pipeline integration
SupportedVia Harness platform
Not supported
Platform Integration
Integrated within a DevOps platform
SupportedCI, CD, IDP, IaCM, CCM, STO
Not supportedObservability and security only
Native CI/CD pipeline integration
Supported
Not supportedCustom integration required
Pipelines for flag lifecycle automation
Supported
Not supported
SDLC Knowledge Graph
SupportedVia Harness platform
Not supported
Internal Developer Portal
SupportedVia Harness IDP
Not supported
SupportedFull supportPartially supportedPartial supportNot supportedNot supported

Key Differentiators

Why Teams Choose Harness FME Over Datadog Feature Flags

Harness
Datadog Feature Flags

Predictable Pricing Without Observability Lock-In

Harness

Harness FME charges a flat per-user rate with no overage fees. Events for release monitoring and experiments share a single billing line. All platform capabilities are included at one tier. Pricing scales predictably at enterprise volumes regardless of how many flag evaluations your application performs. Teams can run more experiments and more frequent rollouts without worrying about unexpected bills at month-end.

Datadog Feature Flags

Datadog Feature Flags is billed per million Monthly Flag Configuration Requests (MFCRs), a usage-based unit that grows with every flag evaluation across your fleet. This cost is layered on top of Datadog's existing per-host infrastructure pricing ($15-34/host/month), per-APM-span charges, per-GB log ingestion fees, and per-session RUM costs. Mid-market teams already pay $30K-$150K per year for Datadog core observability before adding feature flags. Enterprise deployments can reach $500K or more. Total cost of ownership for Datadog Feature Flags is extremely difficult to predict because it depends on how heavily your application evaluates flags, how many hosts you run, and which other Datadog products you have enabled.

Feature Management That Works Alongside Any Observability Stack

Harness

Harness FME integrates natively with Datadog (and any other monitoring tool: Dynatrace, New Relic, Grafana, Prometheus) via its integration layer. Teams can keep Datadog for observability and use Harness FME for feature management without forcing a single-vendor lock-in. The Harness FME Datadog integration automatically enriches RUM data with feature flag variant information, giving teams flag-to-trace correlation without making Datadog the owner of their feature management platform or adding MFCR billing on top of existing observability spend.

Datadog Feature Flags

Datadog Feature Flags is explicitly designed as an extension of the Datadog observability platform. Its primary value proposition, correlating every feature flag with APM traces, RUM sessions, and SLO data, only works if Datadog is your monitoring backbone. Teams not running Datadog APM or RUM get little differentiated value from the product compared to a standalone flag management tool. Choosing Datadog Feature Flags means committing your feature management strategy to the same vendor as your observability stack, with all the pricing and contract exposure that entails.

Complete Built-In Experimentation, Not a Separate Product

Harness

Harness FME includes experimentation as a native, first-class capability within a single price. A/B tests, multi-variant tests, sequential testing, and multiple comparison correction are all built in. Metrics are auto-created from performance data. AI-assisted results interpretation surfaces insights without requiring data science involvement. Warehouse-native experimentation (Snowflake, Amazon Redshift) went GA in April 2026, with Harness only receiving aggregated results and never storing raw warehouse data.

Datadog Feature Flags

Datadog Experiments is a separate product from Datadog Feature Flags. Running warehouse-native experiments that connect flag variants to business metrics (revenue, LTV, retention) requires a Datadog data warehouse integration, a separate product investment, and the associated data transfer costs. Teams wanting to run A/B tests against KPIs that live in Snowflake or Redshift need to configure both products and manage the data pipeline between them.

Policy As Code Governance and True Flag Lifecycle Management

Harness

Harness FME integrates with Harness Policy As Code (OPA) natively, enforcing governance at every flag create, update, delete, or archive operation. Teams can validate naming conventions, targeting rules, and rollout percentages before anything reaches production. Flag archiving (March 2026) removes flags from active views and SDKs while preserving all historical data for compliance and audit. This is the same governance engine used across CI, CD, and IaC within the Harness platform.

Datadog Feature Flags

Datadog Feature Flags includes RBAC and standard approval workflows, but there is no OPA integration and no governance enforced at flag save time. Stale flag detection is available via Bits AI and MCP integrations (which identify unused flags and generate pull requests to remove dead code). However, deletion removes flag history. There is no true archiving capability that preserves historical impressions, configurations, and audit logs for compliance purposes.

Part of a Unified DevOps Platform

Harness

Harness FME is a module within the Harness Software Delivery Platform, which includes CI, CD and GitOps, Internal Developer Portal, IaCM, Cloud Cost Management, Security Testing Orchestration, and more. Teams using Harness FME alongside Harness CI and CD gain a closed-loop release system: code ships through Harness CI/CD, features are exposed via Harness FME, and experiment outcomes feed back into the same unified platform. Flag lifecycle automation, including retirement and cleanup, can be driven by Harness Pipelines natively.

Datadog Feature Flags

Datadog is an observability and security platform. It does not include CI, CD and GitOps, an Internal Developer Portal, Infrastructure as Code Management, or Cloud Cost Management. Connecting Datadog Feature Flags to a software delivery pipeline requires custom integration work and the management of cross-tool workflows outside Datadog's scope.

Decision Guide

Datadog Feature Flags is good for

  • Your team is fully committed to the Datadog platform for observability and the per-MFCR billing is acceptable within your existing Datadog contract structure.
  • Your primary need is real-time flag-to-trace and flag-to-session correlation without any integration work. Datadog's native embedding of flag state into APM and RUM is a genuine differentiator.
  • You are building LLM-powered applications and need offline dataset experimentation, prompt playground, evaluators, and production LLM tracing in a single product. Datadog's LLM Observability suite is industry-leading.
  • You need automated circuit-breaker rollbacks driven by SLOs and are already using Datadog monitors as your reliability source of truth.

Harness is best for

  • You want feature management pricing that is predictable and independent of your observability spend. Datadog Feature Flags adds MFCR costs on top of existing per-host, per-span, and per-session charges that compound at scale.
  • Your team uses Datadog for monitoring but does not want to make Datadog the owner of your feature flag platform or absorb the vendor lock-in that entails.
  • You need experimentation (A/B tests, sequential testing, warehouse-native metrics) included in base pricing without provisioning a separate product.
  • You operate in a regulated industry and need Policy As Code governance enforced at flag save time, plus true flag archiving with preserved historical data for compliance.
  • You are already on Harness CI, CD, or other modules and want flag lifecycle automation tied into your delivery pipelines natively.
  • You need a feature management tool that integrates with multiple observability vendors rather than being purpose-built for one.
Start for Free

Summary

Datadog Feature Flags is a genuinely compelling product for teams already running the full Datadog stack.

FAQs

More Comparisons

Harness vs

Spacelift

Spacelift excels at GitOps-based Terraform automation but lacks native CI/CD integration, runtime inputs, and cross-lifecycle policy enforcement. Harness IaCM unifies infrastructure provisioning, pipeline orchestration, governance, and cost controls on a single platform.

Infrastructure as Code Management

Compare →

Harness IaCM vs Spacelift
Harness IaCM vs Spacelift

Harness vs

OpsGenie

OpsGenie reaches end-of-life in April 2027. Harness AI-SRE is the AI-native alternative — full incident lifecycle, Human-Aware Change Agent, AI Scribe, and deployment context in one platform.

AI SRE

Compare →

Harness AI-SRE vs OpsGenie
Harness AI-SRE vs OpsGenie

Harness vs

GitHub Actions

GitHub Actions trades build speed and security for convenience. Harness CI delivers up to 10x faster builds with Test Intelligence, SLSA L3-compliant infrastructure, OPA policy enforcement, and Harness AI — without the architectural vulnerabilities.

Continuous Integration

Compare →

Harness CI vs GitHub Actions
Harness CI vs GitHub Actions

Get Started

Get Started with Harness AI

Try the full platform free. No module restrictions, no credit card.