Runtime Configuration

Updated

June 24, 2026

Harness Security Testing Agent vs Datadog Feature Flags | Harness Comparisons | Runtime Configuration

Harness FME delivers predictable per-user pricing, built-in experimentation, OPA governance, and platform independence — without MFCR billing layered on top of your existing Datadog observability spend.

Predictable per-user pricing vs. opaque MFCR billing layered on top of host, APM, and RUM costsPricing
Works alongside any observability tool vs. requires Datadog APM and RUM for core valuePlatform Independence
Built-in and included vs. a separate Datadog productExperimentation
Unified CI, CD, IDP, IaCM, CCM vs. observability and security onlyDevOps Platform

Feature Comparison

FeatureHarnessDatadog Feature Flags
Pricing and Packaging
Predictable pricing model
Flat per-user, no overages
MFCR billing layered on host/APM/RUM costs
Experimentation included in base price
Datadog Experiments is a separate product
Events shared across monitoring and experiments
One event charge
Separate product billing
No overage charges
Usage-based MFCR billing
All capabilities at one tier
Modular, per-product billing
Platform-independent (no observability lock-in)
Standalone, works with any monitoring tool
Core value requires Datadog APM/RUM
Feature Management
Boolean and multi-variant flags
Percentage rollouts
Targeted audience rules
Scheduled rollouts
No-code dynamic configurations
Dynamic config tied to Datadog telemetry
Custom SDK flag retrieval
Flag archiving with preserved history
March 2026
Deletion removes history
Rollout board
Stale flag cleanup (AI-assisted)
OPA policies and Pipelines
Bits AI and MCP integrations
Automated canary releases
Driven by Datadog monitors
Circuit-breaker automated rollbacks
Driven by Datadog SLOs
On-device SDK evaluation
Local flag rule evaluation
Governance and Approvals
Policy As Code (OPA) at flag save time
Native OPA (March 2026)
Advanced approval flows
Standard approval controls
RBAC with fine-grained permissions
SCIM provisioning
SSO / SAML
Audit logs
Flag archive with preserved audit trail
Release Monitoring
Release monitoring
Native APM/trace correlation
Via Datadog integration
Native, no integration needed
Native RUM/session correlation
Via Datadog integration
Native
Out-of-the-box metrics (auto-created)
Core Web Vitals, error rates, latency
Enforced guardrail monitoring
Included
Via Datadog monitors
Automated rollback on regression
Circuit breakers via Datadog
Works without vendor observability stack
Requires Datadog for full value
Experimentation
A/B and multi-variant testing
Via Datadog Experiments
Sequential testing
Multiple comparison correction
Not publicly documented
Multi-armed bandits
AI for results interpretation
Guardrail metrics and diagnostics
Warehouse-native experimentation
Snowflake, Redshift (GA April 2026)
Warehouse plus Datadog telemetry combined
LLM/AI offline experimentation
Datasets, evaluators, human review, prompt playground
Experimentation in base price
Datadog Experiments is separate
Data Architecture and Privacy
On-device flag evaluation (SDK)
Local evaluation from cached rules
No user data sent to vendor cloud for evaluation
Local SDK evaluation
Platform-independent (no observability lock-in)
Core value requires Datadog
Broad SDK support
Integrations: data import
GA, mParticle, Segment, Sentry
Native Datadog ecosystem
Integrations: monitoring tools
Datadog, Dynatrace, New Relic, etc.
Datadog native only
AI Capabilities
AI for experiment results interpretation
Guardrail diagnostics
LLM offline experimentation (datasets, evaluators)
Datadog LLM Observability
AI-assisted stale flag cleanup
Via OPA and Harness Pipelines
Bits AI and MCP
AI-powered CI/CD pipeline integration
Via Harness platform
Platform Integration
Integrated within a DevOps platform
CI, CD, IDP, IaCM, CCM, STO
Observability and security only
Native CI/CD pipeline integration
Custom integration required
Pipelines for flag lifecycle automation
SDLC Knowledge Graph
Via Harness platform
Internal Developer Portal
Via Harness IDP
Full supportPartial supportNot supported

Key Differentiators

Why Teams Choose Harness FME Over Datadog Feature Flags

Harness
Datadog Feature Flags

Predictable Pricing Without Observability Lock-In

Harness

Harness FME charges a flat per-user rate with no overage fees. Events for release monitoring and experiments share a single billing line. All platform capabilities are included at one tier. Pricing scales predictably at enterprise volumes regardless of how many flag evaluations your application performs. Teams can run more experiments and more frequent rollouts without worrying about unexpected bills at month-end.

Datadog Feature Flags

Datadog Feature Flags is billed per million Monthly Flag Configuration Requests (MFCRs), a usage-based unit that grows with every flag evaluation across your fleet. This cost is layered on top of Datadog's existing per-host infrastructure pricing ($15-34/host/month), per-APM-span charges, per-GB log ingestion fees, and per-session RUM costs. Mid-market teams already pay $30K-$150K per year for Datadog core observability before adding feature flags. Enterprise deployments can reach $500K or more. Total cost of ownership for Datadog Feature Flags is extremely difficult to predict because it depends on how heavily your application evaluates flags, how many hosts you run, and which other Datadog products you have enabled.

Feature Management That Works Alongside Any Observability Stack

Harness

Harness FME integrates natively with Datadog (and any other monitoring tool: Dynatrace, New Relic, Grafana, Prometheus) via its integration layer. Teams can keep Datadog for observability and use Harness FME for feature management without forcing a single-vendor lock-in. The Harness FME Datadog integration automatically enriches RUM data with feature flag variant information, giving teams flag-to-trace correlation without making Datadog the owner of their feature management platform or adding MFCR billing on top of existing observability spend.

Datadog Feature Flags

Datadog Feature Flags is explicitly designed as an extension of the Datadog observability platform. Its primary value proposition, correlating every feature flag with APM traces, RUM sessions, and SLO data, only works if Datadog is your monitoring backbone. Teams not running Datadog APM or RUM get little differentiated value from the product compared to a standalone flag management tool. Choosing Datadog Feature Flags means committing your feature management strategy to the same vendor as your observability stack, with all the pricing and contract exposure that entails.

Complete Built-In Experimentation, Not a Separate Product

Harness

Harness FME includes experimentation as a native, first-class capability within a single price. A/B tests, multi-variant tests, sequential testing, and multiple comparison correction are all built in. Metrics are auto-created from performance data. AI-assisted results interpretation surfaces insights without requiring data science involvement. Warehouse-native experimentation (Snowflake, Amazon Redshift) went GA in April 2026, with Harness only receiving aggregated results and never storing raw warehouse data.

Datadog Feature Flags

Datadog Experiments is a separate product from Datadog Feature Flags. Running warehouse-native experiments that connect flag variants to business metrics (revenue, LTV, retention) requires a Datadog data warehouse integration, a separate product investment, and the associated data transfer costs. Teams wanting to run A/B tests against KPIs that live in Snowflake or Redshift need to configure both products and manage the data pipeline between them.

Policy As Code Governance and True Flag Lifecycle Management

Harness

Harness FME integrates with Harness Policy As Code (OPA) natively, enforcing governance at every flag create, update, delete, or archive operation. Teams can validate naming conventions, targeting rules, and rollout percentages before anything reaches production. Flag archiving (March 2026) removes flags from active views and SDKs while preserving all historical data for compliance and audit. This is the same governance engine used across CI, CD, and IaC within the Harness platform.

Datadog Feature Flags

Datadog Feature Flags includes RBAC and standard approval workflows, but there is no OPA integration and no governance enforced at flag save time. Stale flag detection is available via Bits AI and MCP integrations (which identify unused flags and generate pull requests to remove dead code). However, deletion removes flag history. There is no true archiving capability that preserves historical impressions, configurations, and audit logs for compliance purposes.

Part of a Unified DevOps Platform

Harness

Harness FME is a module within the Harness Software Delivery Platform, which includes CI, CD and GitOps, Internal Developer Portal, IaCM, Cloud Cost Management, Security Testing Orchestration, and more. Teams using Harness FME alongside Harness CI and CD gain a closed-loop release system: code ships through Harness CI/CD, features are exposed via Harness FME, and experiment outcomes feed back into the same unified platform. Flag lifecycle automation, including retirement and cleanup, can be driven by Harness Pipelines natively.

Datadog Feature Flags

Datadog is an observability and security platform. It does not include CI, CD and GitOps, an Internal Developer Portal, Infrastructure as Code Management, or Cloud Cost Management. Connecting Datadog Feature Flags to a software delivery pipeline requires custom integration work and the management of cross-tool workflows outside Datadog's scope.

Decision Guide

Datadog Feature Flags is good for

  • Your team is fully committed to the Datadog platform for observability and the per-MFCR billing is acceptable within your existing Datadog contract structure.
  • Your primary need is real-time flag-to-trace and flag-to-session correlation without any integration work. Datadog's native embedding of flag state into APM and RUM is a genuine differentiator.
  • You are building LLM-powered applications and need offline dataset experimentation, prompt playground, evaluators, and production LLM tracing in a single product. Datadog's LLM Observability suite is industry-leading.
  • You need automated circuit-breaker rollbacks driven by SLOs and are already using Datadog monitors as your reliability source of truth.

Harness is best for

  • You want feature management pricing that is predictable and independent of your observability spend. Datadog Feature Flags adds MFCR costs on top of existing per-host, per-span, and per-session charges that compound at scale.
  • Your team uses Datadog for monitoring but does not want to make Datadog the owner of your feature flag platform or absorb the vendor lock-in that entails.
  • You need experimentation (A/B tests, sequential testing, warehouse-native metrics) included in base pricing without provisioning a separate product.
  • You operate in a regulated industry and need Policy As Code governance enforced at flag save time, plus true flag archiving with preserved historical data for compliance.
  • You are already on Harness CI, CD, or other modules and want flag lifecycle automation tied into your delivery pipelines natively.
  • You need a feature management tool that integrates with multiple observability vendors rather than being purpose-built for one.
Start for Free

Summary

Datadog Feature Flags is a genuinely compelling product for teams already running the full Datadog stack.

FAQs

More Comparisons

Harness vs

Liquibase Secure

Harness DB DevOps brings governed, automated database deployments into unified app + DB pipelines. Liquibase Secure is a database migration tool with governance layered on top that requires custom orchestration to reach parity.

Database DevOps

Compare →

Harness DB DevOps vs Liquibase Secure
Harness DB DevOps vs Liquibase Secure

Harness vs

Jellyfish

Jellyfish gives executives strong AI investment visibility and engineering analytics. Harness AI DLC Insights goes deeper into operational AI telemetry, prompt-to-production attribution, and delivery-platform outcomes.

AI DLC Insights

Compare →

Harness AI DLC Insights vs Jellyfish
Harness AI DLC Insights vs Jellyfish

Harness vs

Flexera

Kubernetes shared cluster costs spiral out of control without the right tools. Harness CCM solves what Flexera cannot.

Cloud & AI Cost Management

Compare →

Harness CCM vs Flexera
Harness CCM vs Flexera

Get Started

Get Started with Harness AI

Try the full platform free. No module restrictions, no credit card.