Modern data platforms are evolving rapidly, and Google Cloud BigQuery has become a core part of analytics, AI, and large-scale reporting architectures. Teams (including Harness) rely on BigQuery to process and analyze massive datasets, but managing schema changes in a secure, repeatable way can still be challenging.
Today, we’re excited to announce BigQuery support for Harness Database DevOps, enabling teams to bring the same automation, governance, and reliability they expect from application DevOps to their BigQuery deployments.
With this release, organizations can now manage BigQuery schema changes using pipeline-driven Database DevOps workflows directly within Harness, while also leveraging secure OIDC-based authentication for keyless access.
The Challenge: Managing BigQuery Changes at Scale
BigQuery helps organizations move fast with data, but database change management often remains manual and fragmented.
Common challenges include:
- Manual schema deployments that slow down releases
- Limited visibility into schema changes across environments
- Inconsistent promotion workflows between development, staging, and production
- Managing long-lived service account keys
- Difficulty enforcing governance and approvals
Without a standardized deployment process, teams struggle to balance speed, reliability, and security.
Bringing Database DevOps to BigQuery
Harness Database DevOps now supports BigQuery as a first-class database platform, allowing teams to manage schema changes through automated, pipeline-driven workflows.
This means BigQuery schema changes can now be treated just like application code versioned, tested, approved, and promoted through environments using Harness pipelines.
With BigQuery support, teams can:
- Automate schema deployments using Harness pipelines
- Version control database changes alongside application code
- Promote changes consistently across environments
- Enforce approvals and governance policies before production releases
- Track and audit deployments with full visibility
- Eliminate static credentials using OIDC authentication
The result is a modern Database DevOps workflow for BigQuery that helps teams release faster without sacrificing security or reliability.
Key Capabilities
Native BigQuery Integration
Harness Database DevOps can now connect directly to BigQuery environments using BigQuery JDBC connector powered by the Simba BigQuery JDBC driver.
Example JDBC URL:
jdbc:bigquery://https://www.googleapis.com/bigquery/v2:443;ProjectId=YOUR_PROJECT_ID;DefaultDataset=YOUR_DATASET;Location=YOUR_REGION;
OAuth access tokens are injected automatically during authentication, removing the need for manual credential management.
Secure OIDC-Based Authentication
Harness supports OIDC authentication using GCP Workload Identity Federation, allowing teams to securely authenticate to BigQuery without storing long-lived service account keys.
During pipeline execution:
- Harness generates a short-lived OIDC token
- GCP Security Token Service exchanges the token
- Temporary credentials are generated dynamically
- Harness securely authenticates to BigQuery at runtime
This improves:
- Security posture
- Compliance readiness
- Credential management
- Operational reliability
No static JSON keys are stored in Harness or delegate environments.
Automated Database Change Pipelines
Use Harness pipelines to automate BigQuery schema deployments with repeatable workflows across environments.
Teams can:
- Trigger deployments from Git changes
- Standardize promotion workflows
- Validate changes before production releases
- Automate schema delivery using CI/CD
Governance and Control
Leverage Harness approval gates, RBAC, and policy enforcement to ensure safe production changes. This helps organizations introduce governance into analytics database deployments without slowing down delivery velocity.
Deployment Visibility and Auditability
Track every BigQuery deployment with:
- Pipeline execution history
- Deployment logs
- Approval records
- Change visibility across environments
This creates a more transparent and auditable deployment process for data teams.
Why This Matters
As organizations increasingly rely on BigQuery to power analytics and AI workloads, database changes require the same level of automation and governance as application deployments.
By bringing BigQuery into Harness Database DevOps, teams can:
- Reduce manual deployment risk
- Improve collaboration between platform and data teams
- Standardize analytics database release processes
- Improve security with keyless authentication
- Accelerate delivery of data platform changes
Getting Started
BigQuery support for Harness Database DevOps is now available.
To get started:
- Configure a BigQuery JDBC connector in Harness
- Enable OIDC authentication using GCP Workload Identity Federation
- Add BigQuery change scripts to your repository
- Create a Harness pipeline to deploy and promote changes
- Automate BigQuery releases with confidence
Learn More on setting up our documentation.
Learn More
To learn more about using BigQuery with Harness Database DevOps, check out our documentation or schedule a demo.
Additional Resource - Warehouse Native BigQuery Integration
All this author’s posts
Animesh Pathak is a Developer Relations Engineer with a strong focus on Database DevOps, APIs, testing, and open-source innovation.
