# SQL Server + Databricks

> Move tables and schemas from SQL Server to Databricks with no code. Reliable incremental pipeline with automatic alerts and change detection.

Source: https://www.erathos.com/en/pipelines/sql-server-databricks
Em português: https://www.erathos.com/pipelines/sql-server-databricks

SQL Server is a relational database management system developed by Microsoft, used to store and manage large volumes of data. Databricks, on the other hand, is a serverless big data platform that provides robust capabilities for storing and analyzing data at scale.

With Erathos, you can integrate data from SQL Server into Databricks in just a few minutes. Our platform handles the entire data movement process into your analytics environment and lets you combine that data with other sources in your data warehouse. That way, your time goes toward what truly creates value — uncovering actionable insights and making more data-driven decisions.

### Which SQL Server data does Erathos sync with Databricks?

The integration automatically syncs the main SQL Server objects:

- **Selected tables** — incremental replication of any configured table
- **Schema drift** — new columns are detected and automatically added to the destination
- **Primary keys and timestamps** — used for efficient incremental synchronization
- **Historical data** — full initial load followed by incremental updates

### Why sync SQL Server with Databricks?

Keeping an analytical copy of your SQL Server operational data in Databricks ensures that heavy queries don’t affect production application performance. With incremental replication and schema drift detection, your data warehouse stays up to date while the transactional database remains stable and responsive.

### How it works

Erathos connects to SQL Server through the official API and syncs your data incrementally — only new or updated records are processed in each run, keeping pipelines fast and Databricks costs predictable. You choose the sync frequency (from every 5 minutes to daily), the objects to sync, and the target dataset. Every run is fully observable: runtime, rows processed, errors with context, and instant alerts via Slack or email if something goes wrong.

## Data in your data warehouse in minutes

### Ready-to-use SQL Server connector

Replicate SQL Server tables to Databricks with incremental synchronization and automatic schema drift detection—without breaking pipelines when the structure changes.

### Total control over your SQL Server pipelines

Configure frequency, sync type, and partitioning by table. Data arrives in Databricks ready for ML, analytics, and ad hoc queries—with predictable cost.

### End-to-end observability

Stop finding out SQL Server failed only after the business team complains. Every run is logged with runtime, processed row counts, and error context. Automatic alerts via Slack, Discord, or email as soon as anything deviates from expected behavior — keeping replication up to date without impacting the transactional database.

## Centralizing SQL Server data in Databricks has never been easier.

Erathos is a data ingestion platform for teams that need to replicate operational databases for analytics. With the SQL Server connector, you can incrementally sync tables and transactional records to Databricks—with schema drift detection and complete logs for every run.

## FAQ

### What is Erathos and how can it help my company?

Erathos is a data ingestion platform built for reliability, transparency, and control. We help data teams connect tools like SQL Server to their data warehouse—with full observability into every run, zero maintenance, and none of the black-box opacity of traditional market tools.

### How does Erathos synchronize data from SQL Server to Databricks?

Erathos uses incremental replication to sync SQL Server tables to Databricks. Schema drift is automatically detected—if a column is added or changed in SQL Server, the pipeline adapts without manual intervention.

### How often does Erathos synchronize data from SQL Server to Databricks?

You can configure synchronization frequency from every 5 minutes up to once daily at the table level. Erathos uses incremental sync—only new or updated records are processed in each run, keeping the SQL Server pipeline efficient and Databricks costs predictable.

### What happens if a SQL Server synchronization fails?

Erathos automatically detects failures and sends alerts to your email, Slack, or Discord with full context—not just "job failed." Smart retries handle transient errors, and every execution is logged with run time, processed rows, and error context so your team can debug in minutes, not hours.

### Is there a free trial period for the SQL Server connector?

Yes. Every Erathos connector includes a 14-day free trial. Connect SQL Server to Databricks and start syncing immediately—no credit card required.