repositories
18 fields- Some of the fields
archivedcreated_atdefault_branchdescriptionforkforks_countfull_namehtml_urlidlanguagenameopen_issues_countand 6 more
GitHub + Databricks
GitHub is the world’s leading platform for code hosting, Git-based version control, and software development collaboration. Engineering teams centralize repositories, pull requests, code review, issues, and organization member activity in GitHub, making it one of the richest sources of data on software throughput, quality, and productivity.
In practice, GitHub works like the operating system for software delivery: from commit to merge, from bug report to closed issue, every engineering productivity signal is captured there, ready to be joined with product, support, and business data in a data warehouse.
With Erathos, you can integrate GitHub data into Databricks in just a few minutes. Our platform handles the entire data movement process into your analytics environment and makes it possible to combine that data with other sources in your Data Warehouse. That way, your time goes toward what truly creates value — uncovering actionable insights and making more data-driven decisions.
14-day free trial. No credit card required.
Trusted by great companies
Simplified extraction and ingestion
Move data in a few clicks
Connect your source
Authenticate your account and you're done. 100+ ready-made connectors, no code required.
Configure the sync
Pick the tables, the schedule and the update type: batch, cursor-based incremental or CDC.
Choose your destination
Load into BigQuery, Redshift, Databricks, PostgreSQL, ClickHouse, Amazon S3 and more.
What GitHub data does Erathos sync with Databricks?
The integration automatically syncs GitHub’s main objects:
- Repositories — name, organization, language, default branch, issue count, and activity dates
- Pull requests — author, reviewers, status, open, closed, and merge dates
- Issues — author, assignees, labels, status, milestone, and dates
- Commits — author, message, date, and repository
- Organization members — users, login, roles, and membership dates
Why sync GitHub with Databricks?
In Databricks, engineering data lives in the same lakehouse where your team runs ML models and advanced analytics — making it easy to close DORA metrics, build predictive models for delivery risk, and correlate engineering productivity with product signals.
Available data
What GitHub sends to Databricks
5 GitHub tables can be synced to Databricks. Each table is created in Databricks with the same name it has in the connector, inside the schema you choose when setting up the connection.
A closer look at some tables
issues
11 fields- Fields for incremental loads
- updated_at
- Some of the fields
updated_atbodyclosed_atcommentscreated_athtml_urlidnumberstatetitleuser.login
pull_requests
14 fields- Some of the fields
base.refbodyclosed_atcreated_atdrafthead.refhtml_urlidmerged_atnumberstatetitleand 2 more
A first query in Databricks
Reading the GitHub repositories table straight from Databricks. Replace your_schema with the schema you chose for the connection.
SELECT
archived,
created_at,
default_branch,
description
FROM your_schema.repositories
LIMIT 10Available tables
commits· under repositoriesissues· under repositoriesmemberspull_requests· under repositoriesrepositories
Why companies move data from GitHub to Databricks with Erathos
Centralizing GitHub data in Databricks has never been easier.
Erathos is a data ingestion platform for data teams. With the GitHub connector, you automatically export repositories, pull requests, issues, commits, and org members to Databricks — centralized engineering data ready to power DORA metrics, measure review bottlenecks, and provide evidence of controls for audits.
Why do data teams choose Erathos for GitHub?
Data in your data warehouse in minutes
GitHub connector ready to use
Connect GitHub to Databricks and automatically export repositories, pull requests, issues, commits, and org members. Centralized engineering data to power DORA metrics and engineering analytics — without CSVs or scripts.
Learn moreComplete control over your GitHub pipelines
Configure frequency, sync type, and partitioning by table. Data arrives in Databricks ready for ML, analytics, and ad hoc queries—with predictable cost.
Learn moreEnd-to-end observability
Stop finding out about GitHub failures only after the business team complains. Every run is logged with runtime, rows processed, and error context. Get automatic alerts via Slack, Discord, or email as soon as anything goes off track — so your data stays up to date and ready for analysis.
Learn more14-day free trial. No credit card required.
Our partners
Building data-driven stories
“Every new source implementation, if I had to do it myself, would take about two or three months. With Erathos, it's done in a few hours. I don't need the skills of a data engineer to generate real value from the company's data.”
Bruno RossoData Analyst, Brick Software
“Erathos revolutionized data management at WE. By integrating multiple SaaS tools into a single DW, our technical team now focuses on the core business. We implemented dashboards with insights across every area, enriching our organizational culture and improving our decision-making.”
Matheus NunesCTO & co-founder, WePayments
“We used to have a lot of rework, and now we don't. It's more efficient to work this way. If it's not your core business, hire Erathos. Spend your time modeling your own domain, not someone else's.”
Carlos SchwabeCo-Founder & CDO, Brick
“If I didn't have this infrastructure, I'd need three or four people to do what Erathos does today. I was able to generate real value from my data with a much leaner setup than I thought I'd need. That's the core of building a data-driven culture: the team only uses data when they can trust it.”
Thiago PazCFO, Brick
“Erathos brought a practical turnaround at CCM. We were able to integrate financial systems, CRM, and processes with BigQuery in just a few clicks, with no technical team required. That gave us a reliable data warehouse that powers automations, dashboards, and even our customer service bots.”
Gustavo LoforteTechnology Manager, CCM Group
“The robustness and efficiency of Erathos's connectors — whether for Meta, Google, RD Station, or ERPs like Bling and Conta Azul — make the whole process much faster and more reliable. The technical documentation is extremely well put together and intuitive, which makes implementation much easier.”
Sayuri ValenteProject Manager, Xperiun
Explore
Other paths for your data
Other destinations for GitHub
Other sources that land in Databricks
CRMs, ERPs, ad platforms and databases, all through the same managed pipeline.
FAQ
Frequently Asked Questions
Erathos is a data ingestion platform built for reliability, transparency, and control. We help data teams connect tools like GitHub to their data warehouse—with full observability into every run, zero maintenance, and none of the opacity found in traditional market tools.
Erathos syncs GitHub repositories, pull requests, issues, commits, and org members to Databricks. Data ready to calculate DORA metrics, measure PR lead time, identify review bottlenecks, and demonstrate access controls for audits.
You can configure sync frequency at the table level, from every 5 minutes up to once per day. Erathos uses incremental synchronization—only new or updated records are processed in each run—keeping your GitHub pipeline efficient and your Databricks costs predictable.
Erathos automatically detects failures and sends alerts to your email, Slack, or Discord with full context—not just "job failed." Smart retries handle transient errors, and every execution is logged with run time, processed rows, and error context so your team can debug in minutes, not hours.
Yes. Every Erathos connector includes a 14-day free trial. Connect GitHub to Databricks and start syncing immediately—no credit card required.