Data Engineer - Databricks

Capgemini

Software Companies

Atlanta, GA - USA

Senior Specialist / Project Manager

Experteer Overview

In this role you will define and deploy end-to-end data architectures using Databricks medallion architecture, and lead delivery of Databricks solutions. You’ll guide architectural decisions and mentor senior engineers within a hybrid offshore/onshore model. You will collaborate with senior client stakeholders to shape data strategy and unlock value from diverse data sources. This is a hands-on leadership role at scale, focused on impactful, technology-driven transformation.

Compensation / Benefits

Paid time off (12-25 days)
Medical, dental, vision coverage
Retirement savings plans (e.g., 401(k)/RRSP)
Life and disability insurance
Employee assistance programs
Other benefits according to local policy

Responsibilities

Define and deploy end-to-end data architecture including Databricks medallion architecture
Lead large teams of engineers to deploy Databricks solutions
Manage senior client stakeholders and guide architectural decisions

Key requirements

6+ years of experience in Data Engineering
At least 4 years designing and delivering data engineering solutions with Databricks
Expert PySpark/Python development
Expert SQL development
Cloud platform experience in two of Azure, AWS, Google Cloud
Experience deploying Delta Lake solutions into production
Experience extracting value from large, complex data sets
Solid database engineering and design principles
Familiarity with CI/CD methods
Background with orchestration tools such as Airflow
Strong knowledge of Unity Catalog
Experience with ETL tools (Informatica, Talend, Matillion) preferred
Experience with stakeholder management
Delta Sharing and Marketplace expertise
Experience with Databricks Apps
Knowledge of Databricks Genie, AI/BI and Databricks Data Visualization
Conceptual, logical and physical data modeling experience

Stakeholder management Leadership and mentoring Cross-functional collaboration Databricks Medallion Architecture PySpark/Python SQL

Description

In this role you will define and deploy end-to-end data architectures using Databricks medallion architecture, and lead delivery of Databric…

1M+ top positions worldwide with salary benchmarks
Be discreetly found and contacted by headhunters
Exclusively for senior-level professionals and executives

Already a member?