Mediabistro logo
job logo

Lead Databricks Engineer – Cloud Migration & Lakehouse (Jersey City)

Galent, Jersey City, NJ, United States


Key Responsibilities

Lead and execute

migration of legacy data platforms (on‑prem / non‑standard tools)

to

Databricks on cloud

under the Olympus program
Perform

application, data, and pipeline refactoring

to cloud‑native Databricks patterns
Drive

migration planning

including dependency analysis, sequencing, and cutover strategy
Support coexistence models and transition from

dual‑run to cloud‑only execution

Databricks Lakehouse Engineering
Design and implement

Databricks Lakehouse architecture
Build scalable batch and streaming pipelines using

PySpark, Spark SQL
Leverage

Delta Lake

for reliability, versioning, and performance
Optimize compute usage and cost in line with

enterprise cloud efficiency goals

Required Qualifications
8–12+ years in

data engineering / platform modernization
Strong hands‑on experience with

Databricks

in large‑scale enterprises
Proven experience delivering

cloud migration programs

(on‑prem → cloud)
Deep expertise in

Apache Spark, PySpark, Spark SQL
Experience embedding

controls, reconciliation, and data quality

in migrations
Experience in

regulated environments

(banking / financial services preferred)