Lead Spark, Scala Senior Data Engineer
Tata Consultancy Services, Austin, TX, United States
Job Description
Skills & Experience required for the role.
Must Have Technical/Functional Skills
Strong experience in Apache Spark with Scala
Experience building and working on Spark application with Scala data frame APIs
Knowledge of Cloud AWS/S3, Iceberg, Git
Strong SQL and data modelling skills
Experience with building/managing application for large scale data platforms – storage, computing aspects, data ingestion/governance and data management and performance.
Skilled at troubleshooting complex issues in large scale distributed systems.
Roles & Responsibilities
Excellent communication and stakeholder management skills
Strong leadership and coordination capabilities
Ability to drive discussions with both technical and non-technical stakeholders
Act as the primary onsite coordinator between client stakeholders and offshore teams.
Lead onsite‑offshore collaboration, ensuring clear communication of requirements, timelines, and deliverables.
Proactive problem‑solving mindset
Ability to work in a fast‑paced client‑facing environment
Attend and represent the team in client meetings, providing technical insights and progress updates.
Proactively identify risks, blockers, and dependencies, and drive solutions.
Provide technical guidance to offshore team members.
Salary Range: $86,000-$140,000 a year
#J-18808-Ljbffr
Skills & Experience required for the role.
Must Have Technical/Functional Skills
Strong experience in Apache Spark with Scala
Experience building and working on Spark application with Scala data frame APIs
Knowledge of Cloud AWS/S3, Iceberg, Git
Strong SQL and data modelling skills
Experience with building/managing application for large scale data platforms – storage, computing aspects, data ingestion/governance and data management and performance.
Skilled at troubleshooting complex issues in large scale distributed systems.
Roles & Responsibilities
Excellent communication and stakeholder management skills
Strong leadership and coordination capabilities
Ability to drive discussions with both technical and non-technical stakeholders
Act as the primary onsite coordinator between client stakeholders and offshore teams.
Lead onsite‑offshore collaboration, ensuring clear communication of requirements, timelines, and deliverables.
Proactive problem‑solving mindset
Ability to work in a fast‑paced client‑facing environment
Attend and represent the team in client meetings, providing technical insights and progress updates.
Proactively identify risks, blockers, and dependencies, and drive solutions.
Provide technical guidance to offshore team members.
Salary Range: $86,000-$140,000 a year
#J-18808-Ljbffr