Data Engineer Team Lead
Confirmed live in the last 24 hours
Accenture Federal Services
Compensation
$160,700 - $306,500/year
Job Description
As the Data Engineer Team Lead, you will lead a team of talented engineers responsible for building and maintaining the data lifeblood. You will provide the technical vision and hands-on leadership for the design, development, and sustainment of all data pipelines. This senior role requires you to champion innovation through governance, driving the adoption of reusable templates, automation, and modern data engineering practices to deliver resilient, scalable, and cost-efficient data solutions for the DoD.
Responsibilities:
- Lead, mentor, and manage a team of data engineers working on new pipeline development and operations & maintenance (O&M).
- Drive the technical strategy for the data pipeline ecosystem, ensuring stability, scalability, and efficiency.
- Enforce the use of reusable pipeline templates, automated monitoring patterns, and Infrastructure-as-Code (IaC) deployment standards established by the architecture team.
- Oversee the development of new data pipelines using modern, modular patterns like Databricks Delta Live Tables.
- Direct the optimization of existing pipelines through the implementation of automated monitoring, alerting, and proactive schema drift detection.
- Facilitate code reviews, enforce documentation standards, and ensure the team adheres to agile best practices.
- Collaborate with the Solution Architect to identify and implement technical improvements, such as leveraging GPUs for large-scale transformations.
Must have:
- 10+ years of experience in data engineering or software engineering
- Expert-level proficiency with Python, SQL, Spark, or PySpark
- Deep experience with cloud data platforms (e.g., AWS or Azure) and data engineering platforms like Databricks, Palantir, or Snowflake
- Demonstrated experience leading projects
- US Citizenship (No Dual Citizenship)
Nice to have:
- Experience working in high-security DoD environments (e.g., SIPR, JWICS)
- Hands-on experience with Databricks Delta Live Tables, Terraform for IaC, and CI/CD pipelines
- Familiarity with data orchestration tools (e.g., Airflow) and data quality frameworks (e.g., Great Expectations)
- Experience with streaming data technologies (e.g., Kafka) and containerization (Docker, Kubernetes)
- Extensive experience with the development and maintenance of scalable ETL/ELT tools and services
Security Clearance:
- Active Secret or TS or TS/SCI clearance
As required by local law, Accenture Federal Services provides reasonable ranges of compensation for hired roles based on labor costs in the states of California, Colorado, Hawaii, Illinois, Maryland, pythongoawsazurekubernetesdockeraidatadesign
Similar Jobs
Walmart
Senior Incident Response Engineer (Purple Team)
Newsela
Contractor: Lead Analytics Engineer - Data Team
CACI International
MDM Engineer - Team Lead
VML (Wunderman Thompson)