Lead Engineer

Job Summary 

Senior Data Engineer (T4) will support the design, development, and maintenance of enterprise grade data solutions for Guardian’s Investment Data platform - Investment Data Mart (IDM). This role is responsible for building scalable data pipelines, ensuring high quality data delivery, and partnering with business and technology teams to support Investments domain needs across asset classes such as Fixed Income, Equity, Commercial Mortgage Loans, Derivatives Products etc. 

The candidate must have deep technical expertise in modern data engineering, excellent problem solving skills, and the ability to work in an Agile environment. 

Key Responsibilities 

Requirements Elicitation & Analysis 

• Understand product vision, business requirements, data models, and platform objectives. 

• Collaborate with Product Owners, SMEs, and Architects to define technical requirements and data mapping specifications. 

• Translate business rules into detailed lowlevel technical designs (LLD). 

Project Planning, Tracking & Reporting 

• Estimate efforts for design, build, and test activities for assigned modules. 

• Provide input to sprint planning, schedule creation, and dependency identification. 

• Track and report progress, highlighting risks, blockers, and scope variations. 

• Ensure timely, high quality delivery of assigned work items. 

Design 

• Develop low level designs for ingestion, transformation, and delivery pipelines. 

• Evaluate alternate solutions and recommend optimal technical approaches. 

• Present LLDs in formal reviews and incorporate feedback. 

Development & Support 

• Build scalable, high performing ETL/ELT pipelines using approved tools and coding standards. 

• Implement complex investment data transformations involving trades, positions, valuations, pricing, and security master data. 

• Adhere to version control, code management, and DevOps practices. 

• Perform peer reviews; at T4 level, act as a primary reviewer for junior engineers. 

Testing, Debugging & Validation 

• Participate in test case walkthroughs and validate coverage for functional and non functional requirements. 

• Conduct impact analysis for enhancements and defects. 

• Lead debugging efforts for complex data or performance issues; escalate risks as needed. 

Documentation 

• Create and maintain technical documentation, including data mappings, transformation logic, unit test results, and operational runbooks. 

• Ensure documentation meets SDLC and audit requirements. 

Process, Compliance & Governance 

• Follow established SDLC, data governance, security, and audit frameworks. 

• Support internal and external audit requests related to the data platform. 

• Ensure engineering practices adhere to corporate standards. 

Technical Leadership (T4 Expectation) 

• Serve as a subject matter expert for Investments data flows, platform components, and system integrations. 

• Coach and mentor team members through training sessions and knowledge sharing forums. 

• Contribute to reusable frameworks, knowledge repositories, and best practices. 

Qualifications & Required Skills 

Must Have Technical/Process related Skills 

• Strong experience in SQL, performance tuning, and largescale data processing. 

• Experience building ETL/ELT pipelines with robust orchestration and error handling logic using ETL tools like Informatica (IICS or IDMC) 

• Handson experience building data platforms for Reporting. 

• Strong Python skills and good hands-on experience on Databricks platform and PySpark. 

• Understanding of investment data domains such as Fixed Income, Private Equity, Securities, Trades, Positions, Derivatives, Pricing, Derivatives etc. 

• Knowledge of relational and dimensional data modeling. 

• Experience with CI/CD pipelines, version control tools, scheduling tools (Git, Control-M etc.). 

• Experience of working in Agile teams (Scrum/Kanban) preferred 

• Nice to have: Machine learning experience 

Education & Experience 

• Bachelor’s or Master’s degree in Computer Science, Engineering, or a related field. 

• Typically 5-8 years of experience in data engineering roles for T4 levels. 

Behavioral Competencies 

• Analytical and detail oriented with strong problem solving skills. 

• Highly collaborative and comfortable working with cross functional teams. 

• Effective in communicating technical concepts to business stakeholders. 

• Self driven with an ownership mindset and focus on delivery excellence. 

• Adaptable and able to thrive in a fast paced, Agile environment. 

Additional Information 

• This role is part of Guardian’s Investments Technology organization. 

• Occasional evening or weekend work may be required during critical releases or production support windows.