Lead Data Engineer

Job Title:  Lead Data Engineer

Key Skills:  DBT, Python, SQL, Snowflake, Databricks

Location:  Brazil

Mode:  Remote

We at Coforge are hiring  Lead Data Engineer  with the following skill set.

Key Responsibilities

- Lead and mentor a team of data engineers, setting technical direction, conducting code reviews, and promoting engineering excellence.

- Own the end-to-end architecture and design of the data platform, ensuring scalability, reliability, and alignment with business needs.

- Take full ownership of implementation delivery, from design through deployment, ensuring high-quality, production-ready solutions.

- Define and drive the data migration strategy from Snowflake / SSIS to Azure Databricks and DBT, including architecture decisions and execution oversight.

- Collaborate closely with cross-functional stakeholders (data, product, architecture, and business teams) to translate requirements into robust technical designs.

- Design and oversee the development of scalable data pipelines and data models, ensuring best practices in performance and maintainability.

- Lead the implementation of infrastructure-as-code using Terraform, enforcing consistency and automation across environments.

- Establish and enforce architectural standards, design patterns, and engineering best practices across the data ecosystem.

- Ensure reliable and efficient data integration between Legacy system and Azure environments, with strong focus on data quality and observability.

- Drive CI/CD adoption and oversee release processes for data pipelines and platform components.

- Act as the primary technical owner for troubleshooting complex issues and ensuring long-term stability of the platform.

- Maintain comprehensive documentation of architecture, design decisions, and implementation standards.

 

Required Skills & Qualifications

- Proven experience owning system design and leading implementations of large-scale data platforms.

- Strong hands-on expertise with Snowflake, Azure Databricks, and DBT with strong Python.

- Will have worked on large scale data transformations comprising of thousands of DBT models and data pipelines handling terabytes of data daily

- Deep understanding of data architecture, data modelling, and distributed data systems.

- Extensive experience with Terraform and infrastructure-as-code principles.

- Demonstrated experience leading cloud-to-cloud data migration projects (AWS to Azure preferred).

- Strong experience with CI/CD pipelines and Git-based version control.

- Advanced SQL skills and deep knowledge of ETL/ELT frameworks.

- Strong problem-solving skills with the ability to make architectural trade-offs and decisions.

- Excellent communication skills, with the ability to influence both technical and non-technical stakeholders.

- Ability to thrive in a fast-paced, ownership-driven environment.

- Previous experience in the insurance or financial sector industry, with strong understanding of core domains such as claims, policies, underwriting, and risk.

- Will have manged teams with a level of maturity and able to demonstrate key success outcomes with these teams.

- Will have managed low, mid and top performers within the team to get the best from them via mentoring, development and training needs where needed.

 

Preferred Skills:

- Experience implementing data governance, observability, and quality frameworks.

- Strong knowledge of security and compliance standards in insurance or financial services.

- Experience with real-time and streaming data technologies (Kafka, Event Hubs, Delta Live Tables).

- Familiarity with lakehouse architecture and cost/performance optimization strategies.

- Experience operating in multi-cloud or hybrid cloud environments.

Posted On:  14-07-2026

At Coforge, we hire professionals based solely on their skills and do not discriminate based on age, disability, religion, gender, sexual orientation, socioeconomic status, or nationality.