Azure Senior Data Lead

Job Summary

Job Description – Data Engineer (Data Migration)

Role: Data Engineer – Data Migration
Experience: 5–8 years
Primary Skill: Data Engineering & Migration
Location: Offshore / India
Engagement: Full-time

Role Overview

We are looking for an experienced Data Engineer to design, develop, and execute data migration solutions across enterprise applications and platforms. The role will be responsible for data extraction, transformation, validation, reconciliation, and loading while ensuring data quality, integrity, security, and minimal business disruption during migration.

Key Responsibilities

Key Responsibilities

• Design and execute end-to-end data migration from legacy/source systems to target platforms.
• Develop and maintain ETL/ELT pipelines for extraction, transformation, cleansing, and loading.
• Perform source-to-target data mapping and transformation-rule implementation.
• Analyze legacy datasets and identify data quality, duplication, completeness, and consistency issues.
• Develop automated processes for data validation and reconciliation between source and target systems.
• Support migration activities including mock migrations, dress rehearsals, cutover, and post-migration validation.
• Troubleshoot migration failures, performance bottlenecks, and data discrepancies.
• Implement logging, exception handling, auditability, and restart/recovery mechanisms within migration pipelines.
• Work closely with application teams, architects, DBAs, business analysts, and functional SMEs to validate migration requirements.
• Prepare and maintain migration documentation, mapping specifications, reconciliation reports, and operational runbooks.

Skill Requirements

Technical Skills – Must Have

• Strong SQL skills, including complex queries, joins, stored procedures, and performance optimization.
• Hands-on experience with ETL/ELT and data migration projects.
• Strong understanding of relational databases such as SQL Server, Oracle, PostgreSQL, or MySQL.
• Experience with data transformation, cleansing, mapping, validation, and reconciliation.
• Working knowledge of Python / PySpark for data processing and automation.
• Experience handling large-volume datasets and optimizing migration performance.
• Understanding of data quality, metadata, lineage, governance, and security principles.
• Experience with Git / Azure DevOps or equivalent source control and CI/CD tooling.

Good to Have

• Experience with Microsoft Azure, particularly Azure Data Factory, Azure Data Lake Storage, Azure SQL, and Databricks.
• Experience migrating data from on-premises/legacy systems to cloud platforms.
• Knowledge of APIs, JSON, CSV, XML, Parquet, and other structured/semi-structured data formats.
• Exposure to Power BI or similar reporting/reconciliation tools.
• Experience working in large enterprise environments, preferably Insurance / BFSI.

Other Requirements