Job Description

The Offshore Data Engineering Lead role focuses on leading data engineering and application development initiatives for a Microsoft-based Data Mesh Platform.

The candidate will:

• Lead data engineering teams
• Build scalable data platforms
• Drive innovation using Microsoft Fabric and Azure technologies
• Support data product creation across business domains
• Improve engineering practices, security, and system performance

This is a leadership-focused technical role requiring strong expertise in cloud data platforms, data architecture, and engineering management.

Key Responsibilities

1. Data Engineering Leadership

• Lead development of data and application solutions
• Support data domain teams in creating data products
• Drive technical initiatives and innovation

2. Data Pipeline Development

• Design, build, and maintain data pipelines using:
  • Microsoft Azure Data Platform
  • Microsoft Fabric
  • Databricks
• Develop scalable and high-performance data workflows

3. Data Quality & Security

• Ensure:
  • Data quality
  • Data integrity
  • Data security
• Implement engineering best practices and risk management strategies

4. Engineering & Collaboration

• Collaborate with:
  • Data teams
  • Business units
  • Engineering communities
• Promote knowledge sharing and technical excellence

5. Mentorship & Technical Growth

• Mentor engineers and improve technical skills across teams
• Build a culture of:
  • Innovation
  • Documentation
  • Continuous learning

6. DevOps & Cloud Engineering

• Work with:
  • CI/CD pipelines
  • Azure DevOps
  • Kubernetes
  • Containerization technologies
• Improve system scalability and deployment efficiency

Required Skills

Data Engineering & Cloud Technologies

• Microsoft Azure Data Platform
• Microsoft Fabric
• Databricks
• Azure Data Factory
• Azure SQL Database
• Data Mesh Architecture

Programming & Development

• Python
• C#
• SQL
• PySpark
• API Integration

DevOps & Infrastructure

• CI/CD Pipelines
• Azure DevOps
• Kubernetes
• Containerization

Engineering & Architecture

• Data Architecture
• Data Management
• Risk Management
• Engineering Documentation
• System Performance Optimization

Soft Skills

• Leadership
• Communication Skills
• Mentoring
• Problem Solving
• Collaboration

Role Details

• Role: Data Engineer
• Industry: Financial Services
• Department: Engineering – Software & QA
• Employment Type: Full Time, Permanent
• Role Category: Software Development

Education

• Any Graduate
• Any Postgraduate
• Preferred: Degree in:
  • Computer Science
  • Data Engineering
  • Related Field

Key Skills

• Azure
• Microsoft Fabric
• Databricks
• Python
• SQL
• PySpark
• Data Engineering
• Kubernetes
• CI/CD
• Data Architecture