AWS Data Engineer

Bengaluru
June 25, 2026
Full Time
Apply Now

Job Description

A Data Engineer is responsible for designing, developing, and maintaining scalable data pipelines and data integration solutions. This role focuses on AWS cloud platforms, CI/CD automation, SAP Native systems, and data engineering best practices to ensure reliable, secure, and efficient data processing across enterprise environments.

Responsibilities

  • Design and build scalable data pipelines using AWS services.
  • Develop and maintain ETL/ELT workflows for large-scale data processing.
  • Integrate data from SAP HANA, SAP BW, and ABAP systems.
  • Develop automation solutions for data ingestion, transformation, and delivery.
  • Implement and manage CI/CD pipelines for data workflows.
  • Ensure version control, automated testing, and deployment reliability.
  • Monitor data pipelines and resolve production issues.
  • Conduct root cause analysis for failures and performance bottlenecks.
  • Optimize data processing performance and system scalability.
  • Maintain data quality, governance, and security standards.
  • Collaborate with business, analytics, and engineering teams.
  • Create technical documentation and operational runbooks.
  • Ensure compliance with enterprise data management policies.

Required Skills

  • Data Engineering
  • Python
  • SQL
  • AWS Cloud Platform
  • Amazon S3
  • AWS Glue
  • AWS Lambda
  • Amazon Redshift
  • Amazon EMR
  • CI/CD Pipelines
  • GitHub Actions
  • Azure DevOps
  • ETL/ELT Development
  • Data Integration
  • Data Modeling
  • Data Governance
  • Data Security
  • Performance Optimization
  • Root Cause Analysis
  • Pipeline Monitoring
  • Version Control (Git)

SAP Skills

  • SAP HANA
  • SAP BW (Business Warehouse)
  • SAP ABAP
  • SAP Data Extraction
  • SAP Data Integration
  • SAP Native Systems

Preferred Skills

  • Apache Spark
  • Data Orchestration Tools
  • DevOps Practices
  • Cloud Automation
  • Infrastructure as Code
  • Workflow Scheduling Tools

Key Competencies

  • Analytical thinking
  • Problem-solving
  • Data architecture understanding
  • Automation mindset
  • Attention to detail
  • Collaboration and communication
  • Performance tuning expertise
  • Incident management

Career Growth Path

  • Data Engineer
  • Senior Data Engineer
  • Lead Data Engineer
  • Cloud Data Engineer
  • Data Architect
  • Principal Data Engineer
  • Engineering Manager
  • Head of Data Engineering

Keywords

AWS, Data Engineering, Python, SQL, SAP HANA, SAP BW, ABAP, AWS Glue, Lambda, S3, Redshift, EMR, ETL, ELT, CI/CD, GitHub Actions, Azure DevOps, Data Pipelines, Data Integration, Data Governance, Cloud Data Engineering.

Related Jobs