Data Engineer

Software Developer
Pune
May 30, 2026
Full Time
Apply Now

Job Description

The Data Engineer will be responsible for designing, developing, and maintaining automated data pipelines, reporting systems, and data warehouse solutions. The role focuses on collecting, transforming, validating, and delivering large volumes of data from multiple sources, including advertising platforms and cloud environments. The engineer will work closely with stakeholders to improve reporting efficiency, ensure data quality, and provide actionable business insights.

Responsibilities

Data Engineering & Automation

  • Develop automated data management and reporting solutions.
  • Reduce manual reporting efforts through automation.
  • Build and maintain ETL/ELT pipelines.
  • Design and manage data ingestion workflows.

API Integration

  • Develop Python scripts to integrate with APIs such as:
    • Facebook Ads
    • Google Ads
    • Programmatic Advertising Platforms
  • Extract, transform, and load data into reporting systems and data warehouses.

Data Warehousing

  • Design, build, and maintain data warehouses.
  • Manage data storage and optimization in:
    • AWS Redshift
    • Google BigQuery

Dashboard & Reporting

  • Develop and maintain interactive dashboards.
  • Deliver business insights and performance reports.
  • Improve reporting turnaround time and efficiency.

Data Quality & Monitoring

  • Implement data quality checks and validation processes.
  • Monitor automated jobs and data pipelines.
  • Troubleshoot and resolve data-related issues.
  • Ensure data accuracy and consistency.

Team Leadership & Collaboration

  • Mentor junior team members.
  • Promote best practices in data engineering and Python development.
  • Work with internal teams and external data providers.
  • Communicate effectively with technical and non-technical stakeholders.

Required Skills

Programming

  • Python
  • Pandas
  • NumPy
  • Flask

Database & SQL

  • Advanced SQL
  • Query Optimization
  • Indexing
  • Partitioning

Cloud Technologies

  • AWS
  • Amazon Redshift
  • Cloud Data Platforms

Data Engineering

  • ETL/ELT Pipelines
  • Data Warehousing
  • Data Modeling
  • Data Integration

API & Data Integration

  • REST APIs
  • API-based Data Pipelines
  • Third-Party Data Integrations

Monitoring & Quality

  • Data Validation
  • Data Monitoring
  • Troubleshooting
  • Data Quality Frameworks

Analytics & Reporting

  • Dashboard Development
  • Business Reporting
  • Data Visualization

Soft Skills

  • Communication Skills
  • Leadership & Mentoring
  • Problem Solving
  • Stakeholder Management
  • Agile Development

Experience Required

  • 4–5+ years of experience in:
    • Data Engineering
    • AWS & Redshift
    • Data Warehousing
    • ETL/ELT Development
    • Python Development
    • API Integrations

Key Technologies

Python • AWS • Redshift • BigQuery • SQL • ETL • ELT • Pandas • NumPy • Flask • APIs • Data Warehousing • Dashboarding • Data Quality • Data Monitoring • Agile Development

Related Jobs