Job Description
We are looking for a highly skilled Senior Data Engineer to design, build, and optimize enterprise data platforms and cloud-based data solutions. This role focuses on large-scale data integration, ETL/ELT pipelines, data warehousing, and analytics across multi-cloud environments (Azure, AWS, GCP).
You will work closely with business and technical stakeholders to deliver scalable, secure, and high-performance data systems.
Job Details
- Role: Senior Data Engineer
- Location: Bangalore (Work from Office)
- Industry Type: IT Services & Consulting
- Department: Engineering – Software & QA
- Employment Type: Full Time, Permanent
- Role Category: Software Development
Key Responsibilities
🔹 Data Engineering & Integration
- Design and implement enterprise data platforms across relational and NoSQL databases
- Build and optimize ETL/ELT pipelines using:
- Azure Data Factory, Informatica, Apache NiFi, AWS Glue, Cloud Data Fusion
- Develop data models and integration frameworks
- Manage system configuration, upgrades, and performance tuning
🔹 Cloud & Data Warehousing
- Build and maintain cloud data architectures on Azure, AWS, and GCP
- Design and manage:
- Data Lakes & Data Warehouses (BigQuery, Snowflake, Redshift)
- Implement big data processing solutions using Hadoop, Spark, Databricks
- Optimize performance and cost across cloud environments
🔹 Architecture & Governance
- Support enterprise architecture standards and governance
- Define system specifications and evaluate tools/technologies
- Ensure compliance with security, audit, and regulatory requirements
🔹 Testing, Automation & DevOps
- Test and debug SQL queries and ETL pipelines
- Implement CI/CD pipelines and automation scripts
- Support deployment and integration of new technologies
🔹 Monitoring & Support
- Monitor system health, performance, and usage
- Troubleshoot and resolve complex platform issues
- Conduct root cause analysis and implement improvements
- Maintain disaster recovery and business continuity plans
🔹 Leadership & Collaboration
- Provide technical guidance to stakeholders
- Mentor junior engineers and lead initiatives
- Collaborate with distributed teams across time zones
- Maintain detailed technical documentation
Required Skills & Experience
- 5+ years of experience in data engineering and system integration
- Strong expertise in:
- SQL and data processing languages
- Relational & NoSQL databases:
- Azure SQL, MySQL, PostgreSQL, MongoDB, Cassandra
- Hands-on experience with:
- ETL/ELT tools and data integration frameworks
- Cloud platforms (Azure, AWS, GCP)
- Strong understanding of enterprise systems and architecture
- Excellent analytical, troubleshooting, and communication skills
Preferred Skills
- Experience with:
- Power BI / ThoughtSpot
- AI/ML data pipelines
- Job scheduling tools like Stonebranch
- Knowledge of DevOps and CI/CD practices
- Relevant cloud certifications (Azure, AWS, GCP)
Tech Stack
- Cloud: Azure, AWS, GCP
- Databases: Azure SQL, MySQL, PostgreSQL, MongoDB, Cassandra
- ETL Tools: Azure Data Factory, Informatica, Apache NiFi, AWS Glue
- Warehousing: BigQuery, Snowflake, Redshift
- Big Data: Hadoop, Spark, Databricks
- Visualization: Power BI, ThoughtSpot
- DevOps: CI/CD Pipelines, Automation Tools
What Success Looks Like
- Scalable and secure enterprise data platforms
- Optimized data pipelines and cost-efficient architectures
- Proactive issue resolution and high system reliability
- Delivery of accurate, timely, and actionable data insights
- Strong mentorship and adherence to technical standards
Key Skills
Data Engineering, SQL, Azure, AWS, GCP, ETL, Data Warehousing, Big Data, Spark, Hadoop, Snowflake, Redshift, CI/CD, Data Lakes, Informatica.