Job Description
This role focuses on building big data applications, working with large datasets, and supporting Hadoop administration activities. It’s suitable for mid-level developers with data engineering experience.
Role Details
- Role: Hadoop / Big Data Developer
- Location: Pune
- Experience: 3–4 Years
- Employment Type: Full-Time
- Industry: IT Services & Consulting
Key Responsibilities
Big Data Development
Develop and maintain applications using Hadoop ecosystem technologies.
Data Processing
Write and optimize Hive, Spark, and MapReduce jobs.
ETL & Data Pipelines
Build and manage data pipelines and workflows.
Large Dataset Handling
Work with high-volume data and ensure quality and performance.
Hadoop Administration Support
- Cluster monitoring and troubleshooting
- Job scheduling and tuning
- Deployment and maintenance support
Collaboration
Work with data, analytics, and infrastructure teams.
Production Support
Troubleshoot and resolve big data system issues.
Required Skills
- Experience with Apache Hadoop ecosystem
- Knowledge of HDFS, Apache Hive, Apache Spark
- Strong SQL skills
- Linux / Unix basics
- Understanding of ETL concepts
- Analytical and problem-solving skills
Good to Have
- Apache Airflow or Apache Oozie
- Apache Kafka knowledge
- Shell or Python scripting
- Hadoop cluster management exposure
Key Skills
Hadoop, HDFS, Hive, Spark, SQL, ETL, Big Data, Linux, Data Pipelines