EY – GDS Consulting – AI and Data – Hadoop – Senior (Hyderabad)
Job Description
Summary
Join EY Global Delivery Services (GDS) as a Senior Data Engineer – Hadoop within the AI and Data Consulting team in Hyderabad. In this role, you’ll design, build, and maintain large-scale data processing systems using Hadoop, Spark, Hive, and Apache Iceberg.
This is your opportunity to contribute to data-driven transformation initiatives for top global clients while growing your technical expertise in Big Data Engineering and Cloud-based analytics platforms.
Job Details at a Glance
| Job Title | Senior Data Engineer – Hadoop |
|---|---|
| Service Line | GDS Consulting – AI and Data |
| Company | Ernst & Young (EY) |
| Location | Hyderabad, India |
| Other Locations | Primary Location Only |
| Experience Required | 6+ years |
| Requisition ID | 1647162 |
| Employment Type | Full-time |
| Salary | Competitive |
| Posted Date | October 11, 2025 |
About the Role
As a Senior Technology Consultant – Data and Analytics, you’ll help clients harness the power of Big Data, AI, and Analytics to improve business performance. You’ll play a key role in building scalable data pipelines, ensuring high-performance data processing, and enabling data-driven decision-making across enterprises.
Key Responsibilities
- Develop and maintain large-scale data processing systems using Hadoop ecosystem tools.
- Write and optimize Spark SQL, PySpark, HiveQL, and MapReduce jobs for performance and cost efficiency.
- Build ETL/ELT pipelines to integrate data from multiple sources such as APIs, logs, and databases.
- Implement and manage data ingestion frameworks using Hive, Pig, and Sqoop.
- Optimize distributed cluster performance and manage Hadoop clustering and autoscaling.
- Define and apply business rules for data management in Hadoop on Azure Cloud.
- Maintain clean, documented, and version-controlled code (Git, CI/CD).
- Collaborate with cross-functional teams to design data architectures for analytics and reporting.
- Contribute to data governance, data quality, and compliance initiatives.
- Work on Anti-Money Laundering (AML) Transaction Monitoring use cases (preferred).
Skills and Attributes for Success
- Hands-on experience in Hadoop, Spark, Hive, Pig, MapReduce, and Apache Iceberg.
- Proficiency in Unix/Shell scripting and data workflow tools like Apache Oozie.
- Solid understanding of ETL processes, performance tuning, and data modeling.
- Strong analytical, communication, and problem-solving skills.
- Ability to work independently and in collaborative, agile teams.
Preferred Qualifications
- Experience with Kafka, Kinesis, or other stream-processing tools.
- Knowledge of Docker, Kubernetes, and containerized data environments.
- Familiarity with DataOps/DevOps CI/CD pipelines.
- Understanding of data governance and data quality frameworks.
- Exposure to cloud-based Hadoop solutions (Azure, AWS, or GCP).
What EY Offers
- Opportunity to work with leading global clients across industries.
- Access to continuous learning and professional development programs.
- A flexible, inclusive, and collaborative work environment.
- Support from experienced mentors and innovative teams.
- Exposure to cutting-edge AI, Big Data, and analytics technologies.
About EY
At Ernst & Young (EY), we’re committed to building a better working world by helping clients leverage data, AI, and advanced technologies to solve complex business challenges. With a network spanning 150+ countries, EY offers a dynamic and inclusive workplace focused on innovation, learning, and growth.
Apply Now
Take the next step in your data engineering career with EY GDS in Hyderabad.
👉 Apply through the official EY Careers portal: EY Careers – AI and Data Jobs