Job Description

We are looking for a Senior Hadoop Developer with strong experience in Big Data, Hadoop/Cloudera, Spark, Python, SQL, and ETL to design, develop, and support scalable data solutions in a production environment.

Roles and Requirements

4+ years of experience in Big Data and data warehousing.
Strong hands-on experience with Hadoop/Cloudera, HDFS, Hive, and Spark/PySpark.
Proficiency in Python, Scala, SQL, and Unix/Shell scripting.
Strong experience in ETL, data ingestion, transformation, and integration.
Experience with complex SQL query optimization and performance tuning.
Experience with AutoSys or similar enterprise scheduling tools.
Strong understanding of distributed systems and large-scale data processing.
Experience supporting production Big Data applications and troubleshooting critical issues.
Understanding of Agile methodologies and enterprise development/operational processes.
Strong analytical, problem-solving, communication, and collaboration skills.
Experience designing analytical/data warehouse environments and BI solutions.
Financial services/banking experience preferred.

Primary Responsibilities

Develop and maintain scalable Hadoop/Spark-based data pipelines.
Support data ingestion from multiple source systems.
Develop ETL and data transformation solutions using Hive, Spark, Python, and SQL.
Optimize SQL queries and Big Data jobs for performance.
Troubleshoot production issues and perform root-cause analysis.
Support scheduling, monitoring, and operational processes.
Collaborate with architects, developers, analysts, and business teams.
Evaluate and adopt emerging Big Data technologies where appropriate.

Job Tags

Full time

Similar Jobs

Amentum

Senior Structural Designer Job at Amentum

...Senior Structural Designer Amentum is a global leader in advanced engineering and innovative solutions, supporting critical missions across defense, intelligence, energy, and civilian sectors. Our people are our competitive advantage, driven by purpose, collaboration...

PJNH INC

Class A CDL Driver OTR Job at PJNH INC

...Job Description Job Description CDL-A OTR Reefer Driver | Up to $10,000+/Month | Consistent Miles HIRING CDL-A OTR DRIVERS NATIONWIDE... ...growth Long-term work available REQUIREMENTS Valid Class A CDL Must meet DOT/FMCSA requirements Must meet company...

Randstad

Hadoop Developer / Admin Job at Randstad

...background. I have an exciting opportunity *Candidates MUST be ableto work onW2 to qualify for this role.* Job Title: Hadoop Developer / Admin Duration: 6 Months Position Type: Contract to perm Location: Plano,TX Job Description: Bachelor's/Master'...

Aim Hire It, Llc

JR. Medical Recruiter Job at Aim Hire It, Llc

...Entry Level/Junior MEDICAL Recruiter (Central Phoenix) Recruiting firm seeks a Junior/Entry Level Medical Recruiter to join its busy Medical Division. Potential for Growth with this company! Junior Medical Recruiter duties include the following:...

ICON Clinical Research

Senior CRA Job at ICON Clinical Research

...Senior CRA- Phase I Oncology/Mountain West At ICON Strategic Solutions, you will work in a sponsor-dedicated model, supported by ICON's global expertise. As the world's largest FSP organisation, with over 90 sponsor partnerships, we offer stability, career development...

Hadoop Developer Job at Neshent Technologies, Addison, TX