Job Description

Typically requires a Bachelor's Degree and a minimum of 5 years of directly relevant work experience.

Client is embarking on the big data platform in Consumer Digital using Hadoop Distributed File System cluster. As a Sr. Hadoop developer, you will work with a variety of talented client teammates and be a driving force for building solutions. You will be working on development projects related to commerce and web analytics.

Responsibilities

• Design and implement map reduce jobs to support distributed processing using Java, Cascading, Python, Hive, and Pig; ability to design and implement end-to-end solutions.
• Build libraries, user-defined functions, and frameworks around Hadoop.
• Research, evaluate, and utilize new technologies/tools/frameworks around the Hadoop ecosystem.
• Develop user-defined functions to provide custom Hive and Pig capabilities.
• Define and build data acquisitions and consumption strategies.
• Define and develop best practices.
• Work with support teams in resolving operational and performance issues.
• Work with architecture/engineering leads and other teams on capacity planning.

Qualifications

• MS/BS degree in a computer science field or related discipline.
• 6+ years of experience in large-scale software development.
• 1+ year of experience in Hadoop.
• Strong Java programming, shell scripting, Python, and SQL.
• Strong development skills around Hadoop, MapReduce, Hive, Pig, Impala.
• Strong understanding of Hadoop internals.
• Good understanding of Avro and JSON and other compression.
• Experience with build tools such as Maven.
• Experience with databases like Oracle.
• Experience with performance/scalability tuning, algorithms, and computational complexity.
• Experience (at least familiarity) with data warehousing, dimensional modeling, and ETL development.
• Ability to understand ERDs and relational database schemas.
• Proven ability to work with cross-functional teams to deliver appropriate resolutions.

Nice to have:

• Experience with open-source NoSQL technologies such as HBase and Cassandra.
• Experience with messaging and complex event processing systems such as Kafka and Storm.
• Machine learning framework.
• Statistical analysis with Python, R, or similar.

All your information will be kept confidential according to EEO guidelines.

Job Tags

Similar Jobs