Hadoop Developer

About the role

This position sits within our Enterprise Data and Analytics (EDA) Division focusing on Big Data. The EDA Big Data platform supports Hadoop and Aster technology in a multi-tenant environment supporting multiple LOBs.

The EDA Big data team is looking for an Application System Engineer to work in a fast-paced agile development environment to act as a developer on the Hadoop development team; the resource should be able to design and build applications using Big data ecosystem and help with data management (tracking of sources in the big data environment), system documentation, metadata capture quickly analyze, develop, and test potential use cases for the business; take valid use cases from ideation through development to production; write efficient code to extract, transform, load, and query very large datasets, including unstructured data; develop standards and new design patterns for Big Data applications; build out and populate a data lake; understand MapReduce architecture and master the tools and technology components within the Hadoop and Aster environments; help formulate use cases from potentially ambiguous business requirements; provide timely communication to business partners on use cases and project status; mentor and assist users in accessing the data; contribute significantly toward developing a development framework on Big Data.

Required Qualifications

• 2+ years of application development and implementation experience
• 1+ years of Hadoop experience
• 3+ years of UNIX experience
• 3+ years of Java experience

Desired Qualifications

• Good verbal, written, and interpersonal communication skills
• Basic knowledge in data warehouse, Teradata, Oracle, DB2, Agile & ETL (Extract, Transform, Load) programming.

Other Desired Qualifications

• Bachelor degree in Computer Science or related technological degree.
• Experience with MapReduce, HDFS, Hive or Pig on a major distribution such as Hortonworks or Cloudera or MapR
• Experience in large scale data warehousing, distributed computing, and parallel processing environments

• Experience working with business partners on analytical solutions
• Experience building HBase, Spark, Kafka solutions
• Hadoop developer certification
• Experience with unstructured datasets, such as log files, email, text

Additional Information: We have started the process for sponsorship.