Hadoop Engineer (SME)Genesis10 is currently seeking a Hadoop Engineer (SME) for a contract position with a Global Financial Institution located in Chicago, IL. This is a 12+ month contract opportunity.This role supports NextGen Platforms built around Big Data Technologies like Hadoop, Spark, and Kafka. The Hadoop Engineer will be involved in the full life cycle of an application as part of an agile development process, with a focus on cluster management of vendor-based products like Cloudera and Databricks. The ideal candidate will interact with clients, development teams, and vendors at a high technical level.Responsibilities:Work on complex, major or highly visible tasks in support of multiple projects that require multiple areas of expertiseProvide subject matter expertise in managing Hadoop and Data Science Platform operations with a focus on Cloudera Hadoop, Jupyter Notebook, OpenShift, Docker-Container Cluster Management and AdministrationIntegrate solutions with other applications and platforms outside the frameworkManage platform operations across all environments which includes upgrades, bug fixes, deployments, metrics/monitoring for resolution and forecasting, disaster recovery, and incident/problem/capacity managementServe as a liaison between client partners and vendors in coordination with project managers to provide technical solutions that address user needsRequirements:Strong knowledge of Hadoop Architecture, HDFS, Hadoop Cluster and Hadoop Administrator's roleIntimate knowledge of fully integrated AD/Kerberos authenticationExperience setting up optimum cluster configurations and debugging knowledge of YARNHands-on with analyzing various Hadoop log files, compression, encoding, and file formatsExpert level knowledge of Cloudera Hadoop components such as HDFS, Sentry, HBase, Kafka, Impala, SOLR, Hue, Spark, Hive, YARN, Zookeeper and PostgresStrong technical knowledge of Unix/Linux, Databases (Sybase/SQL/Oracle), and scripting (Java, Python, Perl, Shell)Experience with Monitoring, Alerting, and Job Scheduling SystemsStrong grasp of automation/DevOps tools such as Ansible, Jenkins, SVN, and BitbucketExperience working on Big Data Technologies including Hadoop, Kafka, and SparkDesired skills:Cloudera Admin / Dev CertificationCertification in Cloud, Docker-Container, or OpenShift TechnologiesPay range: $63.68 - $71.68 per hourOnly candidates available and ready to work directly as Genesis10 employees will be considered for this position.If you have the described qualifications and are interested in this exciting opportunity, please apply!
