Hadoop Data Engineer

Required Skills

• Experience with multiple large-scale Enterprise Hadoop or Big Data, Data Bricks, Cloudera, HD Insights, or other environments focused on operations, design, capacity planning, cluster setup, security, performance tuning, and monitoring
• Experience with the full Cloudera CDH/CDP distribution to install, configure, and monitor all services in the Cloudera stack
• Strong understanding of core Hadoop services such as HDFS, MapReduce, Kafka, Spark and Spark-Streaming, Hive, Impala, HBase, Kudu, Sqoop, and Oozie
• Experience in administering, and supporting RHEL Linux operating systems, databases, and hardware in an enterprise environment
• Expertise in typical system administration and programming skills such as storage capacity management, debugging, performance tuning
• Proficient in shell scripting (e.g. Bash, KSH, etc)
• Experience in setup, configuration, and management of security for Hadoop clusters using Kerberos with integration with LDAP/AD at an enterprise-level
• Experience with large enterprise scale, separation of resource concepts, and the physical nature of those environments to operate (storage, memory, network, and compute)