SanRamonRecruiter Since 2001
the smart solution for San Ramon jobs

Hadoop Consultant

Company: Group Nine LLC
Location: San Ramon
Posted on: June 6, 2021

Job Description:

Hadoop Consultant (Admin/configuration is needed)
Client: Bank of the west
6-12 Months
SAN RAMON, CA (REMOTE FOR NOW) (for the right candidate manager will consider Only Remote as well)

$70-75/hr W2 or C2C (Own corp only)

Production Level Cluster build/Configuration for the following, which are critical for us. - Apache NIFI/Airflow - Apache Spark - Apache HIVE/Hbase - HDFS - Apache Kafka - Kerberos - LDAP Integration - Tuning/optimization - Monitoring using external tools - Scripting experience in Python and Automation

Main provided is Cloudera. It's very important
Configuration experience needed, cloudera , Production

Notes from the manager:
automation in devops area is key
Setting up security access
admin and configuration position
will be responsible for developer , automation in devOps environment where they will be helping team to configure , optimize, advise, connecting with multiple teams, they will be doing data pipelines,
configure across hadoop, Hbase, scala spark, hive- typical big data technology stack
this is on prem set up, if someone ha cloud experience that is welcome too
need to understand enterprise challenges

8 years' experience in Big Data Hadoop administration and configuration.
Responsible for implementation and ongoing administration of Hadoop infrastructure. Horton Works (HDP) Stack is a must.
Experience in Apache Atlas, Apache Ranger, Apache Kafka, Kerberso, HA cluster setup is a must
Aligning with the systems engineering team to propose and deploy new hardware and software environments required for Hadoop and to expand existing environments.
Working with data delivery teams to setup new Hadoop users. This job includes setting up Linux users, setting up Kerberos principals and testing HDFS, Hive, Pig and MapReduce access for the new users.
Cluster maintenance as well as creation and removal of nodes using tools like Ganglia, Nagios, Cloudera Manager Enterprise/Horton Works Ambari, Dell Open Manage and other tools.
Performance tuning of Hadoop clusters & MR, Apache Spark HBase, Druid
Screen Hadoop cluster job performances and capacity planning
Monitor Hadoop cluster connectivity and security
Manage and review Hadoop log files.
Experience with scripting tools like Python, Ansible , Java is a plus
CI/CD automation using Gitlab

Keywords: Group Nine LLC, San Ramon , Hadoop Consultant, Other , San Ramon, California

Click here to apply!

Didn't find what you're looking for? Search again!

I'm looking for
in category

Log In or Create An Account

Get the latest California jobs by following @recnetCA on Twitter!

San Ramon RSS job feeds