Hadoop Consultant
Company: Group Nine LLC
Location: San Ramon
Posted on: June 6, 2021
|
|
|
Job Description:
Client: Bank of the west
6-12 Months
SAN RAMON, CA (REMOTE FOR NOW) (for the
right candidate manager will consider Only Remote as well)
ONLY GC/CITIZEN/EAD CANDIDATE
$70-75/hr W2 or C2C (Own corp
only)
3-MUST HAVE:
Production Level Cluster build/Configuration for the following,
which are critical for us. - Apache NIFI/Airflow - Apache Spark -
Apache HIVE/Hbase - HDFS - Apache Kafka - Kerberos - LDAP
Integration - Tuning/optimization - Monitoring using external tools
- Scripting experience in Python and Automation
Main provided is Cloudera. It's very
important
Configuration experience needed, cloudera
, Production
Notes from the
manager:
automation in devops area is key
Setting up security access
admin and configuration position
will be responsible for developer , automation in devOps
environment where they will be helping team to configure ,
optimize, advise, connecting with multiple teams, they will be
doing data pipelines,
configure across hadoop, Hbase, scala spark, hive- typical big data
technology stack
this is on prem set up, if someone ha cloud experience that is
welcome too
need to understand enterprise challenges
Required:
8 years' experience in Big Data Hadoop
administration and configuration.
Responsible for implementation and ongoing administration of Hadoop
infrastructure. Horton Works (HDP) Stack is a must.
Experience in Apache Atlas, Apache Ranger, Apache Kafka, Kerberso,
HA cluster setup is a must
Aligning with the systems engineering team to propose and deploy
new hardware and software environments required for Hadoop and to
expand existing environments.
Working with data delivery teams to setup new Hadoop users. This
job includes setting up Linux users, setting up Kerberos principals
and testing HDFS, Hive, Pig and MapReduce access for the new
users.
Cluster maintenance as well as creation and removal of nodes using
tools like Ganglia, Nagios, Cloudera Manager Enterprise/Horton
Works Ambari, Dell Open Manage and other tools.
Performance tuning of Hadoop clusters & MR, Apache Spark HBase,
Druid
Screen Hadoop cluster job performances and capacity planning
Monitor Hadoop cluster connectivity and security
Manage and review Hadoop log files.
Experience with scripting tools like Python, Ansible , Java is a
plus
CI/CD automation using Gitlab
Keywords: Group Nine LLC, San Ramon , Hadoop Consultant, Other , San Ramon, California
|
Click
here to apply!
|
