Expired job

Just missed a job?

Sign up and never miss an opportunity again!

Senior Big Data Administrator job

Kani SolutionsSaint Louis, MO

Job Description

Job Title Senior Big Data Administrator Location St Louis, MO Duration 06+ Months Experience Should have minimum of 6-10 years of Experience. Should have a good understanding of services business for fortune 1000 from the operations point of view Should have set up clusters from scratch and involved in planning the cluster, deployment and administration Ability to read, understand and communicate complex technical information Ability to express ideas in an organized, articulate and concise manner Any certification in regards to Hadoop Administration services will be an added advantage Should have good understanding of ITIL processes, operations support and ticketing tools Education BE, B- Tech (CS), MCA Primary Skills Hands on experience in deploying Big Data clusters involving Hadoop (HDFSYarnHive), CassandraMongo DBHBase, RabbitMQKafka, Storm, Solr, Spark, Zookeeper Hands on experience with AmbariCloudera Manager Hands on experience with ClouderaHDPApache distributions Hands on experience of running tools like SqoopFlumeOozie Good understanding of Hadoop benchmarks and other performance benchmarks for optimal configuration Good understanding of OS parameters, network topologies, storage options for optimal Hadoop cluster set up Hands on experience in any one RDBMS MySQLPostgreSQL Ability to install any of these databases as meta store database, create schema, populate data, importexport, create usersroles etc. Hands on experience with configuring cluster security using Kerberos, ACL Hands on experience with data security using encryption, Sentry, ranger etc. Good understanding of high availability, fault tolerance, data replication Hands on experience on configuring HA in cluster Fluent in at least one scripting language (ShellPerlPython etc.) General operational expertise such as good troubleshooting skills, understanding of system s capacity, bottlenecks, basics of memory, CPU, OS, storage, and networks. Good knowledge of Linux as Hadoop runs on Linux. Familiarity with open source configuration management and deployment tools such as Puppet or Chef and Linux scripting. Knowledge of Troubleshooting Core Java Applications is a plus. Sound UNIX abilities involving user management, security permissions Exposure to cloud technologies like EC2AzureVM ware will be added advantage Hands on experience on monitoring tools like Nagios, Ganglia etc. Ability to deploy, create plug-ins for custom monitoring stats Strong verbal and written communication skills are mandatory Excellent analytical and problem solving skills are mandatory Solid troubleshooting abilities and able to work with a team to fix large production issues Role Responsibilities Hadoop Cluster Planning Principal pints to consider in choosing the hardware and operating systems to host an Apache Hadoop cluster Understand kernel tuning and disk swapping Given a scenario and workload pattern, identify a hardware configuration appropriate to the scenario Given a scenario, determine the ecosystem components your cluster needs to run in order to fulfill the SLA Cluster sizing Benchmarking given a scenario and frequency of execution, identify the specifics for the workload, including CPU, memory, storage, disk IO Disk Sizing and Configuration, including JBOD versus RAID, SANs, virtualization, and disk sizing requirements in a cluster Network Topologies understand network usage in Hadoop (for both HDFS and MapReduce) and propose or identify key network design components for a given scenario Cluster Administration Be able t install all the ecosystem components including (but not limited to) Impala, Flume, Oozie, Hue, Cloudera Manager, Sqoop, Hive, and Pig Addremove nodes Rebalancing f cluster Data back up Cluster Maintenance Service restarts Troubleshooting error Analyze for error User n-boarding Should be able to scan logs, errors, exception and get to the root cause of the issue Cluster monitoring Set up monitoring infrastructure for platform, OS, applications Configure automated alerts and notifications Cluster resource management Configure FairCapacity schedulers Optimize resource usage Cluster security Set up perimeter security Kerbers set up SentryRanger configuration Data encrypting
Associated topics: administrator, equipment, infrastructure, ip, maintenance, operating system, sccm, scom, server, tcp
Similar jobs in the area
Senior Data Engineer Duration: 12 month contract no conversion. Location: Downtown Saint Louis, MO Status: Must be a US Citizen or Green Card holder with three years of US residency. Extensive background check required. Description: Design, develop and...Read more
Hadoop/Big Data DeveloperNet 2 SourceO'Fallon, MO
Net2Source is a Global Workforce Solutions Company headquartered at NJ, USA with its branch offices in Asia Pacific Region. We are one of the fastest growing IT Consulting company across the USA and we are hiring "Hadoop/Big Data Developer" for our client...Read more
ETL Administrator - Data & IntegrationSt. Mary's Good SamaritanSt. Louis, MO
## Description**Role Purpose:**This person will be responsible for developing, modifying, maintaining ETL (Extract, Transform and Load) processes for EPIC Clarity and Business Intelligence Environments. Strong knowledge in EPIC OLTP database i.e...Read more
**Role Purpose:** This person will be responsible for developing, modifying, maintaining ETL (Extract, Transform and Load) processes for EPIC Clarity and Business Intelligence Environments. Strong knowledge in EPIC OLTP database i.e., Chronicles and...Read more
flexjobs
Clayton Science Tutor JobsVarsity TutorsClayton, MO
Clayton Science Tutor Jobs Varsity Tutors has students in Clayton looking for Science tutoring. Varsity Tutors is a live learning platform that connects tutors with students to provide personalized learning. In addition to having knowledge in Science...Read more
Big Data ArchitectApeiro TechnologiesSt. Louis, MO
Client - Express Script Job Title Big Data Architect (w ETL) Location St Louis, MO Key Note - Person will work with Director of Enterprise Architecture from the technical product owner standpoint. ETL tools include Informatica and Talend, SQL, Hortonworks...Read more
flexjobs
In-Home Usage Tester (Product Tester from home) Part-time Presently we're recruiting Product Testers (from home) in several US cities to expand our private network of In-Home Usage Testers (IHUT) to fulfill upcoming contracts with national and...Read more
Looking for Big data engineer with Spark and Scala experience, but who has done Javahadoop role in past . Someone senior + hands-on and has played with Hadoop installation on laptop , dev and production setups. Need to have MapReduce (Hadoop programming...Read more
Big Data EngineerFlux Tek SolutionsLake Saint Louis, MO
Job Description Job Title : Data Engineer Location: St Louis Looking for Big data engineer with Spark and Scala experience, but who has done Java/hadoop role in past . Someone senior + hands-on and has played with Hadoop installation on laptop , dev and...Read more
We are in search of a backend engineer to provide support and assist in building out our Data Historian (Data Lake, Big Data) platform. This platform will be used to store massive amounts of data in the cloud and make it accessible for the enterprise. Main...Read more
Diversant is looking for a ETL Developer to interpret requirements, build designs and have an understanding of Unix, Linix and AIX. In this position you will also be using enterprise databases such as Oracle but can also be DB2 or Teradata. If you are...Read more
Big Data Engineer IBCDTravelSaint Louis, MO
Job Summary: As a (Big Data) Software Engineer you'll use your data engineering knowledge to provide scalable enterprise data integration processes and technical support for our data management systems. In this role, you will be responsible for...Read more

Similar jobs

* Ability to make decisions and solve problems while working under pressure * Ability to prioritize and organize effectively * Ability to show judgment and initiative and to accomplish job duties * Ability to use personal computer and software applications...Read more
At Wells Fargo, we want to satisfy our customers financial needs and help them succeed financially. Were looking for talented people who will put our customers at the center of everything we do. Join our diverse and inclusive team where youll feel valued...Read more
System Engineer with Master’s degree in Computer Science, Engineering any, Technology or related to design of system solutions, providing technical input for all aspects of projects including design, system integration, providing support in order to...Read more
At Wells Fargo, we want to satisfy our customers� financial needs and help them succeed financially. We�re looking for talented people who will put our customers at the center of everything we do. Join our diverse and inclusive team where you�ll feel...Read more
Data Engineer - Maryland HeightsKforce Technology StaffingMaryland Heights, MO
RESPONSIBILITIES Kforce has a client seeking a blend of a Data Engineer in Maryland Heights, Missouri (MO). Essential Functions 70 of this person's time will be assisting data analystsscientist with data source codes, using data lake technologies 30 of...Read more
Skills Required: Hadoop Administrator, with exposure in other BigData technologies and excellent customer interfacing skills. Understand requirements from functional and mapping documents. Raise required clarification and questions prior to requirement...Read more
TECHNOGEN, Inc. is a Proven Leader in providing full IT Services, Software Development and Solutions for 15 years. TECHNOGEN is a Small & Woman Owned Minority Business with GSA Advantage Certification. We have offices in VA; MD & Offshore development...Read more
We are in search of a backend engineer to provide support and assist in building out our Data Historian (Data Lake, Big Data) platform. This platform will be used to store massive amounts of data in the cloud and make it accessible for the enterprise. Main...Read more
Net2Source, Inc. is one of the fastest growing IT Consulting company across USA. N2S is headquartered at NJ, USA with its branch offices in Asia Pacific Region. N2S offers a wide gamut of consulting solutions customized to client needs including staffing...Read more
Hadoop DeveloperWho is Mastercard?We are the global technology company behind the world’s fastest payments processing network. We are a vehicle for commerce, a connection to financial systems for the previously excluded, a technology innovation lab, and...Read more