Expired job

Just missed a job?

Sign up and never miss an opportunity again!

Senior Big Data Administrator job

Kani SolutionsSaint Louis, MO


Job Description

Job Title Senior Big Data Administrator Location St Louis, MO Duration 06+ Months Experience Should have minimum of 6-10 years of Experience. Should have a good understanding of services business for fortune 1000 from the operations point of view Should have set up clusters from scratch and involved in planning the cluster, deployment and administration Ability to read, understand and communicate complex technical information Ability to express ideas in an organized, articulate and concise manner Any certification in regards to Hadoop Administration services will be an added advantage Should have good understanding of ITIL processes, operations support and ticketing tools Education BE, B- Tech (CS), MCA Primary Skills Hands on experience in deploying Big Data clusters involving Hadoop (HDFSYarnHive), CassandraMongo DBHBase, RabbitMQKafka, Storm, Solr, Spark, Zookeeper Hands on experience with AmbariCloudera Manager Hands on experience with ClouderaHDPApache distributions Hands on experience of running tools like SqoopFlumeOozie Good understanding of Hadoop benchmarks and other performance benchmarks for optimal configuration Good understanding of OS parameters, network topologies, storage options for optimal Hadoop cluster set up Hands on experience in any one RDBMS MySQLPostgreSQL Ability to install any of these databases as meta store database, create schema, populate data, importexport, create usersroles etc. Hands on experience with configuring cluster security using Kerberos, ACL Hands on experience with data security using encryption, Sentry, ranger etc. Good understanding of high availability, fault tolerance, data replication Hands on experience on configuring HA in cluster Fluent in at least one scripting language (ShellPerlPython etc.) General operational expertise such as good troubleshooting skills, understanding of system s capacity, bottlenecks, basics of memory, CPU, OS, storage, and networks. Good knowledge of Linux as Hadoop runs on Linux. Familiarity with open source configuration management and deployment tools such as Puppet or Chef and Linux scripting. Knowledge of Troubleshooting Core Java Applications is a plus. Sound UNIX abilities involving user management, security permissions Exposure to cloud technologies like EC2AzureVM ware will be added advantage Hands on experience on monitoring tools like Nagios, Ganglia etc. Ability to deploy, create plug-ins for custom monitoring stats Strong verbal and written communication skills are mandatory Excellent analytical and problem solving skills are mandatory Solid troubleshooting abilities and able to work with a team to fix large production issues Role Responsibilities Hadoop Cluster Planning Principal pints to consider in choosing the hardware and operating systems to host an Apache Hadoop cluster Understand kernel tuning and disk swapping Given a scenario and workload pattern, identify a hardware configuration appropriate to the scenario Given a scenario, determine the ecosystem components your cluster needs to run in order to fulfill the SLA Cluster sizing Benchmarking given a scenario and frequency of execution, identify the specifics for the workload, including CPU, memory, storage, disk IO Disk Sizing and Configuration, including JBOD versus RAID, SANs, virtualization, and disk sizing requirements in a cluster Network Topologies understand network usage in Hadoop (for both HDFS and MapReduce) and propose or identify key network design components for a given scenario Cluster Administration Be able t install all the ecosystem components including (but not limited to) Impala, Flume, Oozie, Hue, Cloudera Manager, Sqoop, Hive, and Pig Addremove nodes Rebalancing f cluster Data back up Cluster Maintenance Service restarts Troubleshooting error Analyze for error User n-boarding Should be able to scan logs, errors, exception and get to the root cause of the issue Cluster monitoring Set up monitoring infrastructure for platform, OS, applications Configure automated alerts and notifications Cluster resource management Configure FairCapacity schedulers Optimize resource usage Cluster security Set up perimeter security Kerbers set up SentryRanger configuration Data encrypting
Associated topics: administrator, equipment, infrastructure, ip, maintenance, operating system, sccm, scom, server, tcp

Kani Solutions


Company - Private


201 to 500 employees


Princeton, NJ


Business Services





Job Filters

Salesforce Solution Architect - New YorkKani SolutionsNew York, New York
Position 1 Salesforce Solution Architect Location New York City, NY Duration Full time Requirement Creating Delivering - CRMs and workflow solutions using SalesforceApex, Force, Visualforce technologies and has hand on experience with 3rd party cloud...Read more
Tibco Developer with JavaKani SolutionsReston, Virginia
Title Tibco Developer with Java Location Reston, VA Duration Long Term Required Skills Good understanding of Java core concepts. Minimum 2 years of experience in programming using Java J2EE Technologies. Good understanding of Spring concepts, Experience in...Read more
Data Engineer(SQL + Python)Kani SolutionsSunnyvale, CA
Position Senior Data Engineer(SQL + Python). Location Sunnyvale CA. Duration Long term Positions 5 Responsibilities Design, develop, own, and maintain ETLELT data flows across a constellation of data sources and systems Aggregate and store quality data in...Read more
PL SQL Developer with JavaKani SolutionsHerndon, Virginia
JD Key job functions Experience with Spring Core, Spring Boot, Spring MVC, Spring Integration and Spring Security Hands-On experience with Database development and tools with SQL, ORM, Flyway, OLTP Database Tuning, etc. Knowledge of UNIX (Linux...Read more
Business AnalystKani SolutionsFarmington, Connecticut
Hello Hope you are doing Great!! This is Himanshu From Kani Solution Inc. Kindly let me know if you are available for new project. Title Business Analyst Location Farmington, CT West Palm Beach, FL (Remote Also Available) Hire Type Contract Fulltime we...Read more

Closed Job Filters

Hello Hope you are doing Great!! This is Himanshu From Kani Solution Inc. Kindly let me know if you are available for new project. Title: SSIS with .Net Location: NYC, NY Hire Type: ContractRead more
Informatica MDM Developer Lead Architect Location Playa Vista CA Duration Contract Developer 6 Lead 2 Architect 1 Required Good Knowledge of Informatica MDM Good Knowledge of IDD, HM, Match MergeRead more
RPA Business Analyst - Milwaukee WIKani SolutionsMilwaukee, WI
Hi, Please review the Job Description and if interested please get back to me with your updated resume and Expecting pay ASAP . Job Details Title RPA BA Location Milwaukee WI Duration 6+ Months JD NoRead more
Python DeveloperKani SolutionsWilmington, DE
Hello, Please go through the Job description below, if interested reply with your updated resume: Title: Python Developer Location: NYC, NY Mandatory skills Job Description 8+ years of developmentRead more
Here at Universal Parks & Resorts, you can enjoy an exciting culture where creating our unique Universal brand of thrilling experiences is a top priority. We are passionate about what we do and takeRead more
Similar jobs in the area
Senior Data Engineer Duration: 12 month contract no conversion. Location: Downtown Saint Louis, MO Status: Must be a US Citizen or Green Card holder with three years of US residency. Extensive background check required. Description: Design, develop and...Read more
Our client is in immediate need for a talented Sybase Database Administrator with experience in the IT Industry. This is a 12+ month s contract opportunity with long-term potential and is located in Saint Louis, MO . Please review the job description below...Read more
Job Title: Sybase Database Administrator Location: Saint Louis, MO Duration- 12+ Month (Long Term) Responsibilities: Understand, evaluate and implement tools and trends in database systems administration. Develop and implement core Sybase databases...Read more
**Introduction** At IBM, work is more than a job - it's a calling: To build. To design. To code. To consult. To think along with clients and sell. To make markets. To invent. To collaborate. Not just to do something better, but to attempt things you've...Read more
Delivery Partner - Weekly PayUber EatsBrookline, MO
Deliver with Uber. Earn on your schedule. Work on your schedule. Deliver for a few hours in the mornings, every night, or just on weekends—it's up to you. Earn Good Money. You’ll earn by bringing people the food they love from local restaurants. Choose...Read more
Hi, Hope you are doing great!! Please find the requirement below, If you find yourself comfortable with the requirement please reply back with your updated resume and I will get back to you or I would really appreciate if you can give me a call back at my...Read more
In-Home Usage Tester (Product Tester from home) Part-time Presently we're recruiting Product Testers (from home) in several US cities to expand our private network of In-Home Usage Testers (IHUT) to fulfill upcoming contracts with national and...Read more
Title HadoopSpark Engineer Location St. Louis, MO Duration 1+ year Interview Skype Language - Java andor Python and Scala Code some sample programs in Mapreduce as well as Spark on the call Computing platforms - Hadoop, Spark Batch Mode ETL - Sqoop, Flume...Read more
Looking for Big data engineer with Spark and Scala experience, but who has done Javahadoop role in past . Someone senior + hands-on and has played with Hadoop installation on laptop , dev and production setups. Need to have MapReduce (Hadoop programming...Read more
Hadoop-LeadWipro Ltd.O Fallon, MO
Mandatory Skills: Hadoop Desirable Skills: Hive Job Description: Key skills required for the job are: * Hadoop-L3 (Mandatory) * Hive-L3 As a Lead, you are responsible for managing a small team of analysts, developers, testers or engineers and drive...Read more
* Ability to make decisions and solve problems while working under pressure * Ability to prioritize and organize effectively * Ability to show judgment and initiative and to accomplish job duties * Ability to use personal computer and software applications...Read more
Engineer 2 Database Administrator (PostGres)Programmer Resources Intl IncSt. Louis, MO
Job Title: Engineer 2 Database Administrator (PostGres) Job ID: 2019-289429 # Positions: 1 Overview: As an Engineer 2, Database Administrator (Postgres), you will leverage your data design and development expertise as part of a developing AWS database team...Read more

Similar jobs

TECHNOGEN, Inc. is a Proven Leader in providing full IT Services, Software Development and Solutions for 15 years. TECHNOGEN is a Small & Woman Owned Minority Business with GSA Advantage Certification. We have offices in VA; MD & Offshore development...Read more
Big DataDeloitteSt. Louis, MO
Position summary As a Big Data/Cloud EnablementSenior Manager you will focus on managing the information supply chain from acquisition to ingestion, storage and the provisioning of data to points of impact by modernizing and enabling new capabilities...Read more
Big Data ArchitectApton incSt. Louis, MO
10+ years of Data warehouse and Business Intelligence and is knowledgeable in various analytical modeling techniques. Should have experience with ETL design, Hadoop (Data lake, hive, sql) Qualifications Developing data Architecture to effectively capture...Read more
Are you looking for a new and challenging opportunity? Do you have experience with DBA? Technology Partners can help you make your next big career move a reality. Our client is currently seeking a talented person for an Engineer 2, Database Administrator...Read more
Description: Must be able to work as our W2 Employee. We are seeking a developer to partner with other engineering teams to help architect and build the data pipeline that ingest hundreds of billions of data points?for our Field Analytics Platform...Read more
Data Engineer - Maryland HeightsKforce Technology StaffingMaryland Heights, MO
RESPONSIBILITIES Kforce has a client seeking a blend of a Data Engineer in Maryland Heights, Missouri (MO). Essential Functions 70 of this person's time will be assisting data analystsscientist with data source codes, using data lake technologies 30 of...Read more
Adaptive Solutions Group is a premier provider of information technology personnel. We provide a variety of technical professionals available for contract, contract to hire, or direct placement positions to companies in and around the St. Louis, Kansas...Read more
Skills Required: Hadoop Administrator, with exposure in other BigData technologies and excellent customer interfacing skills. Understand requirements from functional and mapping documents. Raise required clarification and questions prior to requirement...Read more
KellyMitchell matches the best IT and business talent with premier organizations nationwide. Our clients, ranging from Fortune 500 corporations to rapidly growing high-tech companies, are exceptionally served by our 1500+ IT and business consultants. Our...Read more
Big Data DeveloperPyramid Consulting, Inc.St. Louis
Extensive experience with Hadoop development projects, inclusive of HDFS, Hbase, Spark, graph databases (Titan in particular), Kafka Must have experience leading teams (for senior big data developers ...Read more