Over 5 years of IT experience as a Developer, Designer & QA Test Engineer with cross-platform integration experience using Hadoop Ecosystem, Java and Software Functional Testing. Hands on experience in installing, configuring and using Hadoop Ecosystem - HDFS, MapReduce, Pig, Hive, Oozie, Flume, HBase, Spark, Sqoop, Flume and Oozie. Strong understanding of various Hadoop services, MapReduce and YARN architecture. Responsible for writing Map Reduce programs. Experienced in importing-exporting data into HDFS using SQOOP Experience loading data to Hive partitions and creating buckets in Hive. Developed Map Reduce jobs to automate transfer the data from HBase. Expertise in analysis using PIG, HIVE and MapReduce. Experienced in developing UDFs for Hive, PIG using Java. Strong understanding of NoSQL databases like HBase, MongoDB & Cassandra. Scheduling all Hadoop/hive/Sqoop/HBase jobs using Oozie Experience in setting cluster in Amazon EC2 & S3 including the automation of setting & extending the clusters in AWS Amazon cloud. Good understanding of Scrum methodologies, Test Driven Development and continuous integration. Major strengths are familiarity with multiple software systems, ability to learn quickly new technologies, adapt to new environments, self-motivated, team player, focused adaptive and quick learner with excellent interpersonal, technical and communication skills. Experience in defining detailed application software test plans, including organization, participant, schedule, test and application coverage scope. Experience in gathering and defining functional and user interface requirements for software applications. Experience in real time analytics with Apache Spark (RDD, Data Frames and Streaming API). Used Spark Data Frames API over Cloudera platform to perform analytics on Hive data. Experience in integrating Hadoop with Kafka. Expertise in uploading Click stream data from Kafka to HDFS. Expert in utilizing Kafka for messaging and publishing subscribe messaging system
|
|
By clicking Customize This Resume, you agree to our Terms of Use and Privacy Policy
Any information uploaded, such as a resume, or input by the user is owned solely by the user, not LiveCareer. For further information, please visit our Terms of Use.
By clicking Customize This Resume, you agree to our Terms of Use and Privacy Policy