Hadoop Developer/ Tester Resume Example Cliffit Solutions

HADOOP DEVELOPER/ TESTER

Professional Summary

Experience testing Data Warehouse / Big Data applications using ETL.
Experience in data analysis, validation, cleaning, and verification of data and identifying data mismatch in large-scale, distributed systems.
Experience in developing Map-Reduce programs, Unix shell, Automation test cases.
Experience in Importing and Exporting the data using Sqoop from HDFS to RDBMS and vice versa.
Good experience in SOAP cloud testing.
Tested the GUI of the end product on Mobile and PC.
Experience with testing near real-time data-processing and Analytics Application System.
Used need base SQL queries like select, insert, update, delete and joining multiple tables based on a business requirement to conduct backend testing.
Experience in data warehousing using Amazon Redshift.
Extended Hive and Pig functionality by writing custom UDFs.
Hands on experience in implementing ETL Processes.
Working experience on Quality Center, SQL Server, J2EE.

Skills

Work History

Hadoop Developer/ Tester, 02/2016 to 02/2017
CliffIt Solutions – City , STATE

Managed 200+ Nodes CDH 5.3.8 cluster with 14 petabytes of data using CM 5.5.1 and Linux Cent OS 6.5.
Installed and configured Cloudera Manager for easy management of existing Hadoop cluster.
Deployed cluster in AWS.
Enhanced and optimized product Spark code to aggregate, group and run data mining tasks using the Spark framework.
Performed integration testing of Hadoop packages for ingestion, transformation, and loading of massive structured and unstructured data into benchmark cube.
Hand in developing and testing solutions to analyze large data sets efficiently.
Designed several test scenarios and test cases.
Worked on Quality Center, SQL Server, J2EE.
Involved in creating Hive tables, loading and analyzing data using Hive Queries.
Managed the quality risks and several testing issues.
Load and transform large sets of structured, semi-structured and unstructured data.
Worked on testing and increasing the performance for Hive and Pig queries.
Implemented a proof of concept using Kafka, Storm. Work on spark SQL and spark streaming.
Wrote scripts in Redshift and modified scope to be in Redshift due to relational data.
Worked on EMR to analyze data in S3 bucket.

Environment: HDFS, Hive, MapReduce, Pig, Sqoop, AWS, EMR, RedShift, Kafka, Storm, Spark, Scala, SQL.

Big Data Tester/ Quality Center, 02/2017 to Current
Ciber Inc – City , STATE

Executing test plans/cases and report on results.
Communicating testing results in conjunction with test plans.
Representing defects into the development process.
Identifying and analyze defects/test results and be able to deduct the chain of events leading to a failure.
Help develop, document, and implement applicable QA processes and procedures to provide more effective quality methods within the group in support of providing quality products.
Create, implement, maintain, and enhance test plans, test scripts, and test methodologies that ensure exhaustive testing of all assigned products.
Develop software quality test plans and test cases, and lead in setting and maintaining the standards for Software Quality Assurance test documentation.
Collaborate with Product Manager, Scrum Product Owner, stakeholders, and development teams in order to help refine the Product Backlog by way of User Stories.
This person will their expertise to help elaborate User Stories and ensure proper and complete acceptance criteria.
Collaborate with developers to improve overall product quality by emphasizing defect prevention throughout the development process.
Identify areas for test improvement through analysis, experience, and use of metrics.
Participate in daily scrum activities.

Education

Bachelor of Technology (B-TECH): Computer Science & Engineering, 2013
Audisankara College of Engineering & Technology - City, State

Masters Of Science In Computer Science(MSCS): Computer Science, Current
Silicon Valley University - City, State

Resume Overview

School Attended

Job Titles Held:

Degrees

Bachelor of Technology (B-TECH) : Computer Science & Engineering , 2013
Masters Of Science In Computer Science(MSCS) : Computer Science , Current