HDFS, MapReduce, HBase, Spark 1.3+, Hive, Pig, Kafka 1.2+, Sqoop, Flume, NiFi, Impala, Oozie, ZooKeeper
Relational & NoSQL Databases
MySQL, Oracle, PostgreSQL, HBase, MongoDB
Linux (CentOS, Ubuntu), Windows, Mac OS
Machine Learning algorithms
Regression, Perceptron, Naive Bayes, Decision tree, K-means, SVM
First Niagara Bank is a community-oriented regional banking corporation. Their business involves financial services to individuals, families and business.
The purpose of this project is to capture all data streams from different sources into our cloud stack based on technologies including Hadoop, Spark and Kafka. Also, we built new processing pipelines over transaction records, user profiles, files, and communication data ranging from emails, instant messages, social media feeds. Moreover, using Spark to enrich and transform data to internal data models powering search, data visualization and analytics.
Hadoop, HDFS, MapReduce, Spark 1.5, Spark SQL, Spark Streaming, Zookeeper, Oozie, HBase, Hive, Kafka, Pig, Hive, Scala, Python
WSFS Bank is a financial services company. It provides services including ommercial banking, retail banking and trust and wealth management.
The purpose of this project is to provide data processing and analytic solutions including streaming data ingestion, log and relational databases integration, data transformation and data modeling.
Hadoop, Scala, Spark, Spark SQL, Spark Streaming, Oozie, Zookeeper, Kafka, Pig, Sqoop, Flume, MongoDB, HBase, MLlib, Tableau, Junit, Pytest
The Hanover Insurance Group is the holding company for several property and casualty insurance. This company mainly focused on home, auto and business insurance, it also offers wide variety of flexibility and claims.
The project is to build a fully distributed HDFS and integrate necessary Hadoop tools. Meanwhile, we need to write MapReduce program to process and analysis data stored in HDFS
Hadoop, HDFS, YARN, MapReduce, Sqoop, Flume, Hive, Pig, Zookeeper, Oozie, Oracle, JUnit, MRUnit
JD.com is a Chinese electronic commerce company. It is the largest B2C online retailers in China, and a major competitor to Alibaba TaoBao.
The project is to design and implement different modules including product recommendation and some webpage implementation.
Chung How Kitchen is a Chinese restaurant in Stony Brook, NY.
Chung How Kitchen managed to display the restaurant information to their customers. This project implemented interactive navigation to the website.
Companies Worked For:
Job Titles Held: