Project Name: Data Lake Solution
Client: Major Healthcare Provider
Project Commencement Date: Oct 2018
Project Completion Date: Present
Business Problem: The client is lacking a single source of truth and optimal process for Data Aquisition, Processing and producing Advanced Analytics in realtime.
Need new data architecture.
Re-engineering and new data model for the data lake.
Make a single source of truth in Data lake Horton works.
Data science complication.
KPI & generation of new reporting.
Technical Solution: Develop Data lake, Micro service architecture, API, Database performance issue, Data ingestion.
Technologies Used: Azure Data Lake, Hadoop, NoSQL, Docker, Kubernetes, Microservice architecture, Spark, Hive, Hbase, Kafka, REST API, Hortonworks, Hive, Oracle, SQL Server