Architectural Pattern for Implementing Data Quality Monitoring and Reporting Framework.
 |
International Journal of Computer Trends and Technology (IJCTT) |  |
| © 2020 by IJCTT Journal | ||
| Volume-68 Issue-2 |
||
| Year of Publication : 2020 | ||
| Authors : Imran Quadri Syed | ||
| DOI : 10.14445/22312803/IJCTT-V68I2P107 |
MLA Style:Imran Quadri Syed "Architectural Pattern for Implementing Data Quality Monitoring and Reporting Framework." International Journal of Computer Trends and Technology 68.2 (2020):46-53.
APA Style: Imran Quadri Syed (2020). Architectural Pattern for Implementing Data Quality Monitoring and Reporting Framework. International Journal of Computer Trends and Technology, 68(2),46-53.
Abstract
In today’s world where data is being collected from different source systems and this data eventually makes its way to Enterprise Data Warehouses and Enterprise Data hubs, maintaining highest quality of databeing loadedis imperative.Data Quality could drive an application to be successful or a failure. In this article we will discuss architectural pattern on how the data qualityframeworkcould be implemented to monitor data qualityand provide data quality metricstodata stewards in order to be able to make informed decision oneither to accept or reject aninstance/batch of data load intoEnterprise Datahub/Datawarehouse.
Reference
[1] Fatimetou Zahra Mohamed Mahmoud, Noor Aziza Mohamadali"The Business Intelligence Use In Healthcare And Its Enhancement By Predictive Analytics" International Journal of Engineering Trends and Technology 67.7 (2019): 26-39
[2] Imran Quadri Syed ?Big Data Architectural Pattern to Ingest Multiple Sources and Standardization to Immune Downstream Applications? International Journal of Engineering Trends and Technology 68.1(2019):5-10
[3] Ruojing Zhang, Marta Indulska, Shazia Sadiq. ?Discovering Data Quality Problems?. Business & Information Systems Engineering – Springer Journals published in July 2019.
[4] RistoSilvola, JanneHarkonen, ollivilppola, Hanna Kropsu-Vehkapera and HarriHaapsalo. ?Data quality assessment and improvement? International Journal of Business Information Systems published in January 2016.
[5] Atif Mohammad, Hamid Mcheick, Emanuel Grant ?Big Data Architecture Evolution: 2014 and Beyond? published in Association for Computing Machinery in September 2014
[6] Caihua Liu, Patrick Nitschke, Susan P. Williams, DidarZowghi ?Data quality and the Internet of Things? Computing 102, 573-599 (2020).
Keywords
Enterprise Datahub, Enterprise Data Warehouse, Data Quality, Pre-Stage Data Quality Rules, Post-Stage Data Quality Rules, File Gateway, File Management, Key Performance Indicators (KPI).