International Journal of Computer
Trends and Technology

Research Article | Open Access | Download PDF

Volume 68 | Issue 2 | Year 2020 | Article Id. IJCTT-V68I2P107 | DOI : https://doi.org/10.14445/22312803/IJCTT-V68I2P107

Architectural Pattern for Implementing Data Quality Monitoring and Reporting Framework

Imran Quadri Syed

Received Revised Accepted
07 Jan 2020 16 Feb 2020 17 Feb 2020

Citation :

Imran Quadri Syed, "Architectural Pattern for Implementing Data Quality Monitoring and Reporting Framework," International Journal of Computer Trends and Technology (IJCTT), vol. 68, no. 2, pp. 46-53, 2020. Crossref, https://doi.org/10.14445/22312803/ IJCTT-V68I2P107

Abstract

In today’s world where data is being collected from different source systems and this data eventually makes its way to Enterprise Data Warehouses and Enterprise Data hubs, maintaining highest quality of databeing loadedis imperative.Data Quality could drive an application to be successful or a failure. In this article we will discuss architectural pattern on how the data qualityframeworkcould be implemented to monitor data qualityand provide data quality metricstodata stewards in order to be able to make informed decision oneither to accept or reject aninstance/batch of data load intoEnterprise Datahub/Datawarehouse.

Keywords

Enterprise Datahub, Enterprise Data Warehouse, Data Quality, Pre-Stage Data Quality Rules, Post-Stage Data Quality Rules, File Gateway, File Management, Key Performance Indicators (KPI).

References

[1] Fatimetou Zahra Mohamed Mahmoud, Noor Aziza Mohamadali"The Business Intelligence Use In Healthcare And Its Enhancement By Predictive Analytics" International Journal of Engineering Trends and Technology 67.7 (2019): 26-39
[2] Imran Quadri Syed ?Big Data Architectural Pattern to Ingest Multiple Sources and Standardization to Immune Downstream Applications? International Journal of Engineering Trends and Technology 68.1(2019):5-10
[3] Ruojing Zhang, Marta Indulska, Shazia Sadiq. ?Discovering Data Quality Problems?. Business & Information Systems Engineering – Springer Journals published in July 2019.
[4] RistoSilvola, JanneHarkonen, ollivilppola, Hanna Kropsu-Vehkapera and HarriHaapsalo. ?Data quality assessment and improvement? International Journal of Business Information Systems published in January 2016.
[5] Atif Mohammad, Hamid Mcheick, Emanuel Grant ?Big Data Architecture Evolution: 2014 and Beyond? published in Association for Computing Machinery in September 2014
[6] Caihua Liu, Patrick Nitschke, Susan P. Williams, DidarZowghi ?Data quality and the Internet of Things? Computing 102, 573-599 (2020).