Exploring Popular ETL Testing Techniques

  IJCTT-book-cover
 
         
 
© 2023 by IJCTT Journal
Volume-71 Issue-2
Year of Publication : 2023
Authors : Dhamotharan Seenivasan
DOI :  10.14445/22312803/IJCTT-V71I2P106

How to Cite?

Dhamotharan Seenivasan, "Exploring Popular ETL Testing Techniques," International Journal of Computer Trends and Technology, vol. 71, no. 2, pp. 32-39, 2023. Crossref, https://doi.org/10.14445/22312803/IJCTT-V71I2P106

Abstract
ETL (Extract, Transform, Load) testing is an essential process in ensuring the accuracy, completeness, and consistency of data throughout the ETL process. In this article, we provide an overview of the ETL testing process and explore various ETL testing techniques, including data completeness, accuracy, integrity, transformation, performance, user acceptance, and regression testing. We also discuss best practices for ETL testing, common challenges, and the importance of ETL testing in maintaining high-quality data. By implementing effective ETL testing techniques, organizations can ensure the reliability and validity of their data, leading to better business decisions and outcomes.

Keywords
Data warehouse, ETL testing, Extract Transform and Load (ETL), ETL performance, ETL optimization.

Reference

[1] Theobald J., “Strategies for Testing Data Warehouse Applications,” Information Management, vol. 17, no. 6, p. 20, 2007.
[2] Mahendra A Sethi, and Santosh S Lomte, "An Interactive Dynamic Elearning Framework for Visual and Verbal Learners," SSRG International Journal of Computer Science and Engineering, vol. 4, no. 7, pp. 3-13, 2017. Crossref, https://doi.org/10.14445/23488387/IJCSE-V4I7P102
[3] Sara B. Dakrory, Tarek M. Mahmoud, and Abdelmgeid A. Ali, “Automated ETL Testing on the Data Quality of a Data Warehouse,” International Journal of Computer Applications, vol. 131, no. 16, pp. 9-16, 2015. Crossref, http://dx.doi.org/10.5120/ijca2015907590
[4] Vandana KV., and Sujatha V., ETL Testing in Datawarehousing, 2013
[5] Baljit Singh, "Enterprise Reporting on SAP S/4HANA Using Snowflake as Cloud Datawarehouse," International Journal of Computer Trends and Technology, vol. 71, no. 1, pp. 45-49, 2023. Crossref, https://doi.org/10.14445/22312803/IJCTT-V71I1P107
[6] Mookerjea A, and Malisetty P, Data Warehouse/ETL Testing: Best Practices, Proc. Test (Test Excellence Through Speed And Technology), New Delhi, India. 2008
[7] Ralph Kimball, and Joe Caserta, The Data Warehouse ETL Toolkit, John Wiley & Sons, 2004
[8] Matteo Golfarelli, and Stefano Rizzi, “Data Warehouse Testing,” International Journal of Data Warehousing and Mining (IJDWM), vol. 7, no. 2, pp. 26-43, 2011.
[9] Mitesh Athwani, "A Novel Approach to Version XML Data Warehouse," SSRG International Journal of Computer Science and Engineering, vol. 8, no. 9, pp. 5-11, 2021. Crossref, https://doi.org/10.14445/23488387/IJCSE-V8I9P102
[10] Dhamotharan Seenivasan, “ETL (Extract, Transform, Load) Best Practices,” International Journal of Computer Trends and Technology, vol. 71, no. 1, pp. 40-44, 2023. Crossref, https://doi.org/10.14445/22312803/IJCTT-V71I1P106
[11] Sonali Vyas, and Pragya Vaishnav, “A comparative study of various ETL process and their testing techniques in data warehouse,” Journal of Statistics and Management Systems, vol. 20, no. 4, 2017. Crossref, https://doi.org/10.1080/09720510.2017.1395194
[12] [Online]. Available: https://www.researchgate.net/publication/368300555_ETL_for_Data_Warehousing
[13] Dhamotharan Seenivasan, "ETL (Extract, Transform, Load) Best Practices," International Journal of Computer Trends and Technology, vol. 71, no. 1, pp. 40-44, 2023. Crossref, https://doi.org/10.14445/22312803/IJCTT-V71I1P106
[14] [Online]. Available:https://www.zyxware.com/articles/5152/what-are-the-challenges-of-etl-testing
[15] [Online]. Available: https://www.tutorialspoint.com/etl_testing/etl_testing_challenges.htm
[16] [Online]. Available: https://www.guru99.com/utlimate-guide-etl-datawarehouse-testing.html
[17] [Online]. Available: https://www.softwaretestinghelp.com/etl-testing-data-warehouse-testing/
[18] [Online]. Available: https://www.cigniti.com/blog/conquering-the-challenges-of-data-warehouse-etl-testing/
[19] [Online]. Available: https://www.altexsoft.com/blog/etl-testing/
[20] Dhamotharan Seenivasan, Improving Performance of the ETL Jobs, IIOAB, 2023
[21] [Online]. Available: https://hevodata.com/learn/etl-testing/
[22] [Online]. Available: https://www.datagaps.com/data-testing-concepts/etl-testing/
[23] [Online]. Available: https://www.matillion.com/resources/blog/what-are-the-basics-of-etl-testing
[24] [Online]. Available: https://www.testingxperts.com/blog/etl-testing-guide
[25] Mr. Sujit Prajapati, and Mrs. Sarala Mary, “Study of ETL Process and Its Testing Techniques,” Ijraset Journal for Research in Applied Science and Engineering Technology, vol. 10, no. 6, 2022. Crossref, https://doi.org/10.22214/ijraset.2022.43931
[26] [Online]. Available: https://dataq.io/etl-testing/
[27] [Online]. Available: https://impactqa.medium.com/etl-test-automation-for-better-business-operations-749d768929bc
[28] [Online]. Available: https://www.javatpoint.com/etl-testing
[29] [Online]. Available: https://www.tricentis.com/blog/key-considerations-data-warehousing-etl-test-automation
[30] [Online]. Available: https://www.testing-whiz.com/blog/importance-of-etl-testing-process-challenges-and-future/
[31] [Online]. Available: https://solutionsreview.com/data-integration/the-best-etl-testing-tools-for-data-integration-success/
[32] [Online]. Available: https://www.prolifics-testing.com/testing-services/projects/etl-testing
[33] [Online]. Available: https://dataintegrationinfo.com/data-validation-testing