International Journal of Computer
Trends and Technology

Research Article | Open Access | Download PDF

Volume 71 | Issue 2 | Year 2023 | Article Id. IJCTT-V71I2P106 | DOI : https://doi.org/10.14445/22312803/IJCTT-V71I2P106

Exploring Popular ETL Testing Techniques

Dhamotharan Seenivasan

Received Revised Accepted Published
03 Jan 2023 05 Feb 2023 16 Feb 2023 28 Feb 2023

Citation :

Dhamotharan Seenivasan, "Exploring Popular ETL Testing Techniques," International Journal of Computer Trends and Technology (IJCTT), vol. 71, no. 2, pp. 32-39, 2023. Crossref, https://doi.org/10.14445/22312803/ IJCTT-V71I2P106

Abstract

ETL (Extract, Transform, Load) testing is an essential process in ensuring the accuracy, completeness, and consistency of data throughout the ETL process. In this article, we provide an overview of the ETL testing process and explore various ETL testing techniques, including data completeness, accuracy, integrity, transformation, performance, user acceptance, and regression testing. We also discuss best practices for ETL testing, common challenges, and the importance of ETL testing in maintaining high-quality data. By implementing effective ETL testing techniques, organizations can ensure the reliability and validity of their data, leading to better business decisions and outcomes.

Keywords

Data warehouse, ETL testing, Extract Transform and Load (ETL), ETL performance, ETL optimization.

References

[1] Theobald J., “Strategies for Testing Data Warehouse Applications,” Information Management, vol. 17, no. 6, p. 20, 2007.
[2] Mahendra A Sethi, and Santosh S Lomte, "An Interactive Dynamic Elearning Framework for Visual and Verbal Learners," SSRG International Journal of Computer Science and Engineering, vol. 4, no. 7, pp. 3-13, 2017. Crossref, https://doi.org/10.14445/23488387/IJCSE-V4I7P102
[3] Sara B. Dakrory, Tarek M. Mahmoud, and Abdelmgeid A. Ali, “Automated ETL Testing on the Data Quality of a Data Warehouse,” International Journal of Computer Applications, vol. 131, no. 16, pp. 9-16, 2015. Crossref, http://dx.doi.org/10.5120/ijca2015907590
[4] Vandana KV., and Sujatha V., ETL Testing in Datawarehousing, 2013
[5] Baljit Singh, "Enterprise Reporting on SAP S/4HANA Using Snowflake as Cloud Datawarehouse," International Journal of Computer Trends and Technology, vol. 71, no. 1, pp. 45-49, 2023. Crossref, https://doi.org/10.14445/22312803/IJCTT-V71I1P107
[6] Mookerjea A, and Malisetty P, Data Warehouse/ETL Testing: Best Practices, Proc. Test (Test Excellence Through Speed And Technology), New Delhi, India. 2008
[7] Ralph Kimball, and Joe Caserta, The Data Warehouse ETL Toolkit, John Wiley & Sons, 2004
[8] Matteo Golfarelli, and Stefano Rizzi, “Data Warehouse Testing,” International Journal of Data Warehousing and Mining (IJDWM), vol. 7, no. 2, pp. 26-43, 2011.
[9] Mitesh Athwani, "A Novel Approach to Version XML Data Warehouse," SSRG International Journal of Computer Science and Engineering, vol. 8, no. 9, pp. 5-11, 2021. Crossref, https://doi.org/10.14445/23488387/IJCSE-V8I9P102
[10] Dhamotharan Seenivasan, “ETL (Extract, Transform, Load) Best Practices,” International Journal of Computer Trends and Technology, vol. 71, no. 1, pp. 40-44, 2023. Crossref, https://doi.org/10.14445/22312803/IJCTT-V71I1P106
[11] Sonali Vyas, and Pragya Vaishnav, “A comparative study of various ETL process and their testing techniques in data warehouse,” Journal of Statistics and Management Systems, vol. 20, no. 4, 2017. Crossref, https://doi.org/10.1080/09720510.2017.1395194
[12] [Online]. Available: https://www.researchgate.net/publication/368300555_ETL_for_Data_Warehousing
[13] Dhamotharan Seenivasan, "ETL (Extract, Transform, Load) Best Practices," International Journal of Computer Trends and Technology, vol. 71, no. 1, pp. 40-44, 2023. Crossref, https://doi.org/10.14445/22312803/IJCTT-V71I1P106
[14] [Online]. Available:https://www.zyxware.com/articles/5152/what-are-the-challenges-of-etl-testing
[15] [Online]. Available: https://www.tutorialspoint.com/etl_testing/etl_testing_challenges.htm
[16] [Online]. Available: https://www.guru99.com/utlimate-guide-etl-datawarehouse-testing.html
[17] [Online]. Available: https://www.softwaretestinghelp.com/etl-testing-data-warehouse-testing/
[18] [Online]. Available: https://www.cigniti.com/blog/conquering-the-challenges-of-data-warehouse-etl-testing/
[19] [Online]. Available: https://www.altexsoft.com/blog/etl-testing/
[20] Dhamotharan Seenivasan, Improving Performance of the ETL Jobs, IIOAB, 2023
[21] [Online]. Available: https://hevodata.com/learn/etl-testing/
[22] [Online]. Available: https://www.datagaps.com/data-testing-concepts/etl-testing/
[23] [Online]. Available: https://www.matillion.com/resources/blog/what-are-the-basics-of-etl-testing
[24] [Online]. Available: https://www.testingxperts.com/blog/etl-testing-guide
[25] Mr. Sujit Prajapati, and Mrs. Sarala Mary, “Study of ETL Process and Its Testing Techniques,” Ijraset Journal for Research in Applied Science and Engineering Technology, vol. 10, no. 6, 2022. Crossref, https://doi.org/10.22214/ijraset.2022.43931
[26] [Online]. Available: https://dataq.io/etl-testing/
[27] [Online]. Available: https://impactqa.medium.com/etl-test-automation-for-better-business-operations-749d768929bc
[28] [Online]. Available: https://www.javatpoint.com/etl-testing
[29] [Online]. Available: https://www.tricentis.com/blog/key-considerations-data-warehousing-etl-test-automation
[30] [Online]. Available: https://www.testing-whiz.com/blog/importance-of-etl-testing-process-challenges-and-future/
[31] [Online]. Available: https://solutionsreview.com/data-integration/the-best-etl-testing-tools-for-data-integration-success/
[32] [Online]. Available: https://www.prolifics-testing.com/testing-services/projects/etl-testing
[33] [Online]. Available: https://dataintegrationinfo.com/data-validation-testing