2026-04-14T02:09:31Zhttps://recercat.cat/oai/request

oai:recercat.cat:2117/261302026-02-04T03:41:57Zcom_2072_1033col_2072_452950

Bijoux : data generator for evaluating ETL process quality Nakuçi, Emona Theodorou, Vasileios Jovanovic, Petar Abelló Gamazo, Alberto Universitat Politècnica de Catalunya. Departament d'Enginyeria de Serveis i Sistemes d'Informació Universitat Politècnica de Catalunya. MPI - Modelització i Processament de la Informació Àrees temàtiques de la UPC::Informàtica::Sistemes d'informació Data warehousing Process quality Data generator ETL Repositoris Gestors de dades Obtaining the right set of data for evaluating the fulfillment of different quality standards in the extract-transform-load (ETL) process design is rather challenging. First, the real data might be out of reach due to different privacy constraints, while providing a synthetic set of data is known as a labor-intensive task that needs to take various combinations of process parameters into account. Additionally, having a single dataset usually does not represent the evolution of data throughout the complete process lifespan, hence missing the plethora of possible test cases. To facilitate such demanding task, in this paper we propose an automatic data generator (i.e., Bijoux). Starting from a given ETL process model, Bijoux extracts the semantics of data transformations, analyzes the constraints they imply over data, and automatically generates testing datasets. At the same time, it considers different dataset and transformation characteristics (e.g., size, distribution, selectivity, etc.) in order to cover a variety of test scenarios. We report our experimental findings showing the effectiveness and scalability of our approach. Peer Reviewed Postprint (published version) 2014 Conference report Nakuçi, E. [et al.]. Bijoux : data generator for evaluating ETL process quality. A: International Workshop On Data Warehousing and OLAP. "Proceedings of the 17th International Workshop on Data Warehousing and OLAP". Shanghai: 2014, p. 23-32. 978-1-4503-0999-8 https://hdl.handle.net/2117/26130 10.1145/2666158.2666183 eng http://dl.acm.org/citation.cfm?doid=2666158.2666183 Restricted access - publisher's policy 10 p. application/pdf