2026-04-14T08:35:21Zhttps://recercat.cat/oai/request

oai:recercat.cat:2117/1692932026-01-24T08:20:44Zcom_2072_1033col_2072_452950

PRESISTANT: Learning based assistant for data pre-processing Bilalli, Besim Abelló Gamazo, Alberto Aluja Banet, Tomàs Wrembel, Robert Universitat Politècnica de Catalunya. Departament d'Enginyeria de Serveis i Sistemes d'Informació Universitat Politècnica de Catalunya. Departament d'Estadística i Investigació Operativa Universitat Politècnica de Catalunya. inSSIDE - integrated Software, Service, Information and Data Engineering Àrees temàtiques de la UPC::Informàtica::Sistemes d'informació Decision trees Data mining Information storage and retrieval systems Data pre-processing Meta-learning Arbres de decisió Mineria de dades Informació -- Sistemes d'emmagatzematge i recuperació Data pre-processing is one of the most time consuming and relevant steps in a data analysis process (e.g., classification task). A given data pre-processing operator can have positive, negative, or zero impact on the final result of the analysis. Expert users have the required knowledge to find the right pre-processing operators. However, when it comes to non-experts, they are overwhelmed by the amount of pre-processing operators and it is challenging for them to find operators that would positively impact their analysis (e.g., increase the predictive accuracy of a classifier). Existing solutions either assume that users have expert knowledge, or they recommend pre-processing operators that are only “syntactically” applicable to a dataset, without taking into account their impact on the final analysis. In this work, we aim at providing assistance to non-expert users by recommending data pre-processing operators that are ranked according to their impact on the final analysis. We developed a tool, PRESISTANT, that uses Random Forests to learn the impact of pre-processing operators on the performance (e.g., predictive accuracy) of 5 different classification algorithms, such as Decision Tree (J48), Naive Bayes, PART, Logistic Regression, and Nearest Neighbor (IBk). Extensive evaluations on the recommendations provided by our tool, show that PRESISTANT can effectively help non-experts in order to achieve improved results in their analytic tasks. Peer Reviewed Postprint (author's final draft) 2019-09 Article Bilalli, B. [et al.]. PRESISTANT: Learning based assistant for data pre-processing. "Data and knowledge engineering", vol. 123, Setembre 2019, núm. 101727, p. 1-22. 0169-023X https://hdl.handle.net/2117/169293 10.1016/j.datak.2019.101727 eng https://www.sciencedirect.com/science/article/pii/S0169023X18305123 http://creativecommons.org/licenses/by-nc-nd/3.0/es/ Open Access Attribution-NonCommercial-NoDerivs 3.0 Spain 31 p. application/pdf Elsevier