Skip to main navigation Skip to search Skip to main content

Dirty-Data Impacts on Regression Models: An Experimental Evaluation

  • School of Computer Science and Technology, Harbin Institute of Technology
  • Pengcheng Laboratory

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

Data quality issues have attracted widespread attentions due to the negative impacts of dirty data on regression model results. The relationship between data quality and the accuracy of results could be applied on the selection of appropriate regression model with the consideration of data quality and the determination of data share to clean. However, rare research has focused on exploring such relationship. Motivated by this, we design a generalized framework to evaluate dirty-data impacts on models. Using the framework, we conduct an experimental evaluation for the effects of missing, inconsistent, and conflicting data on regression models. Based on the experimental findings, we provide guidelines for regression model selection and data cleaning.

Original languageEnglish
Title of host publicationDatabase Systems for Advanced Applications - 26th International Conference, DASFAA 2021, Proceedings
EditorsChristian S. Jensen, Ee-Peng Lim, De-Nian Yang, Wang-Chien Lee, Vincent S. Tseng, Vana Kalogeraki, Jen-Wei Huang, Chih-Ya Shen
PublisherSpringer Science and Business Media Deutschland GmbH
Pages88-95
Number of pages8
ISBN (Print)9783030731939
DOIs
StatePublished - 2021
Externally publishedYes
Event26th International Conference on Database Systems for Advanced Applications, DASFAA 2021 - Virtual, Online, Taiwan, Province of China
Duration: 11 Apr 202114 Apr 2021

Publication series

NameLecture Notes in Computer Science
Volume12681 LNCS
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Conference

Conference26th International Conference on Database Systems for Advanced Applications, DASFAA 2021
Country/TerritoryTaiwan, Province of China
CityVirtual, Online
Period11/04/2114/04/21

Keywords

  • Data cleaning
  • Data quality
  • Experimental evaluation
  • Model selection
  • Regression model

Fingerprint

Dive into the research topics of 'Dirty-Data Impacts on Regression Models: An Experimental Evaluation'. Together they form a unique fingerprint.

Cite this