An assessment of open data sets completeness
The rapid growth of open data sources is driven by free-of-charge contents and ease of accessibility. While it is convenient for public data consumers to use data sets extracted from open data sources, the decision to use these data sets should be based on data sets’ quality. Several data quality di...
Saved in:
Main Authors: | , , , |
---|---|
Format: | Article |
Language: | English English English |
Published: |
2019
|
Subjects: | |
Online Access: | http://irep.iium.edu.my/77296/1/An%20Assessment%20of%20Open%20Data%20Sets%20Completeness.pdf http://irep.iium.edu.my/77296/7/77296_An%20assessment%20of%20open%20data%20sets%20completeness_Scopus.pdf http://irep.iium.edu.my/77296/12/77296_An%20Assessment%20of%20Open%20Data%20Sets%20Completeness_wos.pdf http://irep.iium.edu.my/77296/ |
Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
id |
my.iium.irep.77296 |
---|---|
record_format |
dspace |
spelling |
my.iium.irep.772962020-04-13T12:43:26Z http://irep.iium.edu.my/77296/ An assessment of open data sets completeness Ali, Abdulrazzak Asmai, Siti Emran, Nurul Akmar Ismail, Amelia Ritahani QA75 Electronic computers. Computer science The rapid growth of open data sources is driven by free-of-charge contents and ease of accessibility. While it is convenient for public data consumers to use data sets extracted from open data sources, the decision to use these data sets should be based on data sets’ quality. Several data quality dimensions such as completeness, accuracy, and timeliness are common requirements to make data fit for use. More importantly, in many cases, high-quality data sets are desirable in ensuring reliable outcomes of reports and analytics. Even though many open data sources provide data quality guidelines, the responsibility to ensure data of high quality requires commitment from data contributors. In this paper, an initial investigation on the quality of open data sets in terms of completeness dimension was conducted. In particular, the results of the missing values in 20 open data sets measurement were extracted from the open data sources. The analysis covered all the missing values representations which are not limited to nulls or blank spaces. The results exhibited a range of missing values ratios that indicated the level of the data sets completeness. The limited coverage of this analysis does not hinder understanding of the current level of data completeness of open data sets. The findings may motivate open data providers to design initiatives that will empower data quality policy and guidelines for data contributors. In addition, this analysis may assist public data users to decide on the acceptability of open data sets by applying the simple methods proposed in this paper or performing data cleaning actions to improve the completeness of the data sets concerned. 2019 Article PeerReviewed application/pdf en http://irep.iium.edu.my/77296/1/An%20Assessment%20of%20Open%20Data%20Sets%20Completeness.pdf application/pdf en http://irep.iium.edu.my/77296/7/77296_An%20assessment%20of%20open%20data%20sets%20completeness_Scopus.pdf application/pdf en http://irep.iium.edu.my/77296/12/77296_An%20Assessment%20of%20Open%20Data%20Sets%20Completeness_wos.pdf Ali, Abdulrazzak and Asmai, Siti and Emran, Nurul Akmar and Ismail, Amelia Ritahani (2019) An assessment of open data sets completeness. International Journal of Advanced Computer Science and Applications, 10 (6). pp. 557-562. ISSN 2158-107X E-ISSN 2156-5570 |
institution |
Universiti Islam Antarabangsa Malaysia |
building |
IIUM Library |
collection |
Institutional Repository |
continent |
Asia |
country |
Malaysia |
content_provider |
International Islamic University Malaysia |
content_source |
IIUM Repository (IREP) |
url_provider |
http://irep.iium.edu.my/ |
language |
English English English |
topic |
QA75 Electronic computers. Computer science |
spellingShingle |
QA75 Electronic computers. Computer science Ali, Abdulrazzak Asmai, Siti Emran, Nurul Akmar Ismail, Amelia Ritahani An assessment of open data sets completeness |
description |
The rapid growth of open data sources is driven by free-of-charge contents and ease of accessibility. While it is convenient for public data consumers to use data sets extracted from open data sources, the decision to use these data sets should be based on data sets’ quality. Several data quality dimensions such as completeness, accuracy, and timeliness are common requirements to make data fit for use. More importantly, in many cases, high-quality data sets are desirable in ensuring reliable outcomes of reports and analytics. Even though many open data sources provide data quality guidelines, the responsibility to ensure data of high quality requires commitment from data contributors. In this paper, an initial investigation on the quality of open data sets in terms of completeness dimension was conducted. In particular, the results of the missing values in 20 open data sets measurement were extracted from the open data sources. The analysis covered all the missing values representations which are not limited to nulls or blank spaces. The results exhibited a range of missing values ratios that indicated the level of the data sets completeness. The limited coverage of this analysis does not hinder understanding of the current level of data completeness of open data sets. The findings may motivate open data providers to design initiatives that will empower data quality policy and guidelines for data contributors. In addition, this analysis may assist public data users to decide on the acceptability of open data sets by applying the simple methods proposed in this paper or performing data cleaning actions to improve the completeness of the data sets concerned. |
format |
Article |
author |
Ali, Abdulrazzak Asmai, Siti Emran, Nurul Akmar Ismail, Amelia Ritahani |
author_facet |
Ali, Abdulrazzak Asmai, Siti Emran, Nurul Akmar Ismail, Amelia Ritahani |
author_sort |
Ali, Abdulrazzak |
title |
An assessment of open data sets completeness |
title_short |
An assessment of open data sets completeness |
title_full |
An assessment of open data sets completeness |
title_fullStr |
An assessment of open data sets completeness |
title_full_unstemmed |
An assessment of open data sets completeness |
title_sort |
assessment of open data sets completeness |
publishDate |
2019 |
url |
http://irep.iium.edu.my/77296/1/An%20Assessment%20of%20Open%20Data%20Sets%20Completeness.pdf http://irep.iium.edu.my/77296/7/77296_An%20assessment%20of%20open%20data%20sets%20completeness_Scopus.pdf http://irep.iium.edu.my/77296/12/77296_An%20Assessment%20of%20Open%20Data%20Sets%20Completeness_wos.pdf http://irep.iium.edu.my/77296/ |
_version_ |
1665894785824587776 |
score |
13.18916 |