The development of a new data migration model for NoSQL databases with different schemas in environment management system
Data migration transfers data from one database to another database. The motivations of data migration are, for example, transferring data from a legacy database to a modern one and maintaining data up-to-date and consistent in a distributed system. Compared to data migration between traditional dat...
Saved in:
Main Authors: | , |
---|---|
Format: | Article |
Published: |
Dorma Journals
2020
|
Subjects: | |
Online Access: | http://eprints.utm.my/id/eprint/93055/ |
Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
id |
my.utm.93055 |
---|---|
record_format |
eprints |
spelling |
my.utm.930552021-11-07T05:54:45Z http://eprints.utm.my/id/eprint/93055/ The development of a new data migration model for NoSQL databases with different schemas in environment management system Ji, L. F. Azmi, N. F. M. T58.5-58.64 Information technology Data migration transfers data from one database to another database. The motivations of data migration are, for example, transferring data from a legacy database to a modern one and maintaining data up-to-date and consistent in a distributed system. Compared to data migration between traditional databases, data migration between heterogeneous NoSQL databases is more challenging due to the characteristics of NoSQL database such as flexible schema, different supporting features, and different storage paradigms. The differences may cause data quality problem after data migration, especially for environment management system where data are required to predict or to convey accurate information. Therefore, the migration of data between heterogeneous NoSQL databases requires not only to overcome the differences of these databases, but also to ensure the quality of the migrated data. In this paper, we proposed a data migration hub, a model that uses a record to record migration style to transfer data between different NoSQL database schemas. The proposed hub is applicable to the environment management system with data validation and fault tolerance in migration process. As confirmed by the pilot study, our method is able to migrate full set of fields to the destinated database in MongoDB. Dorma Journals 2020 Article PeerReviewed Ji, L. F. and Azmi, N. F. M. (2020) The development of a new data migration model for NoSQL databases with different schemas in environment management system. Journal of Environmental Treatment Techniques, 8 (2). pp. 787-793. ISSN 2309-1185 |
institution |
Universiti Teknologi Malaysia |
building |
UTM Library |
collection |
Institutional Repository |
continent |
Asia |
country |
Malaysia |
content_provider |
Universiti Teknologi Malaysia |
content_source |
UTM Institutional Repository |
url_provider |
http://eprints.utm.my/ |
topic |
T58.5-58.64 Information technology |
spellingShingle |
T58.5-58.64 Information technology Ji, L. F. Azmi, N. F. M. The development of a new data migration model for NoSQL databases with different schemas in environment management system |
description |
Data migration transfers data from one database to another database. The motivations of data migration are, for example, transferring data from a legacy database to a modern one and maintaining data up-to-date and consistent in a distributed system. Compared to data migration between traditional databases, data migration between heterogeneous NoSQL databases is more challenging due to the characteristics of NoSQL database such as flexible schema, different supporting features, and different storage paradigms. The differences may cause data quality problem after data migration, especially for environment management system where data are required to predict or to convey accurate information. Therefore, the migration of data between heterogeneous NoSQL databases requires not only to overcome the differences of these databases, but also to ensure the quality of the migrated data. In this paper, we proposed a data migration hub, a model that uses a record to record migration style to transfer data between different NoSQL database schemas. The proposed hub is applicable to the environment management system with data validation and fault tolerance in migration process. As confirmed by the pilot study, our method is able to migrate full set of fields to the destinated database in MongoDB. |
format |
Article |
author |
Ji, L. F. Azmi, N. F. M. |
author_facet |
Ji, L. F. Azmi, N. F. M. |
author_sort |
Ji, L. F. |
title |
The development of a new data migration model for NoSQL databases with different schemas in environment management system |
title_short |
The development of a new data migration model for NoSQL databases with different schemas in environment management system |
title_full |
The development of a new data migration model for NoSQL databases with different schemas in environment management system |
title_fullStr |
The development of a new data migration model for NoSQL databases with different schemas in environment management system |
title_full_unstemmed |
The development of a new data migration model for NoSQL databases with different schemas in environment management system |
title_sort |
development of a new data migration model for nosql databases with different schemas in environment management system |
publisher |
Dorma Journals |
publishDate |
2020 |
url |
http://eprints.utm.my/id/eprint/93055/ |
_version_ |
1717093413367578624 |
score |
13.154949 |