View: |
Part 1: Document Description
|
Citation |
|
---|---|
Title: |
An overview and implementation of extraction-transformation-loading (ETL) process in data warehouse (Case study: Department of agriculture) |
Identification Number: |
doi:10.34820/FK2/KJ9FLS |
Distributor: |
Telkom University Dataverse |
Date of Distribution: |
2023-10-05 |
Version: |
1 |
Bibliographic Citation: |
wijaya, Rahmadi Wijaya, 2023, "An overview and implementation of extraction-transformation-loading (ETL) process in data warehouse (Case study: Department of agriculture)", https://doi.org/10.34820/FK2/KJ9FLS, Telkom University Dataverse, V1 |
Citation |
|
Title: |
An overview and implementation of extraction-transformation-loading (ETL) process in data warehouse (Case study: Department of agriculture) |
Identification Number: |
doi:10.34820/FK2/KJ9FLS |
Authoring Entity: |
wijaya, Rahmadi Wijaya (Fakultas Ilmu Terapan) |
Distributor: |
Telkom University Dataverse |
Access Authority: |
wijaya, Rahmadi Wijaya |
Depositor: |
wijaya, Rahmadi Wijaya |
Date of Deposit: |
2022-04-02 |
Study Scope |
|
Keywords: |
Agricultural Sciences |
Abstract: |
Extraction-transformation-loading (ETL) process in data warehouse development perform data extraction from various resources, transform the data into suitable format and loadit into data warehouse storage. In the ETL process, there is data cleansing process function that handles redundancy, inconsistency and integrity data. ETL process will move data from the source to the integration layer (data store in data warehouse). In the integration layer, the data can be grouped into smaller scope and more specific for the requirement in other repositories called data marts. Reporting program of data warehouse will be associated with a data mart as its data source. In this research, the data warehouse is built to handle the ETL process. The data warehouse build metadata to support the process. The metadata construction for ETL processes will lead to ETL programs with high degree of reusability. The conclusion from this research is the use of dynamic ETL process (using metadata ETL) is required when ETL process is dealing with the operational system that still unstable and likely to change the database schema. Dynamic ETL process is also needed to address the increase requirement for report from the users. |
Methodology and Processing |
|
Sources Statement |
|
Data Access |
|
Notes: |
CC0 Waiver |
Other Study Description Materials |