An overview and implementation of extraction-transformation-loading (ETL) process in data warehouse (Case study: Department of agriculture) (doi:10.34820/FK2/KJ9FLS)

View:

Part 1: Document Description
Part 2: Study Description
Entire Codebook

Document Description

Citation

Title:

An overview and implementation of extraction-transformation-loading (ETL) process in data warehouse (Case study: Department of agriculture)

Identification Number:

doi:10.34820/FK2/KJ9FLS

Distributor:

Telkom University Dataverse

Date of Distribution:

2023-10-05

Version:

1

Bibliographic Citation:

wijaya, Rahmadi Wijaya, 2023, "An overview and implementation of extraction-transformation-loading (ETL) process in data warehouse (Case study: Department of agriculture)", https://doi.org/10.34820/FK2/KJ9FLS, Telkom University Dataverse, V1

Study Description

Citation

Title:

An overview and implementation of extraction-transformation-loading (ETL) process in data warehouse (Case study: Department of agriculture)

Identification Number:

doi:10.34820/FK2/KJ9FLS

Authoring Entity:

wijaya, Rahmadi Wijaya (Fakultas Ilmu Terapan)

Distributor:

Telkom University Dataverse

Access Authority:

wijaya, Rahmadi Wijaya

Depositor:

wijaya, Rahmadi Wijaya

Date of Deposit:

2022-04-02

Study Scope

Keywords:

Agricultural Sciences

Abstract:

Extraction-transformation-loading (ETL) process in data warehouse development perform data extraction from various resources, transform the data into suitable format and loadit into data warehouse storage. In the ETL process, there is data cleansing process function that handles redundancy, inconsistency and integrity data. ETL process will move data from the source to the integration layer (data store in data warehouse). In the integration layer, the data can be grouped into smaller scope and more specific for the requirement in other repositories called data marts. Reporting program of data warehouse will be associated with a data mart as its data source. In this research, the data warehouse is built to handle the ETL process. The data warehouse build metadata to support the process. The metadata construction for ETL processes will lead to ETL programs with high degree of reusability. The conclusion from this research is the use of dynamic ETL process (using metadata ETL) is required when ETL process is dealing with the operational system that still unstable and likely to change the database schema. Dynamic ETL process is also needed to address the increase requirement for report from the users.

Methodology and Processing

Sources Statement

Data Access

Notes:

CC0 Waiver

Other Study Description Materials