Main Architectures Used in ETL as a Tool, Necessary for the Integration of Data in Large Volumes - a Task in the Field of Digital Preservation of Cultural Heritage
Main Architectures Used in ETL as a Tool, Necessary for the Integration of Data in Large Volumes - a Task in the Field of Digital Preservation of Cultural Heritage
Author(s): Kamen AngelovSubject(s): Museology & Heritage Studies, Library and Information Science, Information Architecture, Electronic information storage and retrieval, ICT Information and Communications Technologies
Published by: Институт по математика и информатика - Българска академия на науките
Keywords: Cultural Heritage; Digitization; Data Integration; Optimization; Performance; ETL; Multiple Queries; Data Warehouse; Data Flow; Data Set; Quantum; Computational; Approach; Simulation; Uncertain; Predi
Summary/Abstract: The digital recording of Cultural Heritage (CH) and its metadata relates to the concept for data warehousing systems and their lifecycle. It uses models and development tools of ETL packages. The tasks used to extract metadata from raw digitized CH data often include hard computing problems, including NP-complete problems. This paper describes the current state of digital preservation of Cultural Heritage with an accent on data integration and performance optimization of processes. We show our vision for further solutions for automated optimization of resource utilization in ETL jobs cutting development cost. In parallel, we describe our experiment that uses quantum computation (in simulation mode) to solve hard combinatorial problems as multiple query optimization.
Journal: Digital Presentation and Preservation of Cultural and Scientific Heritage
- Issue Year: 2016
- Issue No: VI
- Page Range: 129-136
- Page Count: 8
- Language: English