Authors: Noll, Stefan
Title: Resource-efficient processing of large data volumes
Language (ISO): en
Abstract: The complex system environment of data processing applications makes it very challenging to achieve high resource efficiency. In this thesis, we develop solutions that improve resource efficiency at multiple system levels by focusing on three scenarios that are relevant—but not limited—to database management systems. First, we address the challenge of understanding complex systems by analyzing memory access characteristics via efficient memory tracing. Second, we leverage information about memory access characteristics to optimize the cache usage of algorithms and to avoid cache pollution by applying hardware-based cache partitioning. Third, after optimizing resource usage within a multicore processor, we optimize resource usage across multiple computer systems by addressing the problem of resource contention for bulk loading, i.e., ingesting large volumes of data into the system. We develop a distributed bulk loading mechanism, which utilizes network bandwidth and compute power more efficiently and improves both bulk loading throughput and query processing performance.
Subject Headings: Resource efficiency
Main-memory database systems
Memory tracing
CPU cache partitioning
Bulk loading
Subject Headings (RSWK): Ressourceneffizienz
Issue Date: 2021
Appears in Collections:LS 06 Datenbanken und Informationssysteme

Files in This Item:
File Description SizeFormat 
noll_phd_thesis.pdfDNB2.33 MBAdobe PDFView/Open

This item is protected by original copyright

Items in Eldorado are protected by copyright, with all rights reserved, unless otherwise indicated.