Low-latency query compilation

dc.contributor.authorFunke, Henning
dc.contributor.authorMühlig, Jan
dc.contributor.authorTeubner, Jens
dc.date.accessioned2023-06-27T06:02:39Z
dc.date.available2023-06-27T06:02:39Z
dc.date.issued2022-05-10
dc.description.abstractQuery compilation is a processing technique that achieves very high processing speeds but has the disadvantage of introducing additional compilation latencies. These latencies cause an overhead that is relatively high for short-running and high-complexity queries. In this work, we present Flounder IR and ReSQL, our new approach to query compilation. Instead of using a general purpose intermediate representation (e.g., LLVM IR) during compilation, ReSQL uses Flounder IR, which is specifically designed for database processing. Flounder IR is lightweight and close to machine assembly. This simplifies the translation from IR to machine code, which otherwise is a costly translation step. Despite simple translation, compiled queries still benefit from the high processing speeds of the query compilation technique. We analyze the performance of our approach with micro-benchmarks and with ReSQL, which employs a full translation stack from SQL to machine code. We show reductions in compilation times up to two orders of magnitude over LLVM and show improvements in overall execution time for TPC-H queries up to 5.5 × over state-of-the-art systems.en
dc.identifier.urihttp://hdl.handle.net/2003/41845
dc.identifier.urihttp://dx.doi.org/10.17877/DE290R-23688
dc.language.isoende
dc.relation.ispartofseriesThe VLDB journal;31(6)
dc.rights.urihttps://creativecommons.org/licenses/by/4.0/de
dc.subjectQuery processingen
dc.subjectQuery compilationen
dc.subjectJust-in-time compilationen
dc.subject.ddc004
dc.subject.rswkAbfrageverarbeitungde
dc.subject.rswkJust-in-Time-Compilerde
dc.titleLow-latency query compilationen
dc.typeTextde
dc.type.publicationtypeArticlede
dcterms.accessRightsopen access
eldorado.secondarypublicationtruede
eldorado.secondarypublication.primarycitationFunke, H., Mühlig, J. & Teubner, J. Low-latency query compilation. The VLDB Journal 31, 1171–1184 (2022). https://doi.org/10.1007/s00778-022-00741-5de
eldorado.secondarypublication.primaryidentifierhttps://doi.org/10.1007/s00778-022-00741-5de

Files

Original bundle
Now showing 1 - 1 of 1
Loading...
Thumbnail Image
Name:
s00778-022-00741-5.pdf
Size:
1.03 MB
Format:
Adobe Portable Document Format
Description:
DNB
License bundle
Now showing 1 - 1 of 1
No Thumbnail Available
Name:
license.txt
Size:
4.85 KB
Format:
Item-specific license agreed upon to submission
Description: