MODES: model-based optimization on distributed embedded systems

Simple item page
dc.contributor.authorShi, Junjie
dc.contributor.authorBian, Jiang
dc.contributor.authorRichter, Jakob
dc.contributor.authorChen, Kuan-Hsun
dc.contributor.authorRahnenführer, Jörg
dc.contributor.authorXiong, Haoyi
dc.contributor.authorChen, Jian-Jia
dc.date.accessioned2022-04-26T13:20:17Z
dc.date.available2022-04-26T13:20:17Z
dc.date.issued2021-06-04
dc.description.abstractThe predictive performance of a machine learning model highly depends on the corresponding hyper-parameter setting. Hence, hyper-parameter tuning is often indispensable. Normally such tuning requires the dedicated machine learning model to be trained and evaluated on centralized data to obtain a performance estimate. However, in a distributed machine learning scenario, it is not always possible to collect all the data from all nodes due to privacy concerns or storage limitations. Moreover, if data has to be transferred through low bandwidth connections it reduces the time available for tuning. Model-Based Optimization (MBO) is one state-of-the-art method for tuning hyper-parameters but the application on distributed machine learning models or federated learning lacks research. This work proposes a framework MODES that allows to deploy MBO on resource-constrained distributed embedded systems. Each node trains an individual model based on its local data. The goal is to optimize the combined prediction accuracy. The presented framework offers two optimization modes: (1) MODES-B considers the whole ensemble as a single black box and optimizes the hyper-parameters of each individual model jointly, and (2) MODES-I considers all models as clones of the same black box which allows it to efficiently parallelize the optimization in a distributed setting. We evaluate MODES by conducting experiments on the optimization for the hyper-parameters of a random forest and a multi-layer perceptron. The experimental results demonstrate that, with an improvement in terms of mean accuracy (MODES-B), run-time efficiency (MODES-I), and statistical stability for both modes, MODES outperforms the baseline, i.e., carry out tuning with MBO on each node individually with its local sub-data set.en
dc.identifier.urihttp://hdl.handle.net/2003/40880
dc.identifier.urihttp://dx.doi.org/10.17877/DE290R-22737
dc.language.isoende
dc.relation.ispartofseriesMachine learning;Vol. 110. 2021, issue 6, pp 1527-1547
dc.rights.urihttp://creativecommons.org/licenses/by/4.0/
dc.subject.ddc004
dc.titleMODES: model-based optimization on distributed embedded systemsen
dc.typeTextde
dc.type.publicationtypearticlede
dcterms.accessRightsopen access
eldorado.secondarypublicationtruede
eldorado.secondarypublication.primarycitationMachine learning. Vol. 110, 2021, issue 6, pp 1427-1547en
eldorado.secondarypublication.primaryidentifierhttps://doi.org/10.1007/s10994-021-06014-6de

Files

Original bundle
Now showing 1 - 1 of 1
Thumbnail Image
Name:
Shi2021_Article_MODESModel-basedOptimizationOn.pdf
Size:
1.49 MB
Format:
Adobe Portable Document Format
Description:
Download
License bundle
Now showing 1 - 1 of 1
No Thumbnail Available
Name:
license.txt
Size:
4.85 KB
Format:
Item-specific license agreed upon to submission
Description:
Download

Collections

Entwurfsautomatisierung für Eingebettete Systeme