No longer confidential

dc.contributor.authorBriesemeister, Sebastian
dc.contributor.authorRahnenführer, Jörg
dc.contributor.authorKohlbacher, Oliver
dc.date.accessioned2018-02-07T11:22:36Z
dc.date.available2018-02-07T11:22:36Z
dc.date.issued2012-11-15
dc.description.abstractQuantitative predictions in computational life sciences are often based on regression models. The advent of machine learning has led to highly accurate regression models that have gained widespread acceptance. While there are statistical methods available to estimate the global performance of regression models on a test or training dataset, it is often not clear how well this performance transfers to other datasets or how reliable an individual prediction is–a fact that often reduces a user’s trust into a computational method. In analogy to the concept of an experimental error, we sketch how estimators for individual prediction errors can be used to provide confidence intervals for individual predictions. Two novel statistical methods, named CONFINE and CONFIVE, can estimate the reliability of an individual prediction based on the local properties of nearby training data. The methods can be applied equally to linear and non-linear regression methods with very little computational overhead. We compare our confidence estimators with other existing confidence and applicability domain estimators on two biologically relevant problems (MHC–peptide binding prediction and quantitative structure-activity relationship (QSAR)). Our results suggest that the proposed confidence estimators perform comparable to or better than previously proposed estimation methods. Given a sufficient amount of training data, the estimators exhibit error estimates of high quality. In addition, we observed that the quality of estimated confidence intervals is predictable. We discuss how confidence estimation is influenced by noise, the number of features, and the dataset size. Estimating the confidence in individual prediction in terms of error intervals represents an important step from plain, non-informative predictions towards transparent and interpretable predictions that will help to improve the acceptance of computational methods in the biological community.en
dc.identifier.urihttp://hdl.handle.net/2003/36363
dc.identifier.urihttp://dx.doi.org/10.17877/DE290R-18364
dc.language.isoende
dc.relation.ispartofseriesPLoS one;7(11)
dc.rights.urihttps://creativecommons.org/licenses/by/1.0/
dc.subject.ddc310
dc.subject.rswkRegressionsmodellde
dc.subject.rswkStatistisches Verfahrende
dc.subject.rswkKonfidenzschätzungde
dc.subject.rswkComputersimulationde
dc.titleNo longer confidentialen
dc.title.alternativeestimating the confidence of individual regression predictionsen
dc.typeTextde
dc.type.publicationtypearticlede
dcterms.accessRightsopen access
eldorado.secondarypublicationtruede
eldorado.secondarypublication.primarycitationBriesemeister S, Rahnenführer J, Kohlbacher O (2012) No Longer Confidential: Estimating the Confidence of Individual Regression Predictions. PLoS ONE 7(11): e48723. https://doi.org/10.1371/journal.pone.0048723de
eldorado.secondarypublication.primaryidentifierdoi:10.1371/journal.pone.0048723de

Files

Original bundle
Now showing 1 - 1 of 1
Loading...
Thumbnail Image
Name:
NoLongerConfidential.PDF
Size:
255.27 KB
Format:
Adobe Portable Document Format
License bundle
Now showing 1 - 1 of 1
No Thumbnail Available
Name:
license.txt
Size:
4.85 KB
Format:
Item-specific license agreed upon to submission
Description: