Simple and Effective Way for Data Preprocessing Selection Based on Design of Experiments

Analytical Chemistry
Jan GerretzenLutgarde M C Buydens


The selection of optimal preprocessing is among the main bottlenecks in chemometric data analysis. Preprocessing currently is a burden, since a multitude of different preprocessing methods is available for, e.g., baseline correction, smoothing, and alignment, but it is not clear beforehand which method(s) should be used for which data set. The process of preprocessing selection is often limited to trial-and-error and is therefore considered somewhat subjective. In this paper, we present a novel, simple, and effective approach for preprocessing selection. The defining feature of this approach is a design of experiments. On the basis of the design, model performance of a few well-chosen preprocessing methods, and combinations thereof (called strategies) is evaluated. Interpretation of the main effects and interactions subsequently enables the selection of an optimal preprocessing strategy. The presented approach is applied to eight different spectroscopic data sets, covering both calibration and classification challenges. We show that the approach is able to select a preprocessing strategy which improves model performance by at least 50% compared to the raw data; in most cases, it leads to a strategy very close to the true optimu...Continue Reading


Oct 23, 2003·Analytical Chemistry·Paul H C Eilers
Jan 15, 2004·Analytical Chemistry·Paul H C Eilers
Mar 6, 2007·Journal of Chromatography. a·M DaszykowskiB Walczak
Dec 11, 2007·Journal of Pharmaceutical and Biomedical Analysis·Quansheng ChenJianhua Liu
Oct 16, 2012·Analytica Chimica Acta·Agnieszka SmolinskaSybren S Wijmenga
Jan 28, 2015·Food Chemistry·Sergey Kucheryavskiy, Carina Juel Lomborg

❮ Previous
Next ❯


Aug 24, 2016·The Analyst·Ewa SzymańskaLutgarde M C Buydens
Mar 14, 2020·Journal of Biophotonics·Pranita PradhanThomas W Bocklitz
Nov 10, 2020·Computational and Structural Biotechnology Journal·Ya-Juan LiuXi-Yong Yu
Apr 15, 2021·Biological Chemistry·Christel KampIsabelle Bekeredjian-Ding

❮ Previous
Next ❯

Related Concepts

Trending Feeds


Coronaviruses encompass a large family of viruses that cause the common cold as well as more serious diseases, such as the ongoing outbreak of coronavirus disease 2019 (COVID-19; formally known as 2019-nCoV). Coronaviruses can spread from animals to humans; symptoms include fever, cough, shortness of breath, and breathing difficulties; in more severe cases, infection can lead to death. This feed covers recent research on COVID-19.

Hereditary Sensory Autonomic Neuropathy

Hereditary Sensory Autonomic Neuropathies are a group of inherited neurodegenerative disorders characterized clinically by loss of sensation and autonomic dysfunction. Here is the latest research on these neuropathies.

Evolution of Pluripotency

Pluripotency refers to the ability of a cell to develop into three primary germ cell layers of the embryo. This feed focuses on the mechanisms that underlie the evolution of pluripotency. Here is the latest research.

Chronic Fatigue Syndrome

Chronic fatigue syndrome is a disease characterized by unexplained disabling fatigue; the pathology of which is incompletely understood. Discover the latest research on chronic fatigue syndrome here.

Nuclear Pore Complex in ALS/FTD

Alterations in nucleocytoplasmic transport, controlled by the nuclear pore complex, may be involved in the pathomechanism underlying multiple neurodegenerative diseases including Amyotrophic Lateral Sclerosis and Frontotemporal Dementia. Here is the latest research on the nuclear pore complex in ALS and FTD.

Landau-Kleffner Syndrome

Landau Kleffner syndrome (LKS), also called infantile acquired aphasia, acquired epileptic aphasia, or aphasia with convulsive disorder, is a rare childhood neurological syndrome characterized by the sudden or gradual development of aphasia (the inability to understand or express language) and an abnormal electroencephalogram. Discover the latest research on LKS here.

STING Receptor Agonists

Stimulator of IFN genes (STING) are a group of transmembrane proteins that are involved in the induction of type I interferon that is important in the innate immune response. The stimulation of STING has been an active area of research in the treatment of cancer and infectious diseases. Here is the latest research on STING receptor agonists.


Microbicides are products that can be applied to vaginal or rectal mucosal surfaces with the goal of preventing, or at least significantly reducing, the transmission of sexually transmitted infections. Here is the latest research on microbicides.

Regulation of Vocal-Motor Plasticity

Dopaminergic projections to the basal ganglia and nucleus accumbens shape the learning and plasticity of motivated behaviors across species including the regulation of vocal-motor plasticity and performance in songbirds. Discover the latest research on the regulation of vocal-motor plasticity here.

© 2021 Meta ULC. All rights reserved