Search papers, labs, and topics across Lattice.
This study investigates the impact of feature engineering (FE) on ocean colour machine learning models, emphasizing the importance of optimizing data inputs over traditional model tuning. An innovative optimization framework is introduced, consisting of seven sequential data transformation levels, which significantly enhances the performance of models like Multi-layer Perceptron and eXtreme Gradient Boosting Trees when estimating Chlorophyll-a concentration and Secchi disk depth using Sentinel-3 OLCI data. Results indicate that optimized FE can double the correlation coefficients and reduce mean absolute error by up to 63% compared to standard algorithms, highlighting the necessity for tailored FE strategies for different applications.
Optimizing feature engineering can double model accuracy and dramatically reduce error rates in ocean colour machine learning, but a one-size-fits-all approach won't work.
Machine learning (ML) is widely used for the development of ocean colour algorithms, but most studies focus on model parameter training and hyperparameter tuning. The optimisation of the data that feeds the models - i.e., Feature Engineering (FE) - is not fully explored. We assess the impact of FE in ocean colour machine learning models and we propose an optimisation framework that includes seven sequenced levels of data transformation: i. band choice, ii. log scaling, iii. spectral shape normalisation, iv. index extraction, v. principal component analysis, vi. feature scaling, and vii. zero-to-one scaling. We demonstrate the application for Multi-layer perceptron, Support Vector Machines, and eXtreme Gradient Boosting Trees on Sentinel-3 OLCI observations in the Norwegian coastal waters. The models are trained to estimate Chlorophyll-a concentration [Chl-a] and Secchi disk depth (Zsd). Results show that accuracy is highly variable among FE found in six studies using Sentinel-3 OLCI and the ones that we optimise. The R range from 0.01 to 0.55 for [Chl-a] and from 0.15 to 0.68 for Zsd, where the optimised FE shows the top results. The ML models with optimised FE could also improve by two times the R and reduce up to 63% of the mean absolute error when compared to CHL_OC4ME and CHL_NN standard algorithms. Nevertheless, no common optimised FE is found for all target variables and ML models, suggesting that FE optimisation is necessary for each application. Therefore, our proposed framework can be key for improving the accuracy of water quality monitoring in coastal waters.
