Authors:
Felix Lobert | Thünen Institute of Farm Economics | Germany
Michael Schlund | University of Twente
Dr. Marcel Schwieder | Thünen Institute of Farm Economics
Dr. Alexander Gocht | Thünen Institute of Farm Economics
Prof. Dr. Patrick Hostert | Humboldt-Universität zu Berlin
Dr. Stefan Erasmi | Thünen Institute of Farm Economics
Seasonal crop phenology allows understanding a crop’s metabolic cycle, its reactions to environmental influences, and its buildup of biomass, among others. Crop phenology is hence a valuable input for numerous agricultural monitoring tasks, including the assessment of climate impacts, management practices, and yield estimation. As area-wide and field-based collection of related data is not feasible, it is of great interest for the EO research community to leverage the potential of remote sensing data for deriving phenological information on cultivated crops.
Studies so far usually had reference data available for limited regions. This is sufficient for the validation of phenology estimations on fine scales. However, this leads to an insufficient error assessment when area-wide estimations are made. Thus, approaches developed for broad-scale applications often lack precise validation by using reference data or prediction units beyond the plot level (e.g, Meroni et al., 2021). Methods for estimating phenology for large areas while providing reliable plot level information are therefore needed.
We address this need by exploiting a comprehensive data set on phenological observations across Germany provided by the German Weather Service (DWD) that we match to winter wheat plots identified from the German-wide 10 m crop type map by Blickensdörfer et al. (2021). This allows to relate time series from Sentinel-1, 2, and Landsat 8 data to field observations for 700 to 800 locations for every year since 2017. We complement our remote sensing data by meteorological data provided by the DWD.
From the remote sensing imagery, we summarize the pixel values for each plot and calculate time series of the Normalized Difference Vegetation Index (NDVI), γ0 backscatter coefficient (VH & VV), and backscatter cross-ratio. We derive daily precipitation sums from DWD precipitation radar (RADOLAN) and temperature and global radiation measurements by spatially interpolating observations from DWD weather stations. To suppress noise in the remote sensing time series, we use locally weighted scatterplot smoothing (loess) and ensure a common temporal interval of the different data sources by linear interpolation. We feed the resulting time series into a one-dimensional convolutional neural network (CNN), that is trained to deliver the entry dates of four different phenological stages for winter wheat, namely stem elongation, heading, ripening, and harvest.
Preliminary results show that the chosen method is suitable for deriving phenological metrics from the combined optical, radar and meteorological time series. The time-consuming tuning of the model architecture and the selection of the most suitable input time series, however, are still pending prior to an in-depth validation. Further tests will be performed to investigate the suitability of the approach in comparison to established methods to identify strengths and limitations.
The presented approach is new to the field of crop phenology analysis in two respects: first, the use of machine learning and, in particular, deep learning to derive crop phenology has only laterally been explored, and second, the chosen model architecture allows the direct combination of optical, radar and meteorological data instead of establishing separate rule-sets and combining them ex-post. After finalizing the model, area-wide predictions will allow to analyze spatial patterns and trends of phenology in the agricultural landscapes across Germany.
References
Blickensdörfer, L., Schwieder, M., Pflugmacher, D., Nendel, C., Erasmi, S., Hostert, P., 2021. National-scale crop type maps for Germany from combined time series of Sentinel-1, Sentinel-2 and Landsat 8 data (2017, 2018 and 2019). https://doi.org/10.5281/ZENODO.5153047
Meroni, M., d’Andrimont, R., Vrieling, A., Fasbender, D., Lemoine, G., Rembold, F., Seguini, L., Verhegghen, A., 2021. Comparing land surface phenology of major European crops as derived from SAR and multispectral data of Sentinel-1 and -2. Remote Sens. Environ. 253. https://doi.org/10.1016/j.rse.2020.112232