TY - GEN
T1 - Ensemble kriging for environmental spatial processes
AU - Yagli, Gokhan Mert
AU - Tay, Joel Wei En
AU - Yang, Dazhi
N1 - Publisher Copyright:
© 2019 IEEE.
PY - 2019/12
Y1 - 2019/12
N2 - Remote-sensed and reanalysis databases are valuable sources of environmental data that support a wide range of engineering applications. However, the sizes of such databases are often measured in terabytes (TB). Whereas these datasets with high spatial resolution are usually stored on the servers of national laboratories, the large data volume can be inconvenient for individuals who wish to work with the data. To that end, it is important to investigate how much redundant information the dataset contains, e.g., are the time series from two adjacent pixels statistically different? We use kriging, a spatial interpolation technique, to quantify such redundancy. More specifically, if the kriged environmental processes are sufficiently accurate, one can circumvent the need to work with the original high-spatial-resolution data, and use only a dimension-reduced version of the data. The empirical part of the paper considers the National Solar Radiation Data Base (NSRDB), which provides half-hourly, gridded, satellite-derived solar irradiance data, with a spatial resolution of 4 km by 4 km, spanning 1998-2017, with a total size over 40 TB. NSRDB is a valuable dataset for solar resource assessment applications. The beam normal irradiance (BNI) process is reconstructed using data on various dimension-reduced lattices. The trade-off between spatial resolution and data accuracy is studied.
AB - Remote-sensed and reanalysis databases are valuable sources of environmental data that support a wide range of engineering applications. However, the sizes of such databases are often measured in terabytes (TB). Whereas these datasets with high spatial resolution are usually stored on the servers of national laboratories, the large data volume can be inconvenient for individuals who wish to work with the data. To that end, it is important to investigate how much redundant information the dataset contains, e.g., are the time series from two adjacent pixels statistically different? We use kriging, a spatial interpolation technique, to quantify such redundancy. More specifically, if the kriged environmental processes are sufficiently accurate, one can circumvent the need to work with the original high-spatial-resolution data, and use only a dimension-reduced version of the data. The empirical part of the paper considers the National Solar Radiation Data Base (NSRDB), which provides half-hourly, gridded, satellite-derived solar irradiance data, with a spatial resolution of 4 km by 4 km, spanning 1998-2017, with a total size over 40 TB. NSRDB is a valuable dataset for solar resource assessment applications. The beam normal irradiance (BNI) process is reconstructed using data on various dimension-reduced lattices. The trade-off between spatial resolution and data accuracy is studied.
KW - Ensemble
KW - Kriging
KW - Solar irradiance
KW - Solar resources
KW - Spatio-temporal process
UR - https://www.scopus.com/pages/publications/85081408825
U2 - 10.1109/BigData47090.2019.9005731
DO - 10.1109/BigData47090.2019.9005731
M3 - 会议稿件
AN - SCOPUS:85081408825
T3 - Proceedings - 2019 IEEE International Conference on Big Data, Big Data 2019
SP - 3947
EP - 3950
BT - Proceedings - 2019 IEEE International Conference on Big Data, Big Data 2019
A2 - Baru, Chaitanya
A2 - Huan, Jun
A2 - Khan, Latifur
A2 - Hu, Xiaohua Tony
A2 - Ak, Ronay
A2 - Tian, Yuanyuan
A2 - Barga, Roger
A2 - Zaniolo, Carlo
A2 - Lee, Kisung
A2 - Ye, Yanfang Fanny
PB - Institute of Electrical and Electronics Engineers Inc.
T2 - 2019 IEEE International Conference on Big Data, Big Data 2019
Y2 - 9 December 2019 through 12 December 2019
ER -