IDSSE OpenIR
A Data Quality Control Method for Seafloor Observatories: The Application of Observed Time Series Data in the East China Sea
Zhou, Yusheng1,2; Qin, Rufu1; Xu, Huiping1,3; Sadiq, Shazia2; Yu, Yang1
2018-08-01
发表期刊SENSORS
ISSN1424-8220
卷号18期号:8
摘要With the construction and deployment of seafloor observatories around the world, massive amounts of oceanographic measurement data were gathered and transmitted to data centers. The increase in the amount of observed data not only provides support for marine scientific research but also raises the requirements for data quality control, as scientists must ensure that their research outcomes come from high-quality data. In this paper, we first analyzed and defined data quality problems occurring in the East China Sea Seafloor Observatory System (ECSSOS). We then proposed a method to detect and repair the data quality problems of seafloor observatories. Incorporating data statistics and expert knowledge from domain specialists, the proposed method consists of three parts: a general pretest to preprocess data and provide a router for further processing, data outlier detection methods to label suspect data points, and a data interpolation method to fill up missing and suspect data. The autoregressive integrated moving average (ARIMA) model was improved and applied to seafloor observatory data quality control by using a sliding window and cleaning the input modeling data. Furthermore, a quality control flag system was also proposed and applied to describe data quality control results and processing procedure information. The real observed data in ECSSOS were used to implement and test the proposed method. The results demonstrated that the proposed method performed effectively at detecting and repairing data quality problems for seafloor observatory data.
文章类型Article
关键词Seafloor Observatory Data Quality Control Arima Outlier Detection Data Interpolation
WOS标题词Science & Technology ; Physical Sciences ; Technology
DOI10.3390/s18082628
收录类别SCI
资助者Science and Technology Commission of Shanghai(15DZ1207104 ; Shanghai Oceanic Administration(Huhaike 2016-07) ; 15DZ1203100)
语种英语
关键词[WOS]SENSOR DATA ; BENEFITS ; CANADA
WOS研究方向Chemistry ; Electrochemistry ; Instruments & Instrumentation
WOS类目Chemistry, Analytical ; Electrochemistry ; Instruments & Instrumentation
WOS记录号WOS:000445712400228
出版者MDPI
引用统计
文献类型期刊论文
条目标识符http://ir.idsse.ac.cn/handle/183446/6313
专题中国科学院深海科学与工程研究所
通讯作者Qin, Rufu
作者单位1.Tongji Univ, State Key Lab Marine Geol, Shanghai 200092, Peoples R China
2.Univ Queensland, Sch Informat Technol & Elect Engn, St Lucia, Qld 4072, Australia
3.Chinese Acad Sci, Inst Deep Sea Sci & Engn, Sanya 572000, Peoples R China
推荐引用方式
GB/T 7714
Zhou, Yusheng,Qin, Rufu,Xu, Huiping,et al. A Data Quality Control Method for Seafloor Observatories: The Application of Observed Time Series Data in the East China Sea[J]. SENSORS,2018,18(8).
APA Zhou, Yusheng,Qin, Rufu,Xu, Huiping,Sadiq, Shazia,&Yu, Yang.(2018).A Data Quality Control Method for Seafloor Observatories: The Application of Observed Time Series Data in the East China Sea.SENSORS,18(8).
MLA Zhou, Yusheng,et al."A Data Quality Control Method for Seafloor Observatories: The Application of Observed Time Series Data in the East China Sea".SENSORS 18.8(2018).
条目包含的文件
条目无相关文件。
个性服务
推荐该条目
保存到收藏夹
查看访问统计
导出为Endnote文件
谷歌学术
谷歌学术中相似的文章
[Zhou, Yusheng]的文章
[Qin, Rufu]的文章
[Xu, Huiping]的文章
百度学术
百度学术中相似的文章
[Zhou, Yusheng]的文章
[Qin, Rufu]的文章
[Xu, Huiping]的文章
必应学术
必应学术中相似的文章
[Zhou, Yusheng]的文章
[Qin, Rufu]的文章
[Xu, Huiping]的文章
相关权益政策
暂无数据
收藏/分享
所有评论 (0)
暂无评论
 

除非特别说明,本系统中所有内容都受版权保护,并保留所有权利。