ISSN 1009-6248CN 61-1149/P Bimonthly

Supervisor:China Geological Survey

Sponsored by:XI'an Center of China Geological Survey
Geological Society of China

    • The Core Journals of China
    • The Key Magazine of China Technology
    • CSCD Included Journals
    • Scopus Included Journals
Advance Search
WEI Dongqi, JIANG Baode, ZHANG Jingya. Research on Content Storage Method of Unstructured Geological Data[J]. Northwestern Geology, 2021, 54(4): 266-273. DOI: 10.19751/j.cnki.61-1149/p.2021.04.022
Citation: WEI Dongqi, JIANG Baode, ZHANG Jingya. Research on Content Storage Method of Unstructured Geological Data[J]. Northwestern Geology, 2021, 54(4): 266-273. DOI: 10.19751/j.cnki.61-1149/p.2021.04.022

Research on Content Storage Method of Unstructured Geological Data

More Information
  • Received Date: April 14, 2021
  • Revised Date: May 23, 2021
  • Available Online: July 28, 2022
  • Published Date: December 04, 2021
  • Geological work has entered the era of big data, yet the unstructured data, such as reports and maps carrying geosciences information, are still classified in simple ways and stored in the file system, forming a lot of data set with complex internal structures. This method cannot well deliver the abundant geosciences information carried by unstructured data or the complex relationships with information, nor can it discover the knowledge deeply existing across data sets. To solve the problem, this paper proposes a multi-granularity level content tree model and a data modeling method that supports evolution. The model can split the data content at different scales and accurately locate the information and meanwhile expand the dimension of the subject's feature description according to the need of the data subject. The information contained in the data is finally discovered and the relationship with information is thus established. This paper designs a persistence method of data model with HBase as the core to achieve the purpose of processing data under the big data technology system. A modeling example shows preferable effect in content organization and information conveying, with the unstructured data of documents and maps split and reconstructed as the smallest unit of the content entity.
  • 赵鹏大.地质大数据特点及其合理开发利用[J]. 地学前缘, 2019, 26(4):1-5.
    ZHAO P D.Characteristics and Rational Utilization of Geological Big Data[J]. Earth Science Frontiers, 2019, 26(4):1-5.
    陈建平, 李靖, 谢帅, 等.中国地质大数据研究现状[J]. 地质学刊, 2017, 41(03):353-366.
    CHEN J P, LI J, XIE S, et al. China Geological Big Data Research Status[J]. Journal of Geology, 2017, 41(03):353-366.
    李超岭, 李健强, 张宏春, 等.智能地质调查大数据应用体系架构与关键技术[J]. 地质通报, 2015, 34(07):1288-1299.
    LI C L, LI J Q, ZHANG H C, et al. Big Data Application Architecture and Key Technologies of Intelligent Geological Survey[J]. Geological Bulletin of China, 2015, 34(07):1288-1299.
    王珊, 王会举, 覃雄派, 等.架构大数据:挑战、现状与展望[J]. 计算机学报, 2011, 34(10):1741-1752.
    WANG S, WANG H J, QIN X P, et al. Architecting Big Data:Challenges, Studies and Forecasts[J]. Chinese Journal of Computers, 2011, 34(10):1741-1752.
    覃雄派, 王会举, 李芙蓉, 等.数据管理技术的新格局[J]. 软件学报, 2013, 24(02):175-197.
    QIN X P, WANG H J, LI F R, et al. New Landscape of Data Management Technologies[J]. Journal of Software, 2013, 24(2):175-197
    王梅, 周娇玲, 乐嘉锦.一种列存储数据仓库中的数据复用策略[J]. 计算机学报, 2013, 36(08):1626-1635.
    WANG M, ZHOU J L, LE J J.A Data Reusing Strategy in Column-Store Data Warehouse[J]. Chinese Journal of Computers, 2013, 36(08):1626-1635.
    吴冲龙, 刘刚, 张夏林.地质科学大数据及其利用的若干问题探讨[J]. 科学通报, 2016, 61(16):1797-1807.
    WU C L, LIU G, ZHANG X L.Discussion on Geological Science Big Data and its Applications[J]. Chinese Science Bulletin, 2016, 61(16):1797-1807.
    杨鹏, 林俊晖.一种基于MongoDB和Hadoop的海量非结构化物联网数据处理方案[J]. 微电子学与计算机, 2018, 35(04):68-72+78.
    YANG P, LIN J H.A Scheme for Massive Unstructured Iot Data Processing Based on MongoDB and Hadoop[J]. Microelectronics & Computer, 2018, 35(04):68-72+78.
    谢华成, 陈向东.面向云存储的非结构化数据存取[J]. 计算机应用, 2012, 32(07):1924-1928+1942.
    XIE H C, CHEN X D.Cloud storage-oriented unstructured data storage[J]. Journal of Computer Applications, 2012, 32(07):1924-1928+1942.
    李玉坤, 孟小峰, 张相於.数据空间技术研究[J]. 软件学报, 2008(08):2018-2031.
    LI Y K, MENG X F, ZHANG X Y.Research on Dataspace[J]. Journal of Software,, 2008(08):2018-2031.
    Biham E, Chen R, Joux A, et al. Collisions in SHA-0 and Reduced SHA-1[M]. Springer Berlin Heidelberg, 2005.
    Dean J, Ghemawat S.MapReduce:Simplified data process-ing on large clusters[J]. Communications of the ACM, 2004, 51(1):137-150.
    Ashley I.Naimi, Daniel J.Westreich.Big Data:A Revolution That Will Transform How We Live, Work, and Think[J]. American Journal of Epidemiology, 2014, 179(9)Pages 1143-1144.
    Cuzzocrea A, Song I Y, Davis K C.Analytics over Large-scale Multidimensional Data:the Big Data Revolution[A]//International Workshop on Dolap[C]. ACM, 2011, 101-104.
    Franklin M, Halevy A, Maier D.From Databases to Dataspaces:A New Abstraction for Information Management[J]. Sigmod Record:Acm Sigmod (management of data), 2005, 34(4):27-33.
    Chang F, Dean J, Ghemawat S, et al. Bigtable:A Distributed Storage System for Structured Data[J]. Acm Transactions on Computer Systems, 2008, 26(2):1-26.
  • Related Articles

  • Cited by

    Periodical cited type(13)

    1. 吕振虎,张传新,陈小璐,杨刚,程福山,佟亮,陶先高. 砂砾岩尺寸及密度对压裂缝网扩展的影响. 断块油气田. 2024(02): 337-344 .
    2. 王蓓,胡艺潇,周伟,周浩,寇根,刘赛,许宁,祝鹏. 玛西斜坡百口泉组致密砂砾岩储层速敏特征及主控因素. 中国石油大学学报(自然科学版). 2024(04): 141-148 .
    3. 王波,郭强,王春伟,侯瑞卿,孙鑫,郭涛,陈伟. 基于低场核磁共振的致密储层孔隙结构特征及流体可动性研究:以敦煌盆地五墩凹陷侏罗系为例. 西北地质. 2024(05): 156-165 . 本站查看
    4. 唐勇,袁云峰,李辉,王亚飞,吕正祥,卿元华,李树博,陈洪,秦志军,王秋玉,谢知益. 准噶尔盆地阜康凹陷二叠系上乌尔禾组砂砾岩储层特征及发育模式. 石油实验地质. 2024(05): 965-978 .
    5. 吕敏,刘江斌,王茜,吴小斌,余皓天,崔宏俊,魏灿灿. 鄂尔多斯盆地延长东区块本溪组砂砾岩储层孔隙及可动流体差异赋存特征. 地质与勘探. 2023(02): 433-442 .
    6. 贾春明,潘拓,余海涛,岳喜伟,张洁,况昊,于景维. 准噶尔盆地沙湾凹陷风城组储层特征及物性控制因素分析. 西北地质. 2023(04): 49-61 . 本站查看
    7. 郭文建,姜颜良,卞保力,袁波,张学才,吴孔友,孙文洁,李天然. 准噶尔盆地南缘中段山前复杂构造变形特征及形成演化. 西北地质. 2023(04): 62-74 . 本站查看
    8. 孙灵辉,萧汉敏,谭龙,李博文,孙东盟,王鹏威. 致密砂砾岩储层孔隙结构对比及差异机制研究. 地质学报. 2022(06): 2155-2172 .
    9. 吴海光,康逊,秦明阳,连丽霞,李际,曹剑. 准噶尔盆地玛湖凹陷百口泉组砂砾岩非均质储层孔隙结构特征与成因. 中南大学学报(自然科学版). 2022(09): 3337-3353 .
    10. 魏云,沈秀伦,周伟,娄清香,蒋官澄,杨丽丽,张远凯. 准噶尔盆地砂砾岩储层压裂液损害及保护措施. 钻井液与完井液. 2022(04): 508-515 .
    11. 程宏杰,陈玉琨,宋平,李洲. 致密砂砾岩油藏CO_2驱传质规律研究. 应用化工. 2022(S1): 106-109 .
    12. 王松,邓宽海,于会永,朱建新,田刚,林元华,唐伟,郭长永. 玛湖凹陷百口泉组砾岩储层泡酸后岩石损伤及压裂泵压下降机理. 科学技术与工程. 2021(21): 8841-8850 .
    13. 施雷庭,张玉龙,叶仲斌,张景,王英伟,王睿麒,吴思彤. 玛湖砂砾岩致密油藏水平井CO_2吞吐现场试验效果分析. 油气藏评价与开发. 2021(06): 871-877+883 .

    Other cited types(4)

Catalog

    Article views (707) PDF downloads (624) Cited by(17)

    /

    DownLoad:  Full-Size Img  PowerPoint
    Return
    Return