15ac4ca9-3be0-119e-e063-0937940a8990 English nonGeographicDataset non geographic dataset British Geological Survey +44 115 936 3100 Environmental Science Centre,Keyworth NOTTINGHAM NOTTINGHAMSHIRE NG12 5GG United Kingdom enquiries@bgs.ac.uk pointOfContact 2026-05-26 UK GEMINI 2.3 http://data.bgs.ac.uk/id/dataHolding/13608217 Labelled data for fine tuning a geological Named Entity Recognition and Entity Relation Extraction model 2024-02-15 creation http://data.bgs.ac.uk/id/dataHolding/13608217 This dataset consists of sentences extracted from BGS memoirs, DECC/OGA onshore hydrocarbons well reports and Mineral Reconnaissance Programme (MRP) reports. The sentences have been annotated to enable the dataset to be used as labelled training data for a Named Entity Recognition model and Entity Relation Extraction model, both of which are Natural Language Processing (NLP) techniques that assist with extracting structured data from unstructured text. The entities of interest are rock formations, geological ages, rock types, physical properties and locations, with inter-relations such as overlies, observedIn. The entity labels for rock formations and geological ages in the BGS memoirs were an extract from earlier published work https://github.com/BritishGeologicalSurvey/geo-ner-model https://zenodo.org/records/4181488 . The data can be used to fine tune a pre-trained large language model using transfer learning, to create a model that can be used in inference mode to automatically create the labels, thereby creating structured data useful for geological modelling and subsurface characterisation. The data is provided in JSONL(Relation) format which is the export format from doccano open source text annotation software (https://doccano.github.io/doccano/) used to create the labels. The source documents are already publicly available, but the MRP and DECC reports are only published in pdf image form. These latter documents had to undergo OCR and resulted in lower quality text and a lower quality training data. The majority of the labelled data is from the higher quality BGS memoirs text. The dataset is a proof of concept. Minimal peer review of the labelling has been conducted so this should not be treated as a gold standard labelled dataset, and it is of insufficient volume to build a performant model. The development of this training data and the text processing scripts were supported by a grant from UK Government Office for Technology Transfer (GOTT) Knowledge Asset Grant Fund Project 10083604 Enquiries British Geological Survey 0115 936 3143 0115 936 3276 Environmental Science Centre, Nicker Hill, Keyworth NOTTINGHAM NOTTINGHAMSHIRE NG12 5GG United Kingdom enquiries@bgs.ac.uk distributor Enquiries British Geological Survey 0115 936 3143 0115 936 3276 Environmental Science Centre, Nicker Hill, Keyworth NOTTINGHAM NOTTINGHAMSHIRE NG12 5GG United Kingdom enquiries@bgs.ac.uk originator Enquiries British Geological Survey 0115 936 3143 0115 936 3276 Environmental Science Centre, Nicker Hill, Keyworth NOTTINGHAM NOTTINGHAMSHIRE NG12 5GG United Kingdom enquiries@bgs.ac.uk pointOfContact Enquiries British Geological Survey 0115 936 3143 0115 936 3276 Environmental Science Centre, Nicker Hill, Keyworth NOTTINGHAM NOTTINGHAMSHIRE NG12 5GG United Kingdom enquiries@bgs.ac.uk principalInvestigator notPlanned https://resources.bgs.ac.uk/images/geonetworkThumbs/15ac4ca9-3be0-119e-e063-0937940a8990.png Geology GEMET - INSPIRE themes, version 1.0 2008-06-01 publication Physical properties Mathematical programming Stratigraphic unit BGS Thesaurus of Geosciences 2022 revision data.gov.uk (non-INSPIRE) NGDC Deposited Data Citable Data dataCentre NERC_DDC otherRestrictions licenceOGL Available under the Open Government Licence subject to the following acknowledgement accompanying the reproduced NERC materials "Contains NERC materials ©NERC [year]" otherRestrictions The copyright of materials derived from the British Geological Survey's work is vested in the Natural Environment Research Council [NERC]. No part of this work may be reproduced or transmitted in any form or by any means, or stored in a retrieval system of any nature, without the prior permission of the copyright holder, via the BGS Intellectual Property Rights Manager. Use by customers of information provided by the BGS, is at the customer's own risk. In view of the disparate sources of information at BGS's disposal, including such material donated to BGS, that BGS accepts in good faith as being accurate, the Natural Environment Research Council (NERC) gives no warranty, expressed or implied, as to the quality or accuracy of the information supplied, or to the information's suitability for any use. NERC/BGS accepts no liability whatever in respect of loss, damage, injury or other occurence however caused. Available under the Open Government Licence subject to the following acknowledgement accompanying the reproduced NERC materials "Contains NERC materials ©NERC [year]" English geoscientificInformation 2023-11-01 2024-02-15 jsonlines doccano JSONL(Relation) jsonlines PURE relations Enquiries British Geological Survey 0115 936 3143 0115 936 3276 Environmental Science Centre, Nicker Hill, Keyworth NOTTINGHAM NOTTINGHAMSHIRE NG12 5GG United Kingdom enquiries@bgs.ac.uk distributor https://github.com/BritishGeologicalSurvey/princeton-nlp-relation-extraction WWW:DOWNLOAD-1.0-http--download GitHub - princeton-nlp-relation-extraction [NAACL 2021] A Frustratingly Easy Approach for Entity and Relation Extraction https://arxiv.org/abs/2010.12812 download https://webapps.bgs.ac.uk/services/ngdc/accessions/index.html#item186633 WWW:DOWNLOAD-1.0-http--download Data download https://doi.org/10.5285/afba2d1d-8a5d-4b96-a6fa-c13b5d8d32cd WWW:LINK-1.0-http--related Citation Information - Digital Object Identifier (DOI) Heaven, R., Atkinson, P., Joseph, T. (2024). Labelled data for fine tuning a geological Named Entity Recognition and Entity Relation Extraction model. NERC EDS National Geoscience Data Centre. (Dataset). https://doi.org/10.5285/afba2d1d-8a5d-4b96-a6fa-c13b5d8d32cd information nonGeographicDataset non geographic dataset INSPIRE Implementing rules laying down technical arrangements for the interoperability and harmonisation of Geology 2011 publication See the referenced specification false Commission Regulation (EU) No 1089/2010 of 23 November 2010 implementing Directive 2007/2/EC of the European Parliament and of the Council as regards interoperability of spatial data sets and services 2010-12-08 publication See http://eur-lex.europa.eu/LexUriServ/LexUriServ.do?uri=OJ:L:2010:323:0011:0102:EN:PDF false Data was sourced from 3 corpus already available under open licences. BGS memoirs/technical reports sentences were sourced from previous labelled data at https://github.com/BritishGeologicalSurvey/geo-ner-model/blob/main/bgs.3class.geo-all-data.txt. This was converted to a new data format and additional labels were manually added to a subset of the data using doccano open source text annotation software. A small sample of sentences were taken from selected DECC/OGA onshore hydrocarbons well reports http://data.bgs.ac.uk/id/dataHolding/13607542 and from selected Mineral Reconnaisance Programme reports http://data.bgs.ac.uk/id/dataHolding/13605457 These reports were processed by 1. converting to machine readable text, 2. splitting into pages and sentences/paragraphs, 3. converting to doccano import JSONlines format, 5. manually annotating to label a range of geological concepts, 6. manually labelling to add relation labels to indicate how those concepts relate to each other, 7. exporting in doccano JSONL(Relations) format and also converting to format required by https://github.com/princeton-nlp/PURE