数据集-实体&关系抽取：SCIERC语料格式解读

分手后的思念是犯贱 2023-09-25 12:18 110阅读 0赞

## 一、观察语料 ##

> \{"clusters": \[\[\[17, 20\], \[23, 23\]\]\], "sentences": \[\["English", "is", "shown", "to", "be", "trans-context-free", "on", "the", "basis", "of", "coordinations", "of", "the", "respectively", "type", "that", "involve", "strictly", "syntactic", "cross-serial", "agreement", "."\], \["The", "agreement", "in", "question", "involves", "number", "in", "nouns", "and", "reflexive", "pronouns", "and", "is", "syntactic", "rather", "than", "semantic", "in", "nature", "because", "grammatical", "number", "in", "English", ",", "like", "grammatical", "gender", "in", "languages", "such", "as", "French", ",", "is", "partly", "arbitrary", "."\], \["The", "formal", "proof", ",", "which", "makes", "crucial", "use", "of", "the", "Interchange", "Lemma", "of", "Ogden", "et", "al.", ",", "is", "so", "constructed", "as", "to", "be", "valid", "even", "if", "English", "is", "presumed", "to", "contain", "grammatical", "sentences", "in", "which", "respectively", "operates", "across", "a", "pair", "of", "coordinate", "phrases", "one", "of", "whose", "members", "has", "fewer", "conjuncts", "than", "the", "other", ";", "it", "thus", "goes", "through", "whatever", "the", "facts", "may", "be", "regarding", "constructions", "with", "unequal", "numbers", "of", "conjuncts", "in", "the", "scope", "of", "respectively", ",", "whereas", "other", "arguments", "have", "foundered", "on", "this", "problem", "."\]\], "ner": \[\[\[0, 0, "Material"\], \[10, 10, "OtherScientificTerm"\], \[17, 20, "OtherScientificTerm"\]\], \[\[23, 23, "Generic"\], \[29, 29, "OtherScientificTerm"\], \[31, 32, "OtherScientificTerm"\], \[42, 43, "OtherScientificTerm"\], \[45, 45, "Material"\], \[48, 49, "OtherScientificTerm"\], \[51, 51, "Material"\], \[54, 54, "Material"\]\], \[\[70, 71, "Method"\], \[86, 86, "Material"\]\]\], "relations": \[\[\], \[\[29, 29, 31, 32, "CONJUNCTION"\], \[48, 49, 51, 51, "FEATURE-OF"\], \[54, 54, 51, 51, "HYPONYM-OF"\]\], \[\]\], "doc\_key": "J87-1003"\}

## 二、利用下面的代码将语料打印出来    ##

import json
     
    gold_docs = [json.loads(line) for line in open('scierc_data/processed_data/json/train.json')]
    # print(gold_docs)
     
    for i in gold_docs:
        print('集群:', i['clusters'])
        print("句子:", i['sentences'])
        print("实体信息:", i['ner'])
        print("关系对:", i["relations"])
        print("文章编号：", i["doc_key"])
        all_sentences = []
        for j in i["sentences"]:
            all_sentences += j
        break

集群: [[[17, 20], [23, 23]]]
    
    
    句子: [['English', 'is', 'shown', 'to', 'be', 'trans-context-free', 'on', 'the', 'basis', 'of', 'coordinations', 'of', 'the', 'respectively', 'type', 'that', 'involve', 'strictly', 'syntactic', 'cross-serial', 'agreement', '.'], ['The', 'agreement', 'in', 'question', 'involves', 'number', 'in', 'nouns', 'and', 'reflexive', 'pronouns', 'and', 'is', 'syntactic', 'rather', 'than', 'semantic', 'in', 'nature', 'because', 'grammatical', 'number', 'in', 'English', ',', 'like', 'grammatical', 'gender', 'in', 'languages', 'such', 'as', 'French', ',', 'is', 'partly', 'arbitrary', '.'], ['The', 'formal', 'proof', ',', 'which', 'makes', 'crucial', 'use', 'of', 'the', 'Interchange', 'Lemma', 'of', 'Ogden', 'et', 'al.', ',', 'is', 'so', 'constructed', 'as', 'to', 'be', 'valid', 'even', 'if', 'English', 'is', 'presumed', 'to', 'contain', 'grammatical', 'sentences', 'in', 'which', 'respectively', 'operates', 'across', 'a', 'pair', 'of', 'coordinate', 'phrases', 'one', 'of', 'whose', 'members', 'has', 'fewer', 'conjuncts', 'than', 'the', 'other', ';', 'it', 'thus', 'goes', 'through', 'whatever', 'the', 'facts', 'may', 'be', 'regarding', 'constructions', 'with', 'unequal', 'numbers', 'of', 'conjuncts', 'in', 'the', 'scope', 'of', 'respectively', ',', 'whereas', 'other', 'arguments', 'have', 'foundered', 'on', 'this', 'problem', '.']]
    
    
    实体信息: [[[0, 0, 'Material'], [10, 10, 'OtherScientificTerm'], [17, 20, 'OtherScientificTerm']], [[23, 23, 'Generic'], [29, 29, 'OtherScientificTerm'], [31, 32, 'OtherScientificTerm'], [42, 43, 'OtherScientificTerm'], [45, 45, 'Material'], [48, 49, 'OtherScientificTerm'], [51, 51, 'Material'], [54, 54, 'Material']], [[70, 71, 'Method'], [86, 86, 'Material']]]
    
    
    关系对: [[], [[29, 29, 31, 32, 'CONJUNCTION'], [48, 49, 51, 51, 'FEATURE-OF'], [54, 54, 51, 51, 'HYPONYM-OF']], []]
    
    
    文章编号： J87-1003
    ————————————————
    版权声明：本文为CSDN博主「hithithithithit」的原创文章，遵循CC 4.0 BY-SA版权协议，转载请附上原文出处链接及本声明。
    原文链接：https://blog.csdn.net/qq_38901850/article/details/125075286

[SCIERC语料格式解读\_hithithithithit的博客-CSDN博客\_scierc数据集][SCIERC_hithithithithit_-CSDN_scierc]

[SCIERC实体识别和关系抽取的英文数据集 - 知乎][SCIERC_ -]

[Multi-Task Identification of Entities, Relations, and Coreferencefor Scientific Knowledge Graph Construction][Multi-Task Identification of Entities_ Relations_ and Coreferencefor Scientific Knowledge Graph Construction]

[SCIERC_hithithithithit_-CSDN_scierc]: https://blog.csdn.net/qq_38901850/article/details/125075286
[SCIERC_ -]: https://zhuanlan.zhihu.com/p/462638191
[Multi-Task Identification of Entities_ Relations_ and Coreferencefor Scientific Knowledge Graph Construction]: http://nlp.cs.washington.edu/sciIE/