python爬取单词构造自己的词典

小咪咪 2022-02-17 02:09 279阅读 0赞

make\_dictionary.py

import urllib.request
    from lxml import etree
    import re
    
    url = "http://cn.bing.com/dict/search?q="
    meaning_xpath = "/html/body/div[1]/div/div/div[1]/div[1]/ul/li"
    
    
    def get_word_meaning(word):
        html = urllib.request.urlopen(url + word).read()
        selector = etree.HTML(html.decode('utf-8'))
    
        meaning = ""
        for item in selector.xpath(meaning_xpath):
            it = item.xpath('span')
            meaning += "####{}$${}".format(it[0].text, it[1].xpath('span')[0].text)
        return word + meaning
    
    
    fw = open("dictionary.txt", 'w')
    
    with open("words.txt") as fr:
        for line in fr.readlines():
            word_list = re.split(r'[;,. -]', line.strip())
            for word in word_list:
                if word:
                    result = get_word_meaning(word)
                    fw.write(result + "\n")
                    print(result)
    
    fw.close()

words.txt

hello bug, you.   dhsj dsj   dsdh
    good
    abcdhghh
    puts
    goods
    your
    yours

dictionary.txt

hello####int.$$你好；喂；您好；哈喽####网络$$哈罗；哈啰；大家好
    bug####n.$$缺陷；虫子；窃听器；小昆虫####v.$$在（某处）装窃听器；窃听（谈话）；使烦恼；使恼怒####网络$$臭虫；错误；漏洞
    dhsj####网络$$瀛樻煡
    dsj####网络$$邓顺杰；虹吸式雨量计；东安县
    dsdh####网络$$马兰花；躲；初开
    good####adv.$$好####n.$$好处；好人；益处；善行####adj.$$有好处；好的；优质的；符合标准的####网络$$良好；很好；佳
    abcdhghh####
    puts####
    goods####n.$$商品；货品；动产；私人财产####网络$$货物；物品；产品
    your####adv.$$你的；您的；你们的；（泛指）大家的####pron.$$你(们)的；大家都很知道的####网络$$称别人的事物；物主代词
    yours####pron.$$你的；您的；你们的；用于书信结尾的签名前####adj.$$你(们)的(东西)；信末署名前用语####网络$$你的就是我的；你的东西；你的朋友