通过聚合数据API获取微信精选文章

客官°小女子只卖身不卖艺 2021-10-29 19:00 202阅读 0赞

# 思路 #

1.  在聚合数据申请账号([https://www.juhe.cn/][https_www.juhe.cn])
2.  通过聚合数据api获取微信精选文章api
3.  通过`newspaper`库提取相应的文本内容，关于`newspaper`库的使用方法可以参考[这里][Link 1]

# 代码 #

# -*- coding: utf-8 -*-
    
    # !/usr/bin/env python
    
    # Time: 2019/5/9 18:57
    
    # Author: sty
    
    # File: get_data.py
    
    import json, urllib
    from urllib.parse import urlencode
    import requests
    import json
    import re
    from newspaper import Article
    
    def remove_punctuation(strs):
        """
        去除标点符号
        :param strs:
        :return:
        """
        return re.sub("[\s+\.\!\/<>“”,$%^*(+\"\']+|[+——！，。？、~@#￥%……&*（）]+", "", strs.strip())
    
    def remove_unusual_upunctuation(strs):
        """
        去除标点符号
        :param strs:
        :return:
        """
        return re.sub("[\s+\.\!\/<>“”,$%^*(+\"\']+|[+——、~@#￥%……&*（）]+", "", strs.strip())
    
    # 获取当天的详细信息
    def request():
        url = "http://v.juhe.cn/weixin/query"
        payload = {
            "pno": 1,
            "ps":50,
            "dtype":"json",
            "key":"_______"     # 这里填写自己在聚合数据申请api时，产生的key
        }
        f = requests.get(url,params=payload)
        res = json.loads(f.text)
        for detail in res["result"]["list"]:
            url = detail["url"]
            article = Article(url, language='zh')  # Chinese
            article.download()
            article.parse()
            text_res = article.text[:].strip()
            print("Title is :", detail["title"])
            text_res = text_res.replace("\n\n", "")
            print(remove_unusual_upunctuation(text_res))
    
    if __name__ == '__main__':
        request()

[https_www.juhe.cn]: https://www.juhe.cn/
[Link 1]: https://blog.csdn.net/sty945/article/details/87901407