Beautiful Soup库的基本元素和简单应用

ゝ一纸荒年。 2022-05-25 10:42 122阅读 0赞

官网：https://www.crummy.com/software/BeautifulSoup

安装：

在cmd命令提示符中输入pip install beautifulsoup4

![70][]

使用beautifulsoup库：

>>>imoprt requests

>>>r = requests.get(https://python123.io/ws/demo.html')

>>>r.text

'<html><head><title>This is a python demo page</title></head>\\r\\n<body>\\r\\nThe demo python introduces several python courses.\\r\\nPython is a wonderful general-purpose programming language. You can learn Python from novice to professional by tracking the following courses:\\r\\n<a href="http://www.icourse163.org/course/BIT-268001" class="py1" id="link1">Basic Python</a> and <a href="http://www.icourse163.org/course/BIT-1001870001" class="py2" id="link2">Advanced Python</a>.\\r\\n</body></html>'

>>>demo = r.text

>>>from bs4 import BeautifulSoup:                \# 从bs4(就是beautifulsoup4库，可简写为bs4)加载beautifulsoup模块

>>>soup = BeautifulSoup('data','html.parser')                \#

>>>print(soup.prettify())

<html> 
    <head> 
        <title> 
            This is a python demo page 
        </title> 
    </head> 
    <body> 
        
            
                The demo python introduces several python courses. 
            
        
        
            Python is a wonderful general-purpose programming language. You can learn Python from novice to 
            professional by tracking the following courses: 
            <a href="http://www.icourse163.org/course/BIT-268001" class="py1" id="link1"> 
            Basic Python 
            </a> 
            and 
            <a href="http://www.icourse163.org/course/BIT-1001870001" class="py2" id="link2"> 
                Advanced Python 
            </a> 
            . 
        
    </body>

</html>

beautifulsoup库是解析、遍历、维护‘标签树’的功能库

标签树如下图所示：

![70 1][]

>>>from bs4 import BeautifulSoup

>>>soup = BeautifulSoup("<html>data</html>","html.parser")

>>>soup2 = BeautifulSoup(open("D://demo.html"),"html.parser")

Beautiful Soup库解析器

![70 2][]

Beautiful Soup库基本元素

![70 3][]

使用示例（以这个网址为例https://python123.io/ws/demo.html）：

网页样式如下：

![70 4][]

查看指定标签

![70 5][]

查看标签名

![70 6][]

查看标签属性

![70 7][]

查看标签内容

![70 8][]

文本分析

![70 9][]

图示：

![70 10][]

[70]: /images/20220525/90a382903cf14f0aa949a2e09b87b818.png
[70 1]: /images/20220525/328254fba4724ba3963675adfd0c899e.png
[70 2]: /images/20220525/0d981172b3ce4aa1ab039a4119efff46.png
[70 3]: /images/20220525/742607b90629479b84cb1f263d260f15.png
[70 4]: /images/20220525/33b9872212af400e95e805634d4277fa.png
[70 5]: /images/20220525/33b16d06a36940d380bea7d34b7990f2.png
[70 6]: /images/20220525/de03a2842a3a43dcb9a1cc8005a98fec.png
[70 7]: /images/20220525/b7e143a85cce4116a0e0a3f3f65c4ba2.png
[70 8]: /images/20220525/13161b87cabd44ddb657593f8e70dd90.png
[70 9]: /images/20220525/42731e4b1c73448ea3a7d9764d95d378.png
[70 10]: /images/20220525/b1d423bc97a24854a510c249f8ddca37.png