phpcms自带采集功能需注意

左手的ㄟ右手 2023-07-05 10:23 8阅读 0赞

参考 [http://down.chinaz.com/try/201203/1732\_1.htm][http_down.chinaz.com_try_201203_1732_1.htm]

需要注意的是

**（1）这个示例我是没采集到内容 他说是网页复杂还有可能是人家做了限制，我找的简答的**

![watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3oxMzYxNTQ4MDczNw_size_16_color_FFFFFF_t_70][]

问题网页有可能是太复杂了，找个简单的网址

![watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3oxMzYxNTQ4MDczNw_size_16_color_FFFFFF_t_70 1][]

我这里找了个简单的

![watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3oxMzYxNTQ4MDczNw_size_16_color_FFFFFF_t_70 2][]

简单的是可以出来的

![watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3oxMzYxNTQ4MDczNw_size_16_color_FFFFFF_t_70 3][]

**（2）phpcms默认发布时间是当前时间 如果你想抓过来的时间是当时的那个时间，需要自己配置**

然后我这配置了一个发布时间，它的时间默认的是当前时间戳，如果要采集发布时间是要自己配置的

![watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3oxMzYxNTQ4MDczNw_size_16_color_FFFFFF_t_70 4][]

配置好点击测试 成功采集到网址 就可查看内容![20200214095706857.png][]

![watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3oxMzYxNTQ4MDczNw_size_16_color_FFFFFF_t_70 5][]

测试成功就可以 点击【采集网址】->【采集内容】

![watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3oxMzYxNTQ4MDczNw_size_16_color_FFFFFF_t_70 6][]

![watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3oxMzYxNTQ4MDczNw_size_16_color_FFFFFF_t_70 7][]

发布内容的时候

![watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3oxMzYxNTQ4MDczNw_size_16_color_FFFFFF_t_70 8][]

选择对应的字段![watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3oxMzYxNTQ4MDczNw_size_16_color_FFFFFF_t_70 9][]

点击提交就可看到导入成功

![watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3oxMzYxNTQ4MDczNw_size_16_color_FFFFFF_t_70 10][]

涉及到的表

v9\_collection\_history 存储采集的表  如果提示![20200214151530409.png][]可以清除这个表

我的规则

eyJsYXN0ZGF0ZSI6IjE1ODE2NDcwOTAiLCJzb3VyY2VjaGFyc2V0IjoidXRmLTgiLCJzb3VyY2V0eXBlIjoiMyIsInVybHBhZ2UiOiJodHRwOlwvXC8xMjcuMC4wLjFcL2dvbmdhblwvIiwicGFnZXNpemVfc3RhcnQiOiIxIiwicGFnZXNpemVfZW5kIjoiMTAiLCJwYWdlX2Jhc2UiOiIiLCJwYXJfbnVtIjoiMSIsInVybF9jb250YWluIjoiIiwidXJsX2V4Y2VwdCI6IiIsInVybF9zdGFydCI6IjwhLS1oYXZlTmV4dFBhZ2UtLT5cdCIsInVybF9lbmQiOiI8ZGl2IGNsYXNzPVwicGFnZVwiIHN0eWxlPVwidGV4dC1hbGlnbjpjZW50ZXI7IFwiPiIsInRpdGxlX3J1bGUiOiI8c3BhbiBzdHlsZT1cImxpbmUtaGVpZ2h0OjQwcHg7XCI+PHN0cm9uZz5bXHU1MTg1XHU1YmI5XTxcL3N0cm9uZz48XC9zcGFuPiIsInRpdGxlX2h0bWxfcnVsZSI6IiIsImF1dGhvcl9ydWxlIjoiIiwiYXV0aG9yX2h0bWxfcnVsZSI6IiIsImNvbWVmb3JtX3J1bGUiOiIiLCJjb21lZm9ybV9odG1sX3J1bGUiOiIiLCJ0aW1lX3J1bGUiOiI8c3BhbiBzdHlsZT1cImxpbmUtaGVpZ2h0OjQwcHg7XCI+PHN0cm9uZz5bXHU1MTg1XHU1YmI5XTxcL3N0cm9uZz48XC9zcGFuPiIsInRpbWVfaHRtbF9ydWxlIjoiIiwiY29udGVudF9ydWxlIjoiPGhyPjxcL2Rpdj5bXHU1MTg1XHU1YmI5XTwhLS1cdTRlZTVcdTRlMGJcdTY2MmZcdTVlOTVcdTkwZThcdTUxODVcdTViYjktLT4iLCJjb250ZW50X2h0bWxfcnVsZSI6IiIsImNvbnRlbnRfcGFnZV9zdGFydCI6IiIsImNvbnRlbnRfcGFnZV9lbmQiOiIiLCJjb250ZW50X3BhZ2VfcnVsZSI6IjEiLCJjb250ZW50X3BhZ2UiOiIxIiwiY29udGVudF9uZXh0cGFnZSI6IiIsImRvd25fYXR0YWNobWVudCI6IjAiLCJ3YXRlcm1hcmsiOiIwIiwiY29sbF9vcmRlciI6IjEiLCJjdXN0b21pemVfY29uZmlnIjoie1wiMFwiOntcIm5hbWVcIjpcIlxcdTUzZDFcXHU1ZTAzXFx1NjVmNlxcdTk1ZjRcIixcImVuX25hbWVcIjpcImludGltZVwiLFwicnVsZVwiOlwiXFx1NWY1NVxcdTUxNjVcXHU2NWY2XFx1OTVmNFxcdWZmMWFbXFx1NTE4NVxcdTViYjldXFx1NWY1NVxcdTUxNjVcXHU0ZWJhXCIsXCJodG1sX3J1bGVcIjpcIjxwKFtePl0qKT4oLiopPFxcXC9wPlt8XVxcclxcbjxhKFtePl0qKT4oLiopPFxcXC9hPlt8XVxcclxcbjxzY3JpcHQoW14+XSopPiguKik8XFxcL3NjcmlwdD5bfF1cXHJcXG48aWZyYW1lKFtePl0qKT4oLiopPFxcXC9pZnJhbWU+W3xdXFxyXFxuPHRhYmxlKFtePl0qKT4oLiopPFxcXC90YWJsZT5bfF1cXHJcXG48c3BhbihbXj5dKik+KC4qKTxcXFwvc3Bhbj5bfF1cXHJcXG48YihbXj5dKik+KC4qKTxcXFwvYj5bfF1cXHJcXG48aW1nKFtePl0qKT5bfF1cXHJcXG48b2JqZWN0KFtePl0qKT4oLiopPFxcXC9vYmplY3Q+W3xdXFxyXFxuPGVtYmVkKFtePl0qKT4oLiopPFxcXC9lbWJlZD5bfF1cXHJcXG48cGFyYW0oW14+XSopPiguKik8XFxcL3BhcmFtPlt8XVxcclxcbjxkaXYoW14+XSopPlt8XVxcclxcbjxcXFwvZGl2Plt8XVxcclxcbjwhLS0oW14+XSopLS0+W3xdXFxyXFxuXCJ9fSJ9

保存成txt文件

[http_down.chinaz.com_try_201203_1732_1.htm]: http://down.chinaz.com/try/201203/1732_1.htm
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3oxMzYxNTQ4MDczNw_size_16_color_FFFFFF_t_70]: https://img-blog.csdnimg.cn/20200214094417646.png?x-oss-process=image/watermark,type_ZmFuZ3poZW5naGVpdGk,shadow_10,text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3oxMzYxNTQ4MDczNw==,size_16,color_FFFFFF,t_70
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3oxMzYxNTQ4MDczNw_size_16_color_FFFFFF_t_70 1]: https://img-blog.csdnimg.cn/20200214094344378.png?x-oss-process=image/watermark,type_ZmFuZ3poZW5naGVpdGk,shadow_10,text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3oxMzYxNTQ4MDczNw==,size_16,color_FFFFFF,t_70
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3oxMzYxNTQ4MDczNw_size_16_color_FFFFFF_t_70 2]: https://img-blog.csdnimg.cn/20200214094837943.png?x-oss-process=image/watermark,type_ZmFuZ3poZW5naGVpdGk,shadow_10,text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3oxMzYxNTQ4MDczNw==,size_16,color_FFFFFF,t_70
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3oxMzYxNTQ4MDczNw_size_16_color_FFFFFF_t_70 3]: https://img-blog.csdnimg.cn/20200214094919733.png?x-oss-process=image/watermark,type_ZmFuZ3poZW5naGVpdGk,shadow_10,text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3oxMzYxNTQ4MDczNw==,size_16,color_FFFFFF,t_70
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3oxMzYxNTQ4MDczNw_size_16_color_FFFFFF_t_70 4]: https://img-blog.csdnimg.cn/2020021409505174.png?x-oss-process=image/watermark,type_ZmFuZ3poZW5naGVpdGk,shadow_10,text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3oxMzYxNTQ4MDczNw==,size_16,color_FFFFFF,t_70
[20200214095706857.png]: https://img-blog.csdnimg.cn/20200214095706857.png
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3oxMzYxNTQ4MDczNw_size_16_color_FFFFFF_t_70 5]: https://img-blog.csdnimg.cn/20200214095636144.png?x-oss-process=image/watermark,type_ZmFuZ3poZW5naGVpdGk,shadow_10,text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3oxMzYxNTQ4MDczNw==,size_16,color_FFFFFF,t_70
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3oxMzYxNTQ4MDczNw_size_16_color_FFFFFF_t_70 6]: https://img-blog.csdnimg.cn/20200214095938115.png?x-oss-process=image/watermark,type_ZmFuZ3poZW5naGVpdGk,shadow_10,text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3oxMzYxNTQ4MDczNw==,size_16,color_FFFFFF,t_70
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3oxMzYxNTQ4MDczNw_size_16_color_FFFFFF_t_70 7]: https://img-blog.csdnimg.cn/20200214095857841.png?x-oss-process=image/watermark,type_ZmFuZ3poZW5naGVpdGk,shadow_10,text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3oxMzYxNTQ4MDczNw==,size_16,color_FFFFFF,t_70
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3oxMzYxNTQ4MDczNw_size_16_color_FFFFFF_t_70 8]: https://img-blog.csdnimg.cn/20200214100154532.png?x-oss-process=image/watermark,type_ZmFuZ3poZW5naGVpdGk,shadow_10,text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3oxMzYxNTQ4MDczNw==,size_16,color_FFFFFF,t_70
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3oxMzYxNTQ4MDczNw_size_16_color_FFFFFF_t_70 9]: https://img-blog.csdnimg.cn/20200214100245445.png?x-oss-process=image/watermark,type_ZmFuZ3poZW5naGVpdGk,shadow_10,text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3oxMzYxNTQ4MDczNw==,size_16,color_FFFFFF,t_70
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3oxMzYxNTQ4MDczNw_size_16_color_FFFFFF_t_70 10]: https://img-blog.csdnimg.cn/20200214100328683.png?x-oss-process=image/watermark,type_ZmFuZ3poZW5naGVpdGk,shadow_10,text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3oxMzYxNTQ4MDczNw==,size_16,color_FFFFFF,t_70
[20200214151530409.png]: https://img-blog.csdnimg.cn/20200214151530409.png