08.存储Cinder→5场景学习→12.Ceph Volume Provider→4.Attach Volume

你的名字 2021-11-09 02:22 159阅读 0赞

# [返回总目录][Link 1] #

背景：

![paste-109311212650499.jpg][]

![paste-123961346097155.jpg][]

![paste-109624745263107.jpg][]

![paste-123944166227971.jpg][]

<table style="font-size:1em;border-collapse:collapse;"> 
 <thead> 
 <tr> 
 <th align="left" style="border-bottom:2px solid #00B3FF;">描述</th> 
 <th align="left" style="border-bottom:2px solid #00B3FF;">详细</th> 
 </tr> 
 </thead> 
 <tbody> 
 <tr> 
 <td style="border-bottom:1px solid #B0B0B0;"> 
 <ol> 
 <li>将ceph volume type的volume attach到instance c1上。</li> 
 </ol></td> 
 <td style="border-bottom:1px solid #B0B0B0;"><img src="http://zhaolei.xuexihaike.com/paste-113163798315011.jpg" alt="paste-113163798315011.jpg"></td> 
 </tr> 
 <tr> 
 <td style="border-bottom:1px solid #B0B0B0;"> 
 <ol> 
 <li>我们重点关注nova-compute 如何将vol-1 attach 到c1。查看cinder-volume日志： 
 <ol> 
 <li>cinder-volume查看monitor的映射信息，初始化volume的连接，查看要连接的volume信息</li> 
 </ol></li> 
 </ol></td> 
 <td style="border-bottom:1px solid #B0B0B0;"> 
 <div> 
 <table> 
 <tbody> 
 <tr> 
 <td> 
 <div> 
 <pre style="line-height:16px;">1 
2 
3 
4 
5</pre> 
 </div></td> 
 <td> 
 <div> 
 <pre style="line-height:16px;">Jun <span style="border-top-width:1px;border-right-width:1px;border-bottom-width:1px;border-left-width:1px;border-top-style:solid;border-right-style:solid;border-bottom-style:solid;border-left-style:solid;border-top-color:rgb(255,0,0);border-right-color:rgb(255,0,0);border-bottom-color:rgb(255,0,0);border-left-color:rgb(255,0,0);">27 <span style="border-top-width:1px;border-right-width:1px;border-bottom-width:1px;border-left-width:1px;border-top-style:solid;border-right-style:solid;border-bottom-style:solid;border-left-style:solid;border-top-color:rgb(255,0,0);border-right-color:rgb(255,0,0);border-bottom-color:rgb(255,0,0);border-left-color:rgb(255,0,0);">15:<span style="border-top-width:1px;border-right-width:1px;border-bottom-width:1px;border-left-width:1px;border-top-style:solid;border-right-style:solid;border-bottom-style:solid;border-left-style:solid;border-top-color:rgb(255,0,0);border-right-color:rgb(255,0,0);border-bottom-color:rgb(255,0,0);border-left-color:rgb(255,0,0);">34:<span style="border-top-width:1px;border-right-width:1px;border-bottom-width:1px;border-left-width:1px;border-top-style:solid;border-right-style:solid;border-bottom-style:solid;border-left-style:solid;border-top-color:rgb(255,0,0);border-right-color:rgb(255,0,0);border-bottom-color:rgb(255,0,0);border-left-color:rgb(255,0,0);">08 controller cinder<span style="border-top-width:1px;border-right-width:1px;border-bottom-width:1px;border-left-width:1px;border-top-style:solid;border-right-style:solid;border-bottom-style:solid;border-left-style:solid;border-top-color:rgb(255,0,0);border-right-color:rgb(255,0,0);border-bottom-color:rgb(255,0,0);border-left-color:rgb(255,0,0);">-volume[9796]: DEBUG oslo_concurrency.processutils 
[req-c9184b0e-2cb3-4549-bb6b-cf0482f682bf req-27aba675-b7ad-4ca0-bc5e-2678211ebe8c admin None] Running cmd (subprocess): 
{
 {(pid=9947) execute /usr/local/lib/python2.7/dist-packages/oslo_concurrency/processutils.py:372 </pre> 
 </div></td> 
 </tr> 
 </tbody> 
 </table> 
 </div> 
 <div> 
 <table> 
 <tbody> 
 <tr> 
 <td> 
 <div> 
 <pre style="line-height:16px;">1 
2 
3 
4 
5</pre> 
 </div></td> 
 <td> 
 <div> 
 <pre style="line-height:16px;">Jun <span style="border-top-width:1px;border-right-width:1px;border-bottom-width:1px;border-left-width:1px;border-top-style:solid;border-right-style:solid;border-bottom-style:solid;border-left-style:solid;border-top-color:rgb(255,0,0);border-right-color:rgb(255,0,0);border-bottom-color:rgb(255,0,0);border-left-color:rgb(255,0,0);">27 <span style="border-top-width:1px;border-right-width:1px;border-bottom-width:1px;border-left-width:1px;border-top-style:solid;border-right-style:solid;border-bottom-style:solid;border-left-style:solid;border-top-color:rgb(255,0,0);border-right-color:rgb(255,0,0);border-bottom-color:rgb(255,0,0);border-left-color:rgb(255,0,0);">15:<span style="border-top-width:1px;border-right-width:1px;border-bottom-width:1px;border-left-width:1px;border-top-style:solid;border-right-style:solid;border-bottom-style:solid;border-left-style:solid;border-top-color:rgb(255,0,0);border-right-color:rgb(255,0,0);border-bottom-color:rgb(255,0,0);border-left-color:rgb(255,0,0);">34:<span style="border-top-width:1px;border-right-width:1px;border-bottom-width:1px;border-left-width:1px;border-top-style:solid;border-right-style:solid;border-bottom-style:solid;border-left-style:solid;border-top-color:rgb(255,0,0);border-right-color:rgb(255,0,0);border-bottom-color:rgb(255,0,0);border-left-color:rgb(255,0,0);">08 controller cinder<span style="border-top-width:1px;border-right-width:1px;border-bottom-width:1px;border-left-width:1px;border-top-style:solid;border-right-style:solid;border-bottom-style:solid;border-left-style:solid;border-top-color:rgb(255,0,0);border-right-color:rgb(255,0,0);border-bottom-color:rgb(255,0,0);border-left-color:rgb(255,0,0);">-volume[9796]: DEBUG oslo_concurrency.processutils 
[req-c9184b0e-2cb3-4549-bb6b-cf0482f682bf req-27aba675-b7ad-4ca0-bc5e-2678211ebe8c admin None] CMD "" returned: <span style="border-top-width:1px;border-right-width:1px;border-bottom-width:1px;border-left-width:1px;border-top-style:solid;border-right-style:solid;border-bottom-style:solid;border-left-style:solid;border-top-color:rgb(255,0,0);border-right-color:rgb(255,0,0);border-bottom-color:rgb(255,0,0);border-left-color:rgb(255,0,0);">0 in <span style="border-top-width:1px;border-right-width:1px;border-bottom-width:1px;border-left-width:1px;border-top-style:solid;border-right-style:solid;border-bottom-style:solid;border-left-style:solid;border-top-color:rgb(255,0,0);border-right-color:rgb(255,0,0);border-bottom-color:rgb(255,0,0);border-left-color:rgb(255,0,0);">0.<span style="border-top-width:1px;border-right-width:1px;border-bottom-width:1px;border-left-width:1px;border-top-style:solid;border-right-style:solid;border-bottom-style:solid;border-left-style:solid;border-top-color:rgb(255,0,0);border-right-color:rgb(255,0,0);border-bottom-color:rgb(255,0,0);border-left-color:rgb(255,0,0);">340s 
{
 {(pid=9947) execute /usr/local/lib/python2.7/dist-packages/oslo_concurrency/processutils.py:409</pre> 
 </div></td> 
 </tr> 
 </tbody> 
 </table> 
 <table> 
 <tbody> 
 <tr> 
 <td> 
 <div> 
 <pre style="line-height:16px;">1 
2 
3 
4 
5 
6 
7 
8</pre> 
 </div></td> 
 <td> 
 <div> 
 <pre style="line-height:16px;">Jun <span style="border-top-width:1px;border-right-width:1px;border-bottom-width:1px;border-left-width:1px;border-top-style:solid;border-right-style:solid;border-bottom-style:solid;border-left-style:solid;border-top-color:rgb(255,0,0);border-right-color:rgb(255,0,0);border-bottom-color:rgb(255,0,0);border-left-color:rgb(255,0,0);">27 <span style="border-top-width:1px;border-right-width:1px;border-bottom-width:1px;border-left-width:1px;border-top-style:solid;border-right-style:solid;border-bottom-style:solid;border-left-style:solid;border-top-color:rgb(255,0,0);border-right-color:rgb(255,0,0);border-bottom-color:rgb(255,0,0);border-left-color:rgb(255,0,0);">15:<span style="border-top-width:1px;border-right-width:1px;border-bottom-width:1px;border-left-width:1px;border-top-style:solid;border-right-style:solid;border-bottom-style:solid;border-left-style:solid;border-top-color:rgb(255,0,0);border-right-color:rgb(255,0,0);border-bottom-color:rgb(255,0,0);border-left-color:rgb(255,0,0);">34:<span style="border-top-width:1px;border-right-width:1px;border-bottom-width:1px;border-left-width:1px;border-top-style:solid;border-right-style:solid;border-bottom-style:solid;border-left-style:solid;border-top-color:rgb(255,0,0);border-right-color:rgb(255,0,0);border-bottom-color:rgb(255,0,0);border-left-color:rgb(255,0,0);">08 controller cinder<span style="border-top-width:1px;border-right-width:1px;border-bottom-width:1px;border-left-width:1px;border-top-style:solid;border-right-style:solid;border-bottom-style:solid;border-left-style:solid;border-top-color:rgb(255,0,0);border-right-color:rgb(255,0,0);border-bottom-color:rgb(255,0,0);border-left-color:rgb(255,0,0);">-volume[9796]: DEBUG cinder.volume.drivers. 
[req-c9184b0e-2cb3-4549-bb6b-cf0482f682bf req-27aba675-b7ad-4ca0-bc5e-2678211ebe8c admin None] : {, 'data': {'secret_uuid': 'df0d0b60-047a-45f5-b5be-f7d2b4beadee', 
'volume_id': u'823dfaa9-a41c-4df7-a165-30db20b5b1c7', 'auth_username': 'cinder', 'secret_type': 'ceph', 
'name': u'', 'discard': True, 'keyring': None, 
'cluster_name': 'ceph', 'hosts': [u'172.16.1.17'], 'auth_enabled': True, 'ports': [u'6789'] 
{
 {(pid=9947) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1252</pre> 
 </div></td> 
 </tr> 
 </tbody> 
 </table> 
 <table> 
 <tbody> 
 <tr> 
 <td> 
 <div> 
 <pre style="line-height:16px;">1 
2 
3 
4</pre> 
 </div></td> 
 <td> 
 <div> 
 <pre style="line-height:16px;">Jun <span style="border-top-width:1px;border-right-width:1px;border-bottom-width:1px;border-left-width:1px;border-top-style:solid;border-right-style:solid;border-bottom-style:solid;border-left-style:solid;border-top-color:rgb(255,0,0);border-right-color:rgb(255,0,0);border-bottom-color:rgb(255,0,0);border-left-color:rgb(255,0,0);">27 <span style="border-top-width:1px;border-right-width:1px;border-bottom-width:1px;border-left-width:1px;border-top-style:solid;border-right-style:solid;border-bottom-style:solid;border-left-style:solid;border-top-color:rgb(255,0,0);border-right-color:rgb(255,0,0);border-bottom-color:rgb(255,0,0);border-left-color:rgb(255,0,0);">15:<span style="border-top-width:1px;border-right-width:1px;border-bottom-width:1px;border-left-width:1px;border-top-style:solid;border-right-style:solid;border-bottom-style:solid;border-left-style:solid;border-top-color:rgb(255,0,0);border-right-color:rgb(255,0,0);border-bottom-color:rgb(255,0,0);border-left-color:rgb(255,0,0);">34:<span style="border-top-width:1px;border-right-width:1px;border-bottom-width:1px;border-left-width:1px;border-top-style:solid;border-right-style:solid;border-bottom-style:solid;border-left-style:solid;border-top-color:rgb(255,0,0);border-right-color:rgb(255,0,0);border-bottom-color:rgb(255,0,0);border-left-color:rgb(255,0,0);">09 controller cinder<span style="border-top-width:1px;border-right-width:1px;border-bottom-width:1px;border-left-width:1px;border-top-style:solid;border-right-style:solid;border-bottom-style:solid;border-left-style:solid;border-top-color:rgb(255,0,0);border-right-color:rgb(255,0,0);border-bottom-color:rgb(255,0,0);border-left-color:rgb(255,0,0);">-volume[9796]: INFO cinder.volume.manager 
[req-c9184b0e-2cb3-4549-bb6b-cf0482f682bf req-27aba675-b7ad-4ca0-bc5e-2678211ebe8c admin None] </pre> 
 </div></td> 
 </tr> 
 </tbody> 
 </table> 
 连接信息更新完毕 
 </div></td> 
 </tr> 
 <tr> 
 <td style="border-bottom:1px solid #B0B0B0;"> 
 <ol> 
 <li>查看nova-compute日志： 
 <ol> 
 <li>通过curl请求获得volume。REQ是request,RESP是response。</li> 
 </ol></li> 
 </ol></td> 
 <td style="border-bottom:1px solid #B0B0B0;"> 
 <div> 
 <table> 
 <tbody> 
 <tr> 
 <td> 
 <div> 
 <pre style="line-height:16px;">1 
2 
3 
4 
5</pre> 
 </div></td> 
 <td> 
 <div> 
 <pre style="line-height:16px;">Jun <span style="border-top-width:1px;border-right-width:1px;border-bottom-width:1px;border-left-width:1px;border-top-style:solid;border-right-style:solid;border-bottom-style:solid;border-left-style:solid;border-top-color:rgb(255,0,0);border-right-color:rgb(255,0,0);border-bottom-color:rgb(255,0,0);border-left-color:rgb(255,0,0);">27 <span style="border-top-width:1px;border-right-width:1px;border-bottom-width:1px;border-left-width:1px;border-top-style:solid;border-right-style:solid;border-bottom-style:solid;border-left-style:solid;border-top-color:rgb(255,0,0);border-right-color:rgb(255,0,0);border-bottom-color:rgb(255,0,0);border-left-color:rgb(255,0,0);">15:<span style="border-top-width:1px;border-right-width:1px;border-bottom-width:1px;border-left-width:1px;border-top-style:solid;border-right-style:solid;border-bottom-style:solid;border-left-style:solid;border-top-color:rgb(255,0,0);border-right-color:rgb(255,0,0);border-bottom-color:rgb(255,0,0);border-left-color:rgb(255,0,0);">34:<span style="border-top-width:1px;border-right-width:1px;border-bottom-width:1px;border-left-width:1px;border-top-style:solid;border-right-style:solid;border-bottom-style:solid;border-left-style:solid;border-top-color:rgb(255,0,0);border-right-color:rgb(255,0,0);border-bottom-color:rgb(255,0,0);border-left-color:rgb(255,0,0);">06 controller nova<span style="border-top-width:1px;border-right-width:1px;border-bottom-width:1px;border-left-width:1px;border-top-style:solid;border-right-style:solid;border-bottom-style:solid;border-left-style:solid;border-top-color:rgb(255,0,0);border-right-color:rgb(255,0,0);border-bottom-color:rgb(255,0,0);border-left-color:rgb(255,0,0);">-compute[7060]: INFO nova.compute.manager 
[None req-c9184b0e-2cb3-4549-bb6b-cf0482f682bf admin admin] 
[instance: f092dfe4-365b-4dd6-8867-76a311399782] </pre> 
 </div></td> 
 </tr> 
 </tbody> 
 </table> 
 </div> 
 <div> 
 <table> 
 <tbody> 
 <tr> 
 <td> 
 <div> 
 <pre style="line-height:16px;">1 
2 
3 
4 
5 
6 
7 
8 
9</pre> 
 </div></td> 
 <td> 
 <div> 
 <pre style="line-height:16px;">Jun <span style="border-top-width:1px;border-right-width:1px;border-bottom-width:1px;border-left-width:1px;border-top-style:solid;border-right-style:solid;border-bottom-style:solid;border-left-style:solid;border-top-color:rgb(255,0,0);border-right-color:rgb(255,0,0);border-bottom-color:rgb(255,0,0);border-left-color:rgb(255,0,0);">27 <span style="border-top-width:1px;border-right-width:1px;border-bottom-width:1px;border-left-width:1px;border-top-style:solid;border-right-style:solid;border-bottom-style:solid;border-left-style:solid;border-top-color:rgb(255,0,0);border-right-color:rgb(255,0,0);border-bottom-color:rgb(255,0,0);border-left-color:rgb(255,0,0);">15:<span style="border-top-width:1px;border-right-width:1px;border-bottom-width:1px;border-left-width:1px;border-top-style:solid;border-right-style:solid;border-bottom-style:solid;border-left-style:solid;border-top-color:rgb(255,0,0);border-right-color:rgb(255,0,0);border-bottom-color:rgb(255,0,0);border-left-color:rgb(255,0,0);">34:<span style="border-top-width:1px;border-right-width:1px;border-bottom-width:1px;border-left-width:1px;border-top-style:solid;border-right-style:solid;border-bottom-style:solid;border-left-style:solid;border-top-color:rgb(255,0,0);border-right-color:rgb(255,0,0);border-bottom-color:rgb(255,0,0);border-left-color:rgb(255,0,0);">06 controller nova<span style="border-top-width:1px;border-right-width:1px;border-bottom-width:1px;border-left-width:1px;border-top-style:solid;border-right-style:solid;border-bottom-style:solid;border-left-style:solid;border-top-color:rgb(255,0,0);border-right-color:rgb(255,0,0);border-bottom-color:rgb(255,0,0);border-left-color:rgb(255,0,0);">-compute[7060]: DEBUG cinderclient.v3.client 
[None req-c9184b0e-2cb3-4549-bb6b-cf0482f682bf admin admin] : <span style="border-top-width:1px;border-right-width:1px;border-bottom-width:1px;border-left-width:1px;border-top-style:solid;border-right-style:solid;border-bottom-style:solid;border-left-style:solid;border-top-color:rgb(255,0,0);border-right-color:rgb(255,0,0);border-bottom-color:rgb(255,0,0);border-left-color:rgb(255,0,0);">-g <span style="border-top-width:1px;border-right-width:1px;border-bottom-width:1px;border-left-width:1px;border-top-style:solid;border-right-style:solid;border-bottom-style:solid;border-left-style:solid;border-top-color:rgb(255,0,0);border-right-color:rgb(255,0,0);border-bottom-color:rgb(255,0,0);border-left-color:rgb(255,0,0);">-i <span style="border-top-width:1px;border-right-width:1px;border-bottom-width:1px;border-left-width:1px;border-top-style:solid;border-right-style:solid;border-bottom-style:solid;border-left-style:solid;border-top-color:rgb(255,0,0);border-right-color:rgb(255,0,0);border-bottom-color:rgb(255,0,0);border-left-color:rgb(255,0,0);">-X <span style="border-top-width:1px;border-right-width:1px;border-bottom-width:1px;border-left-width:1px;border-top-style:solid;border-right-style:solid;border-bottom-style:solid;border-left-style:solid;border-top-color:rgb(255,0,0);border-right-color:rgb(255,0,0);border-bottom-color:rgb(255,0,0);border-left-color:rgb(255,0,0);">-H "OpenStack-API-Version: volume 3.48" <span style="border-top-width:1px;border-right-width:1px;border-bottom-width:1px;border-left-width:1px;border-top-style:solid;border-right-style:solid;border-bottom-style:solid;border-left-style:solid;border-top-color:rgb(255,0,0);border-right-color:rgb(255,0,0);border-bottom-color:rgb(255,0,0);border-left-color:rgb(255,0,0);">-H "User-Agent: python-cinderclient" <span style="border-top-width:1px;border-right-width:1px;border-bottom-width:1px;border-left-width:1px;border-top-style:solid;border-right-style:solid;border-bottom-style:solid;border-left-style:solid;border-top-color:rgb(255,0,0);border-right-color:rgb(255,0,0);border-bottom-color:rgb(255,0,0);border-left-color:rgb(255,0,0);">-H "X-OpenStack-Request-ID: req-c9184b0e-2cb3-4549-bb6b-cf0482f682bf" <span style="border-top-width:1px;border-right-width:1px;border-bottom-width:1px;border-left-width:1px;border-top-style:solid;border-right-style:solid;border-bottom-style:solid;border-left-style:solid;border-top-color:rgb(255,0,0);border-right-color:rgb(255,0,0);border-bottom-color:rgb(255,0,0);border-left-color:rgb(255,0,0);">-H "Accept: application/json" <span style="border-top-width:1px;border-right-width:1px;border-bottom-width:1px;border-left-width:1px;border-top-style:solid;border-right-style:solid;border-bottom-style:solid;border-left-style:solid;border-top-color:rgb(255,0,0);border-right-color:rgb(255,0,0);border-bottom-color:rgb(255,0,0);border-left-color:rgb(255,0,0);">-H "X-Auth-Token: {SHA1}7b8f6c716bfad9dcabf83a44913184ec49384e88" 
{
 {(pid=7060) _http_log_request /usr/local/lib/python2.7/dist-packages/keystoneauth1/session.py:372 </pre> 
 </div></td> 
 </tr> 
 </tbody> 
 </table> 
 -g：--globoff &nbsp; &nbsp; &nbsp; Disable URL sequences and ranges using {} and [] 
 </div> 
 <div> 
 -i：--include &nbsp; &nbsp; &nbsp; Include protocol headers in the output 
 </div> 
 <div> 
 -X：--request COMMAND &nbsp;Specify request command to use 
 </div> 
 <div> 
 -H：--header LINE &nbsp; Pass custom header LINE to server 
 <div> 
 <table> 
 <tbody> 
 <tr> 
 <td> 
 <div> 
 <pre style="line-height:16px;"> 1 
2 
3 
4 
5 
6 
7 
8 
9 
10 
11 
12 
13</pre> 
 </div></td> 
 <td> 
 <div> 
 <pre style="line-height:16px;">Jun <span style="border-top-width:1px;border-right-width:1px;border-bottom-width:1px;border-left-width:1px;border-top-style:solid;border-right-style:solid;border-bottom-style:solid;border-left-style:solid;border-top-color:rgb(255,0,0);border-right-color:rgb(255,0,0);border-bottom-color:rgb(255,0,0);border-left-color:rgb(255,0,0);">27 <span style="border-top-width:1px;border-right-width:1px;border-bottom-width:1px;border-left-width:1px;border-top-style:solid;border-right-style:solid;border-bottom-style:solid;border-left-style:solid;border-top-color:rgb(255,0,0);border-right-color:rgb(255,0,0);border-bottom-color:rgb(255,0,0);border-left-color:rgb(255,0,0);">15:<span style="border-top-width:1px;border-right-width:1px;border-bottom-width:1px;border-left-width:1px;border-top-style:solid;border-right-style:solid;border-bottom-style:solid;border-left-style:solid;border-top-color:rgb(255,0,0);border-right-color:rgb(255,0,0);border-bottom-color:rgb(255,0,0);border-left-color:rgb(255,0,0);">34:<span style="border-top-width:1px;border-right-width:1px;border-bottom-width:1px;border-left-width:1px;border-top-style:solid;border-right-style:solid;border-bottom-style:solid;border-left-style:solid;border-top-color:rgb(255,0,0);border-right-color:rgb(255,0,0);border-bottom-color:rgb(255,0,0);border-left-color:rgb(255,0,0);">06 controller nova<span style="border-top-width:1px;border-right-width:1px;border-bottom-width:1px;border-left-width:1px;border-top-style:solid;border-right-style:solid;border-bottom-style:solid;border-left-style:solid;border-top-color:rgb(255,0,0);border-right-color:rgb(255,0,0);border-bottom-color:rgb(255,0,0);border-left-color:rgb(255,0,0);">-compute[7060]: : {: {"migration_status": null, "provider_id": null, "attachments": [], 
"links": [{"href": "", "rel": "self"}, {"href": "http://172.16.1.17/ 
volume/c1e57b427f934cadbe32750b1b8ccfd8/volumes/823dfaa9-a41c-4df7-a165-30db20b5b1c7", "rel": "bookmark"}] 
, "availability_zone": "nova", "os-vol-host-attr:host": "controller@ceph#ceph", "encrypted": false, "updated_at": 
"2019-06-27T07:34:06.000000", "replication_status": null, "snapshot_id": null, "id": 
"823dfaa9-a41c-4df7-a165-30db20b5b1c7", "size": 1, "user_id": "7a2243af10174653931f76c748209551", 
"os-vol-tenant-attr:tenant_id": "c1e57b427f934cadbe32750b1b8ccfd8", "os-vol-mig-status-attr:migstat": null, 
"metadata": {}, "status": "reserved", "description": "", , 
"service_uuid": "a01f1424-3912-4b36-88e0-7fd8e1d5310a", "source_volid": null, "consistencygroup_id": null, 
"os-vol-mig-status-attr:name_id": null, "name": "vol-1", "bootable": "false", 
"created_at": "2019-06-27T07:31:09.000000", "volume_type": "ceph", "group_id": null, "shared_targets": false </pre> 
 </div></td> 
 </tr> 
 </tbody> 
 </table> 
 </div> 
 </div></td> 
 </tr> 
 <tr> 
 <td style="border-bottom:1px solid #B0B0B0;"> 
 <blockquote style="border:none;"> 
 <ol> 
 <li>通过curl请求建立attachment。REQ是request,RESP是response。</li> 
 </ol> 
 </blockquote></td> 
 <td style="border-bottom:1px solid #B0B0B0;"> 
 <div> 
 <table> 
 <tbody> 
 <tr> 
 <td> 
 <div> 
 <pre style="line-height:16px;"> 1 
2 
3 
4 
5 
6 
7 
8 
9 
10 
11 
12</pre> 
 </div></td> 
 <td> 
 <div> 
 <pre style="line-height:16px;">Jun <span style="border-top-width:1px;border-right-width:1px;border-bottom-width:1px;border-left-width:1px;border-top-style:solid;border-right-style:solid;border-bottom-style:solid;border-left-style:solid;border-top-color:rgb(255,0,0);border-right-color:rgb(255,0,0);border-bottom-color:rgb(255,0,0);border-left-color:rgb(255,0,0);">27 <span style="border-top-width:1px;border-right-width:1px;border-bottom-width:1px;border-left-width:1px;border-top-style:solid;border-right-style:solid;border-bottom-style:solid;border-left-style:solid;border-top-color:rgb(255,0,0);border-right-color:rgb(255,0,0);border-bottom-color:rgb(255,0,0);border-left-color:rgb(255,0,0);">15:<span style="border-top-width:1px;border-right-width:1px;border-bottom-width:1px;border-left-width:1px;border-top-style:solid;border-right-style:solid;border-bottom-style:solid;border-left-style:solid;border-top-color:rgb(255,0,0);border-right-color:rgb(255,0,0);border-bottom-color:rgb(255,0,0);border-left-color:rgb(255,0,0);">34:<span style="border-top-width:1px;border-right-width:1px;border-bottom-width:1px;border-left-width:1px;border-top-style:solid;border-right-style:solid;border-bottom-style:solid;border-left-style:solid;border-top-color:rgb(255,0,0);border-right-color:rgb(255,0,0);border-bottom-color:rgb(255,0,0);border-left-color:rgb(255,0,0);">08 controller nova<span style="border-top-width:1px;border-right-width:1px;border-bottom-width:1px;border-left-width:1px;border-top-style:solid;border-right-style:solid;border-bottom-style:solid;border-left-style:solid;border-top-color:rgb(255,0,0);border-right-color:rgb(255,0,0);border-bottom-color:rgb(255,0,0);border-left-color:rgb(255,0,0);">-compute[7060]: DEBUG cinderclient.v3.client 
[None req-c9184b0e-2cb3-4549-bb6b-cf0482f682bf admin admin] : curl <span style="border-top-width:1px;border-right-width:1px;border-bottom-width:1px;border-left-width:1px;border-top-style:solid;border-right-style:solid;border-bottom-style:solid;border-left-style:solid;border-top-color:rgb(255,0,0);border-right-color:rgb(255,0,0);border-bottom-color:rgb(255,0,0);border-left-color:rgb(255,0,0);">-g <span style="border-top-width:1px;border-right-width:1px;border-bottom-width:1px;border-left-width:1px;border-top-style:solid;border-right-style:solid;border-bottom-style:solid;border-left-style:solid;border-top-color:rgb(255,0,0);border-right-color:rgb(255,0,0);border-bottom-color:rgb(255,0,0);border-left-color:rgb(255,0,0);">-i <span style="border-top-width:1px;border-right-width:1px;border-bottom-width:1px;border-left-width:1px;border-top-style:solid;border-right-style:solid;border-bottom-style:solid;border-left-style:solid;border-top-color:rgb(255,0,0);border-right-color:rgb(255,0,0);border-bottom-color:rgb(255,0,0);border-left-color:rgb(255,0,0);">-X <span style="border-top-width:1px;border-right-width:1px;border-bottom-width:1px;border-left-width:1px;border-top-style:solid;border-right-style:solid;border-bottom-style:solid;border-left-style:solid;border-top-color:rgb(255,0,0);border-right-color:rgb(255,0,0);border-bottom-color:rgb(255,0,0);border-left-color:rgb(255,0,0);">-H "Accept: application/json" <span style="border-top-width:1px;border-right-width:1px;border-bottom-width:1px;border-left-width:1px;border-top-style:solid;border-right-style:solid;border-bottom-style:solid;border-left-style:solid;border-top-color:rgb(255,0,0);border-right-color:rgb(255,0,0);border-bottom-color:rgb(255,0,0);border-left-color:rgb(255,0,0);">-H "User-Agent: python-cinderclient" <span style="border-top-width:1px;border-right-width:1px;border-bottom-width:1px;border-left-width:1px;border-top-style:solid;border-right-style:solid;border-bottom-style:solid;border-left-style:solid;border-top-color:rgb(255,0,0);border-right-color:rgb(255,0,0);border-bottom-color:rgb(255,0,0);border-left-color:rgb(255,0,0);">-H "OpenStack-API-Version: volume 3.44" <span style="border-top-width:1px;border-right-width:1px;border-bottom-width:1px;border-left-width:1px;border-top-style:solid;border-right-style:solid;border-bottom-style:solid;border-left-style:solid;border-top-color:rgb(255,0,0);border-right-color:rgb(255,0,0);border-bottom-color:rgb(255,0,0);border-left-color:rgb(255,0,0);">-H "X-Auth-Token: {SHA1}7b8f6c716bfad9dcabf83a44913184ec49384e88" <span style="border-top-width:1px;border-right-width:1px;border-bottom-width:1px;border-left-width:1px;border-top-style:solid;border-right-style:solid;border-bottom-style:solid;border-left-style:solid;border-top-color:rgb(255,0,0);border-right-color:rgb(255,0,0);border-bottom-color:rgb(255,0,0);border-left-color:rgb(255,0,0);">-H "Content-Type: application/json" <span style="border-top-width:1px;border-right-width:1px;border-bottom-width:1px;border-left-width:1px;border-top-style:solid;border-right-style:solid;border-bottom-style:solid;border-left-style:solid;border-top-color:rgb(255,0,0);border-right-color:rgb(255,0,0);border-bottom-color:rgb(255,0,0);border-left-color:rgb(255,0,0);">-H "X-OpenStack-Request-ID: req-c9184b0e-2cb3-4549-bb6b-cf0482f682bf" <span style="border-top-width:1px;border-right-width:1px;border-bottom-width:1px;border-left-width:1px;border-top-style:solid;border-right-style:solid;border-bottom-style:solid;border-left-style:solid;border-top-color:rgb(255,0,0);border-right-color:rgb(255,0,0);border-bottom-color:rgb(255,0,0);border-left-color:rgb(255,0,0);">-d '{"attachment": {"connector": {"initiator": "iqn.1993-08.org.debian:01:f3f9353d3735", "ip": "172.16.1.17", "platform": "x86_64", "host": "controller", "do_local_attach": false, "mountpoint": "/dev/vdb", "os_type": "linux2", "multipath": false}' 
{
 {(pid=7060) _http_log_request /usr/local/lib/python2.7/dist-packages/keystoneauth1/session.py:372 </pre> 
 </div></td> 
 </tr> 
 </tbody> 
 </table> 
 </div> 
 <table> 
 <tbody> 
 <tr> 
 <td> 
 <div> 
 <pre style="line-height:16px;">1 
2 
3 
4 
5 
6 
7 
8 
9</pre> 
 </div></td> 
 <td> 
 <div> 
 <pre style="line-height:16px;">Jun <span style="border-top-width:1px;border-right-width:1px;border-bottom-width:1px;border-left-width:1px;border-top-style:solid;border-right-style:solid;border-bottom-style:solid;border-left-style:solid;border-top-color:rgb(255,0,0);border-right-color:rgb(255,0,0);border-bottom-color:rgb(255,0,0);border-left-color:rgb(255,0,0);">27 <span style="border-top-width:1px;border-right-width:1px;border-bottom-width:1px;border-left-width:1px;border-top-style:solid;border-right-style:solid;border-bottom-style:solid;border-left-style:solid;border-top-color:rgb(255,0,0);border-right-color:rgb(255,0,0);border-bottom-color:rgb(255,0,0);border-left-color:rgb(255,0,0);">15:<span style="border-top-width:1px;border-right-width:1px;border-bottom-width:1px;border-left-width:1px;border-top-style:solid;border-right-style:solid;border-bottom-style:solid;border-left-style:solid;border-top-color:rgb(255,0,0);border-right-color:rgb(255,0,0);border-bottom-color:rgb(255,0,0);border-left-color:rgb(255,0,0);">34:<span style="border-top-width:1px;border-right-width:1px;border-bottom-width:1px;border-left-width:1px;border-top-style:solid;border-right-style:solid;border-bottom-style:solid;border-left-style:solid;border-top-color:rgb(255,0,0);border-right-color:rgb(255,0,0);border-bottom-color:rgb(255,0,0);border-left-color:rgb(255,0,0);">09 controller nova<span style="border-top-width:1px;border-right-width:1px;border-bottom-width:1px;border-left-width:1px;border-top-style:solid;border-right-style:solid;border-bottom-style:solid;border-left-style:solid;border-top-color:rgb(255,0,0);border-right-color:rgb(255,0,0);border-bottom-color:rgb(255,0,0);border-left-color:rgb(255,0,0);">-compute[7060]: : {: {"status": "reserved", "detached_at": "", "connection_info": 
{"attachment_id": , "encrypted": false, "driver_volume_type": 
"rbd", "secret_uuid": "df0d0b60-047a-45f5-b5be-f7d2b4beadee", "qos_specs": null, 
"volume_id": "823dfaa9-a41c-4df7-a165-30db20b5b1c7", "auth_username": "cinder", "secret_type": "ceph", 
"name": "volumes/volume-823dfaa9-a41c-4df7-a165-30db20b5b1c7", "discard": true, "keyring": null, 
"cluster_name": "ceph", "auth_enabled": true, "hosts": ["172.16.1.17"], "access_mode": "rw", 
"ports": ["6789"]}, "attached_at": "", "attach_mode": null, "instance": "f092dfe4-365b-4dd6-8867-76a311399782", 
"volume_id": "823dfaa9-a41c-4df7-a165-30db20b5b1c7", "id": "b030252b-a04d-4cc7-b682-b3a38c1e8937"</pre> 
 </div></td> 
 </tr> 
 </tbody> 
 </table></td> 
 </tr> 
 <tr> 
 <td style="border-bottom:1px solid #B0B0B0;"> 
 <blockquote style="border:none;"> 
 <ol> 
 <li>更新 instance 的 XML 配置文件，将 volume 文件映射给 instance。 
 <ol> 
 <li>新增的磁盘格式为network，因为在volumes存储池中可以查到对应对象文件</li> 
 <li>启动盘对应的也是network，因为在vms存储池可以查到对应的镜像对象文件</li> 
 <li>对象文件包含三部分：标识符，二进制数据，名字/值</li> 
 </ol></li> 
 </ol> 
 </blockquote></td> 
 <td style="border-bottom:1px solid #B0B0B0;"> 
 <table> 
 <tbody> 
 <tr> 
 <td> 
 <div> 
 <pre style="line-height:16px;"> 1 
2 
3 
4 
5 
6 
7 
8 
9 
10 
11 
12 
13 
14 
15</pre> 
 </div></td> 
 <td> 
 <div> 
 <pre style="line-height:16px;">Jun <span style="border-top-width:1px;border-right-width:1px;border-bottom-width:1px;border-left-width:1px;border-top-style:solid;border-right-style:solid;border-bottom-style:solid;border-left-style:solid;border-top-color:rgb(255,0,0);border-right-color:rgb(255,0,0);border-bottom-color:rgb(255,0,0);border-left-color:rgb(255,0,0);">27 <span style="border-top-width:1px;border-right-width:1px;border-bottom-width:1px;border-left-width:1px;border-top-style:solid;border-right-style:solid;border-bottom-style:solid;border-left-style:solid;border-top-color:rgb(255,0,0);border-right-color:rgb(255,0,0);border-bottom-color:rgb(255,0,0);border-left-color:rgb(255,0,0);">15:<span style="border-top-width:1px;border-right-width:1px;border-bottom-width:1px;border-left-width:1px;border-top-style:solid;border-right-style:solid;border-bottom-style:solid;border-left-style:solid;border-top-color:rgb(255,0,0);border-right-color:rgb(255,0,0);border-bottom-color:rgb(255,0,0);border-left-color:rgb(255,0,0);">34:<span style="border-top-width:1px;border-right-width:1px;border-bottom-width:1px;border-left-width:1px;border-top-style:solid;border-right-style:solid;border-bottom-style:solid;border-left-style:solid;border-top-color:rgb(255,0,0);border-right-color:rgb(255,0,0);border-bottom-color:rgb(255,0,0);border-left-color:rgb(255,0,0);">09 controller nova<span style="border-top-width:1px;border-right-width:1px;border-bottom-width:1px;border-left-width:1px;border-top-style:solid;border-right-style:solid;border-bottom-style:solid;border-left-style:solid;border-top-color:rgb(255,0,0);border-right-color:rgb(255,0,0);border-bottom-color:rgb(255,0,0);border-left-color:rgb(255,0,0);">-compute[7060]: DEBUG nova.virt.libvirt.guest 
[None req-c9184b0e-2cb3-4549-bb6b-cf0482f682bf admin admin] : <span style="border-top-width:1px;border-right-width:1px;border-bottom-width:1px;border-left-width:1px;border-top-style:solid;border-right-style:solid;border-bottom-style:solid;border-left-style:solid;border-top-color:rgb(255,0,0);border-right-color:rgb(255,0,0);border-bottom-color:rgb(255,0,0);border-left-color:rgb(255,0,0);">&lt;disk type="" device="disk"<span style="border-top-width:1px;border-right-width:1px;border-bottom-width:1px;border-left-width:1px;border-top-style:solid;border-right-style:solid;border-bottom-style:solid;border-left-style:solid;border-top-color:rgb(255,0,0);border-right-color:rgb(255,0,0);border-bottom-color:rgb(255,0,0);border-left-color:rgb(255,0,0);">&gt; <span style="border-top-width:1px;border-right-width:1px;border-bottom-width:1px;border-left-width:1px;border-top-style:solid;border-right-style:solid;border-bottom-style:solid;border-left-style:solid;border-top-color:rgb(255,0,0);border-right-color:rgb(255,0,0);border-bottom-color:rgb(255,0,0);border-left-color:rgb(255,0,0);">&lt;driver name="qemu" type="raw" cache="writeback" discard="unmap"<span style="border-top-width:1px;border-right-width:1px;border-bottom-width:1px;border-left-width:1px;border-top-style:solid;border-right-style:solid;border-bottom-style:solid;border-left-style:solid;border-top-color:rgb(255,0,0);border-right-color:rgb(255,0,0);border-bottom-color:rgb(255,0,0);border-left-color:rgb(255,0,0);">/&gt; <span style="border-top-width:1px;border-right-width:1px;border-bottom-width:1px;border-left-width:1px;border-top-style:solid;border-right-style:solid;border-bottom-style:solid;border-left-style:solid;border-top-color:rgb(255,0,0);border-right-color:rgb(255,0,0);border-bottom-color:rgb(255,0,0);border-left-color:rgb(255,0,0);">&lt;source <span style="border-top-width:1px;border-right-width:1px;border-bottom-width:1px;border-left-width:1px;border-top-style:solid;border-right-style:solid;border-bottom-style:solid;border-left-style:solid;border-top-color:rgb(255,0,0);border-right-color:rgb(255,0,0);border-bottom-color:rgb(255,0,0);border-left-color:rgb(255,0,0);">&gt; <span style="border-top-width:1px;border-right-width:1px;border-bottom-width:1px;border-left-width:1px;border-top-style:solid;border-right-style:solid;border-bottom-style:solid;border-left-style:solid;border-top-color:rgb(255,0,0);border-right-color:rgb(255,0,0);border-bottom-color:rgb(255,0,0);border-left-color:rgb(255,0,0);">&lt;host name="172.16.1.17" port="6789"<span style="border-top-width:1px;border-right-width:1px;border-bottom-width:1px;border-left-width:1px;border-top-style:solid;border-right-style:solid;border-bottom-style:solid;border-left-style:solid;border-top-color:rgb(255,0,0);border-right-color:rgb(255,0,0);border-bottom-color:rgb(255,0,0);border-left-color:rgb(255,0,0);">/&gt; <span style="border-top-width:1px;border-right-width:1px;border-bottom-width:1px;border-left-width:1px;border-top-style:solid;border-right-style:solid;border-bottom-style:solid;border-left-style:solid;border-top-color:rgb(255,0,0);border-right-color:rgb(255,0,0);border-bottom-color:rgb(255,0,0);border-left-color:rgb(255,0,0);">&lt;/source<span style="border-top-width:1px;border-right-width:1px;border-bottom-width:1px;border-left-width:1px;border-top-style:solid;border-right-style:solid;border-bottom-style:solid;border-left-style:solid;border-top-color:rgb(255,0,0);border-right-color:rgb(255,0,0);border-bottom-color:rgb(255,0,0);border-left-color:rgb(255,0,0);">&gt; <span style="border-top-width:1px;border-right-width:1px;border-bottom-width:1px;border-left-width:1px;border-top-style:solid;border-right-style:solid;border-bottom-style:solid;border-left-style:solid;border-top-color:rgb(255,0,0);border-right-color:rgb(255,0,0);border-bottom-color:rgb(255,0,0);border-left-color:rgb(255,0,0);">&lt;auth username="cinder"<span style="border-top-width:1px;border-right-width:1px;border-bottom-width:1px;border-left-width:1px;border-top-style:solid;border-right-style:solid;border-bottom-style:solid;border-left-style:solid;border-top-color:rgb(255,0,0);border-right-color:rgb(255,0,0);border-bottom-color:rgb(255,0,0);border-left-color:rgb(255,0,0);">&gt; <span style="border-top-width:1px;border-right-width:1px;border-bottom-width:1px;border-left-width:1px;border-top-style:solid;border-right-style:solid;border-bottom-style:solid;border-left-style:solid;border-top-color:rgb(255,0,0);border-right-color:rgb(255,0,0);border-bottom-color:rgb(255,0,0);border-left-color:rgb(255,0,0);">&lt;secret type="ceph" uuid="df0d0b60-047a-45f5-b5be-f7d2b4beadee"<span style="border-top-width:1px;border-right-width:1px;border-bottom-width:1px;border-left-width:1px;border-top-style:solid;border-right-style:solid;border-bottom-style:solid;border-left-style:solid;border-top-color:rgb(255,0,0);border-right-color:rgb(255,0,0);border-bottom-color:rgb(255,0,0);border-left-color:rgb(255,0,0);">/&gt; <span style="border-top-width:1px;border-right-width:1px;border-bottom-width:1px;border-left-width:1px;border-top-style:solid;border-right-style:solid;border-bottom-style:solid;border-left-style:solid;border-top-color:rgb(255,0,0);border-right-color:rgb(255,0,0);border-bottom-color:rgb(255,0,0);border-left-color:rgb(255,0,0);">&lt;/auth<span style="border-top-width:1px;border-right-width:1px;border-bottom-width:1px;border-left-width:1px;border-top-style:solid;border-right-style:solid;border-bottom-style:solid;border-left-style:solid;border-top-color:rgb(255,0,0);border-right-color:rgb(255,0,0);border-bottom-color:rgb(255,0,0);border-left-color:rgb(255,0,0);">&gt; <span style="border-top-width:1px;border-right-width:1px;border-bottom-width:1px;border-left-width:1px;border-top-style:solid;border-right-style:solid;border-bottom-style:solid;border-left-style:solid;border-top-color:rgb(255,0,0);border-right-color:rgb(255,0,0);border-bottom-color:rgb(255,0,0);border-left-color:rgb(255,0,0);">&lt;target bus="virtio" dev=""<span style="border-top-width:1px;border-right-width:1px;border-bottom-width:1px;border-left-width:1px;border-top-style:solid;border-right-style:solid;border-bottom-style:solid;border-left-style:solid;border-top-color:rgb(255,0,0);border-right-color:rgb(255,0,0);border-bottom-color:rgb(255,0,0);border-left-color:rgb(255,0,0);">/&gt; <span style="border-top-width:1px;border-right-width:1px;border-bottom-width:1px;border-left-width:1px;border-top-style:solid;border-right-style:solid;border-bottom-style:solid;border-left-style:solid;border-top-color:rgb(255,0,0);border-right-color:rgb(255,0,0);border-bottom-color:rgb(255,0,0);border-left-color:rgb(255,0,0);">&lt;serial<span style="border-top-width:1px;border-right-width:1px;border-bottom-width:1px;border-left-width:1px;border-top-style:solid;border-right-style:solid;border-bottom-style:solid;border-left-style:solid;border-top-color:rgb(255,0,0);border-right-color:rgb(255,0,0);border-bottom-color:rgb(255,0,0);border-left-color:rgb(255,0,0);">&gt;823dfaa9<span style="border-top-width:1px;border-right-width:1px;border-bottom-width:1px;border-left-width:1px;border-top-style:solid;border-right-style:solid;border-bottom-style:solid;border-left-style:solid;border-top-color:rgb(255,0,0);border-right-color:rgb(255,0,0);border-bottom-color:rgb(255,0,0);border-left-color:rgb(255,0,0);">-a41c<span style="border-top-width:1px;border-right-width:1px;border-bottom-width:1px;border-left-width:1px;border-top-style:solid;border-right-style:solid;border-bottom-style:solid;border-left-style:solid;border-top-color:rgb(255,0,0);border-right-color:rgb(255,0,0);border-bottom-color:rgb(255,0,0);border-left-color:rgb(255,0,0);">-4df7<span style="border-top-width:1px;border-right-width:1px;border-bottom-width:1px;border-left-width:1px;border-top-style:solid;border-right-style:solid;border-bottom-style:solid;border-left-style:solid;border-top-color:rgb(255,0,0);border-right-color:rgb(255,0,0);border-bottom-color:rgb(255,0,0);border-left-color:rgb(255,0,0);">-a165<span style="border-top-width:1px;border-right-width:1px;border-bottom-width:1px;border-left-width:1px;border-top-style:solid;border-right-style:solid;border-bottom-style:solid;border-left-style:solid;border-top-color:rgb(255,0,0);border-right-color:rgb(255,0,0);border-bottom-color:rgb(255,0,0);border-left-color:rgb(255,0,0);">-30db20b5b1c7<span style="border-top-width:1px;border-right-width:1px;border-bottom-width:1px;border-left-width:1px;border-top-style:solid;border-right-style:solid;border-bottom-style:solid;border-left-style:solid;border-top-color:rgb(255,0,0);border-right-color:rgb(255,0,0);border-bottom-color:rgb(255,0,0);border-left-color:rgb(255,0,0);">&lt;/serial<span style="border-top-width:1px;border-right-width:1px;border-bottom-width:1px;border-left-width:1px;border-top-style:solid;border-right-style:solid;border-bottom-style:solid;border-left-style:solid;border-top-color:rgb(255,0,0);border-right-color:rgb(255,0,0);border-bottom-color:rgb(255,0,0);border-left-color:rgb(255,0,0);">&gt; <span style="border-top-width:1px;border-right-width:1px;border-bottom-width:1px;border-left-width:1px;border-top-style:solid;border-right-style:solid;border-bottom-style:solid;border-left-style:solid;border-top-color:rgb(255,0,0);border-right-color:rgb(255,0,0);border-bottom-color:rgb(255,0,0);border-left-color:rgb(255,0,0);">&lt;/disk<span style="border-top-width:1px;border-right-width:1px;border-bottom-width:1px;border-left-width:1px;border-top-style:solid;border-right-style:solid;border-bottom-style:solid;border-left-style:solid;border-top-color:rgb(255,0,0);border-right-color:rgb(255,0,0);border-bottom-color:rgb(255,0,0);border-left-color:rgb(255,0,0);">&gt; {
 {(pid=7060) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:305</pre> 
 </div></td> 
 </tr> 
 </tbody> 
 </table>root@controller:~# vim /etc/libvirt/qemu/instance-00000001.xml <img src="http://zhaolei.xuexihaike.com/paste-180225417674755.jpg" alt="paste-180225417674755.jpg"> <img src="http://zhaolei.xuexihaike.com/paste-185340723724291%20%282%29.jpg" alt="paste-185340723724291%20(2).jpg"></td> 
 </tr> 
 <tr> 
 <td style="border-bottom:1px solid #B0B0B0;"> 
 <div> 
 <ol> 
 <li>GUI 界面也会更新相关 attach 信息</li> 
 </ol> 
 </div></td> 
 <td style="border-bottom:1px solid #B0B0B0;"><img src="http://zhaolei.xuexihaike.com/paste-191061620162563.jpg" alt="paste-191061620162563.jpg"></td> 
 </tr> 
 </tbody> 
</table>

转载于:https://www.cnblogs.com/LeisureZhao/p/11185605.html

[Link 1]: https://www.cnblogs.com/LeisureZhao/p/11181452.html
[paste-109311212650499.jpg]: /images/20211109/d9fc7b9aee5b444a8ed9c2d9e6df2b7e.png
[paste-123961346097155.jpg]: /images/20211109/9a4b66014b844994991444ddda0b1629.png
[paste-109624745263107.jpg]: /images/20211109/0c1bb7dde738425ea33e10966a9f4674.png
[paste-123944166227971.jpg]: /images/20211109/f9ad10305e724e29b210c861e74c1f1e.png