weblogic 12 套接字泄露处理方法

客官°小女子只卖身不卖艺 2022-08-06 00:18 12阅读 0赞

现场weblogic报<DynamicListenThread\[Default\]> <<WLS Kernel>> <> <> <1417715701920> <BEA-002631> <Max threshold reached for open sockets \[total open sockets: 5,000, allowed max: 5,000\]. No more connections allowed.>

处理方法有两种：

<table> 
 <tbody> 
  <tr> 
   <td align="left"><span style="text-align:right; padding:0px 6px 0px 0px; font-size:14px; font-weight:bold"><br> BEA-002631 - Reached Maximum Open Sockets / Leak of Sockets in CLOSE_WAIT state (文档 ID 1673969.1)</span></td> 
   <td align="right"><a title="转到底部" href="https://support.oracle.com/epmos/faces/SearchDocDisplay?_adf.ctrl-state=y0q8uqyye_9&amp;_afrLoop=539298100012454#" style="white-space:nowrap; font-size:11px; text-decoration:none" rel="nofollow"><img title="转到底部" alt="转到底部" src="https://support.oracle.com/epmos/ui/images/quicklink_smlarrowdown_enabled.gif" style="border-bottom:medium none; border-left:medium none; display:inline; vertical-align:middle; border-top:medium none; border-right:medium none"><span style="color:rgb(0,50,134); margin-left:3px">转到底部</span></a></td> 
   <td><img alt="" src="https://support.oracle.com/epmos/adf/images/t.gif" width="20" height="10"></td> 
  </tr> 
 </tbody> 
</table>

--------------------

<table style="table-layout:fixed; overflow:hidden"> 
 <tbody> 
  <tr> 
   <td style="vertical-align:top; overflow:hidden"> 
    <div style="overflow:auto"> 
     <div> 
      <span style="font-size:12px"></span> 
      <p><strong>In this Document</strong><br> </p> 
      <table> 
       <tbody> 
        <tr> 
         <td></td> 
         <td><a href="https://support.oracle.com/epmos/faces/SearchDocDisplay?_adf.ctrl-state=y0q8uqyye_9&amp;_afrLoop=539298100012454#SYMPTOM" rel="nofollow">Symptoms</a></td> 
        </tr> 
       </tbody> 
      </table> 
      <table> 
       <tbody> 
        <tr> 
         <td>&nbsp;</td> 
         <td><a href="https://support.oracle.com/epmos/faces/SearchDocDisplay?_adf.ctrl-state=y0q8uqyye_9&amp;_afrLoop=539298100012454#CAUSE" rel="nofollow">Cause</a></td> 
        </tr> 
       </tbody> 
      </table> 
      <table> 
       <tbody> 
        <tr> 
         <td>&nbsp;</td> 
         <td><a href="https://support.oracle.com/epmos/faces/SearchDocDisplay?_adf.ctrl-state=y0q8uqyye_9&amp;_afrLoop=539298100012454#FIX" rel="nofollow">Solution</a></td> 
        </tr> 
       </tbody> 
      </table> 
      <table> 
       <tbody> 
        <tr> 
         <td>&nbsp;</td> 
         <td><a href="https://support.oracle.com/epmos/faces/SearchDocDisplay?_adf.ctrl-state=y0q8uqyye_9&amp;_afrLoop=539298100012454#REF" rel="nofollow">References</a></td> 
        </tr> 
       </tbody> 
      </table> 
      <hr> 
      <p><br> </p> 
      <h2 style="border-bottom-color:rgb(196,209,230); border-bottom-width:1px; border-bottom-style:solid; padding-bottom:6px; text-transform:uppercase; background-color:rgb(119,119,115); padding-left:8px; color:rgb(255,255,255); font-size:16px; padding-top:6px"> APPLIES TO:</h2> Oracle WebLogic Server - Version 12.1.2.0.0 and later 
      <br> Information in this document applies to any platform. 
      <br> 
      <h2 style="border-bottom-color:rgb(196,209,230); border-bottom-width:1px; border-bottom-style:solid; padding-bottom:6px; text-transform:uppercase; background-color:rgb(119,119,115); padding-left:8px; color:rgb(255,255,255); font-size:16px; padding-top:6px"> <a rel="nofollow"></a>SYMPTOMS</h2> 
      <p>In a lightly loaded staging environment, the maximum open sockets was reached as below.</p> 
      <div style="border-bottom:rgb(196,209,230) 1px solid; border-left:rgb(196,209,230) 1px solid; padding-bottom:0.5em; background-color:rgb(224,234,241); margin:5px 0px 0px; padding-left:0.5em; padding-right:0.5em; font-family:'Courier New',Courier,monospace; font-size:12px; overflow:auto; border-top:rgb(196,209,230) 1px solid; border-right:rgb(196,209,230) 1px solid; padding-top:0.5em">
        06-Dec-2013 20:03:03 o'clock GMT Warning Server rds09470app145 rdms1-restgp2b DynamicListenThread[Default] WLS Kernel 1386360183611 BEA-002631 Max threshold reached for open sockets [total open sockets: 1,000, allowed max: 1,000]. No more connections allowed. 
      </div> 
      <p>In WLS 11g and 8.1 domains running on the same hardware with 1000 sockets, this issue was not observed.</p> 
      <h2 style="border-bottom-color:rgb(196,209,230); border-bottom-width:1px; border-bottom-style:solid; padding-bottom:6px; text-transform:uppercase; background-color:rgb(119,119,115); padding-left:8px; color:rgb(255,255,255); font-size:16px; padding-top:6px"> <a rel="nofollow"></a>CAUSE</h2> 
      <p>Using NIOSocketMuxer (the default socket muxer in 12.1.2), the socket closure depends on the finalizer mechanism. If the finalizer thread does not kick in (e.g., no GC), the socket closure will not happen and you will reach the number of open sockets configured.</p> 
      <p>A second issue was that disabling the MAX-OPEN-SOCK-COUNT setting requires a reboot, although the console says that a reboot is unnecessary.</p> 
      <p>A third issue was that although the first issue is solved, a number of sockets in CLOSE_WAIT were still found, leading to the server ceasing to process requests.</p> 
      <p>Observations:</p> 
      <ol> 
       <li>For the first issue, when using JFR (that regularly kicks GC), the issue does not happen. The source code analysis confirms this. </li> 
       <li>For the second issue, this is shown in console and while reproducing the first issue. </li> 
       <li>For the third issue, one could watch, only on the customer instances, this phenomenon, although first issue was fixed! The same symptom occurred (leak of CLOSE_WAIT sockets) but in this case, stopping JFR does not make the issue disappear.</li> 
      </ol> 
      <h2 style="border-bottom-color:rgb(196,209,230); border-bottom-width:1px; border-bottom-style:solid; padding-bottom:6px; text-transform:uppercase; background-color:rgb(119,119,115); padding-left:8px; color:rgb(255,255,255); font-size:16px; padding-top:6px"> <a rel="nofollow"></a>SOLUTION</h2> 
      <p>Solution retained by this customer is to drop MAX-OPEN-SOCK-COUNT and to apply the known workaround against the deadlock. The other solution is to install the following patches on WLS 12.1.2:</p> 
      <ul> 
       <li><a href="https://support.oracle.com/epmos/faces/ui/patch/PatchDetail.jspx?parent=DOCUMENT&amp;sourceId=1673969.1&amp;patchId=18108916" rel="nofollow">Patch 18108916</a> </li> 
       <li><a href="https://support.oracle.com/epmos/faces/ui/patch/PatchDetail.jspx?parent=DOCUMENT&amp;sourceId=1673969.1&amp;patchId=18289179" rel="nofollow">Patch 18289179</a> </li> 
       <li><a href="https://support.oracle.com/epmos/faces/ui/patch/PatchDetail.jspx?parent=DOCUMENT&amp;sourceId=1673969.1&amp;patchId=16784672" rel="nofollow">Patch 16784672</a></li> 
      </ul> 
      <h2 style="border-bottom-color:rgb(196,209,230); border-bottom-width:1px; border-bottom-style:solid; padding-bottom:6px; text-transform:uppercase; background-color:rgb(119,119,115); padding-left:8px; color:rgb(255,255,255); font-size:16px; padding-top:6px"> <a rel="nofollow"></a>REFERENCES</h2> 
      <br> 
      <a href="https://support.oracle.com/epmos/faces/BugDisplay?parent=DOCUMENT&amp;sourceId=1673969.1&amp;id=18396023" rel="nofollow">BUG:18396023</a>&nbsp;- NIO: MANY NATIVE SOCKETS IN CLOSE_WAIT, NO JAVA SOCKET LEAKS 
      <br> 
      <a href="https://support.oracle.com/epmos/faces/BugDisplay?parent=DOCUMENT&amp;sourceId=1673969.1&amp;id=18289179" rel="nofollow">BUG:18289179</a>&nbsp;- SETTING MAX-OPEN-SOCK-COUNT REQUIRES ENTITY REBOOT 
     </div> 
    </div> </td> 
  </tr> 
 </tbody> 
</table>