使用css防止选择相邻的div

Question

我有以下代码 -

<div id="collapse1" class="panel-collapse collapse">
<div class="panel-body answer">
   Some text content
   <br/>
</div>
<div class="panel-body edit-area">
<div class="pull-right" style="margin-right: 20px">
   <div class="panel-data" style="margin-bottom:10px; display: none">
      <div class='input-group'>
         <input type='text' class='submit-edit-request' placeholder='Type content & hit enter' aria-describedby='basic-addon1'>
      </div>
   </div>
   <div class="separator">
   </div>
   <div class="row">
      <button class="btn btn-primary btn-sm">Request Edit</button>
   </div>
</div></div></div>

问题在于，每当我尝试双击并在“回答”中选择文本内容时div，按钮中包含的文本也被选中。我已经尝试将-webkit-user-select属性添加到按钮并将其设置为none但它没有帮助。