Other browsers that I tested have the following behavior:
IE11 @ Win10: Empty <p>
Chrome @ Ubuntu: Single <br>
What's important is that if it's not the <body> element that's editable but something else the result is different only on Edge.
For example a single editable <div> on Edge has a <br> element inside after deleting the text - which is the expected behavior.