In the new Outlook on the Web in Exchange Online and Exchange 2016 reading pane includes an action button with a text and a drop-down list. The text and default action is Reply All. Suggestion to change that to Reply to prevent people from using Reply all by accident.
Idea No. 114