In T378777, we will evolve the desktop Reference Check experience by presenting the Check in a side rail that will live adjacent to the editable content, rather than presenting the Check within the editable content.

This task involves the work of analyzing how –if at all – the change described above (and visualized below) impacts the Edit Check guardrail metrics we've established.

Change

Before T378777 | After T378777

Decision(s) to be made

• What – if any – further investigations will we prioritize doing to understand what might be contributing to the changes in the "Metrics" detailed in the "Research questions" section below?

Research questions

1. Do we notice a change in how likely the Reference Check is to be disrupting people as measured by:
   • Edit completion rate
   • False positive report rate
   • Revert rate
   • Proportion of new content edits that include a reference

2. Do we notice a change in how likely the Reference Check is to cause people to publish constructive edits as measured by:
   • Absolute number of people who are adding a citation as a result of this rule change
   • Proportion of edits Edit Check was activated within that result in a new reference being added (and the edit not being reverted)