Whenever Facebook removes content because of a negative character claim that is only a single word or phrase in a larger post, it should promptly notify the user of that fact, so that the user can repost the material without the negative character claim.
Our commitment: We’re exploring ways of notifying users of specific violating words under multiple sections of the Community Standards before we take an enforcement action.
Considerations: We’re exploring ways of increasing transparency and using automation to help users self-remediate. Currently, when our automated systems detect with high confidence a potential Bullying and Harassment violation in content that a user is about to post, we may inform the user that their post might violate the policy. This provides an opportunity for users to modify the content or decide not to post it at all. This notification, currently active in English and under testing in additional languages, informs users that the content they are posting might violate the Bullying and Harassment policy. However, this process does not include the specificity the board recommends because (1) we do not have this feature available after the moment of posting, and (2) it does not notify the user of specific words or phrases that may violate.
Prior to the board’s recommendation, we’ve also been exploring how to use automation to highlight specific words or phrases that violate our Hate Speech policies to potentially allow users to edit and repost previously violating content. This automation may eventually be used in other policy areas, for instance, identifying specific words or phrases that violate our Bullying and Harassment policy.
We do not, however, have this preemptive detection capability for human review. In this case, a user reported a comment, which our content moderators reactively reviewed. Based on this recommendation, we will assess whether we could potentially highlight specific violating words and phrases for users as a result of human review.
Next steps: We need time to build the tools necessary for this work and to test these capabilities. We plan to complete our assessment and update on our progress in the first half of 2022.