User feedback is the signals people give about the quality of answers: thumbs up or down, corrections, comments, rephrasings. Collected and analyzed together with the context of the request, it reveals real defects and feeds the test sets.
Example
A thumbs down with the reason "off-topic answer" is recorded together with the request.