If a result is an advertisement but highly relevant, how do you rate it?

• A. Highly Relevant, with note that it is an ad and consider user experience
• B. Not Relevant
• C. Moderately relevant
• D. Highly Relevant without note

Answer: (A)

When evaluating a result, relevance is about how well it matches what the user is seeking. If an advertisement directly addresses the query and could satisfy the user’s intent, it deserves a high relevance rating. However, because it is paid content, you should annotate that it is an advertisement. This transparency helps users understand the source and makes them aware of potential bias, which supports a better user experience. The other options miss an important factor: an ad can be highly relevant to the query, and hiding that it’s an ad would reduce clarity and trust.