Check whether AI-generated themes are decision-ready
Count distinct participants, not repeated quotes
Before treating a theme as a product need, link it to the exact interview excerpts and count how many different participants support it. Several quotes from one interview are still one participant, not independent confirmation.
Look for evidence against the theme
Review interviews that contradict or qualify the theme. Separate what participants actually said from the researcher's interpretation, and mark a thin or mixed pattern as provisional rather than a validated finding.
Hold roadmap decisions until the evidence is reviewed
Have the study owner check the participant mix, consent, source access, and unresolved gaps before using the theme to prioritize a feature. If the claimed breadth is not supported, run targeted follow-up research or keep the decision open.