
In an era overwhelmed by misinformation, professionals (and amateurs) across various fields are faced with the challenge of navigating through an ever-increasing volume of falsehoods. That’s a nice way of saying there’s a lot of junk out there. At WebExpo 2024 in Prague, Nick Fine delivered a powerful talk titled “Signal to noise in the age of misinformation,” talking about the critical role that designers, product managers, and researchers play in combating the insidious effects of misinformation, particularly in an environment heavily influenced by AI.

The impact of misinformation on professionals
The underlying theme of Nick’s presentation revolved around the pervasive influence of misinformation in both personal and workplace settings. Misinformation has the potential to derail the products and services we dedicate ourselves to, while also posing significant risks to our career growth and mental well-being, underscoring the gravity of the topic at hand. As professionals in the digital space, it is imperative to discern essential truths from the flood of false information that inundates daily interactions and decisions. Nick’s assertion emphasised that mastering this discernment is not merely a skill but a necessity.

Redefining roles in a modern landscape
The historical roles of designers, researchers, and product managers have undergone significant transformations, especially in light of ongoing developments in AI technology. Nick articulated that the traditional methods of facilitating interviews and distributing surveys are no longer sufficient in the fight against misinformation. He argued for a shift in approach: “My point here is that we are all living in this world of increasing misinformation. It’s not levelling off, it’s getting worse.”
This calls for professionals to evolve and adopt new practices, moving towards methods that actively mitigate the spread and impact of false information. Nick advocated for a more rigorous examination of sources, stating, “So tell me, why do we all consume information from anywhere without thinking about where it came from?” Engaging with material critically and purposefully is now paramount for individuals in these fields.
The guardianship of validity
Nick outlined the need for those in the industry to take on the role of “guardians of validity.” In light of rampant misinformation, researchers and product developers must ensure the integrity of the insights they utilise. He noted, “You are what you eat. If you were to eat this unknown food, it could make you sick. If I consume really bad information from Medium or LinkedIn or YouTube, I’d be going to a meeting knowing the wrong thing.”
This metaphor illustrates the critical importance of scrutinising the sources of information. Digital experts must actively filter data to ensure they are not grounding their work in misinformation. Nick encouraged his audience to establish a framework for assessing validity, emphasising the significance of questioning source credibility and corroborating facts across multiple data points.

The intricate relationship with AI
As AI becomes more embedded in day-to-day operations, the challenge of discerning misinformation becomes even more convoluted. Nick stated, “AI is a nightmare for PI [personal information], clinical data,” exposing the legal hellscape that could arise from relying on AI-generated insights without adequate scrutiny.
He admonished that the tools and methodologies created to aid research must not become blind sources of misinformation themselves. “If you’re messing around with misinformation, the regulators are going to come at you hard,” he warned. This highlights the necessity for professionals to remain vigilant and informed about the tools they use, ensuring that accuracy is always prioritised.
Cultivating critical thinking amidst chaos
In light of this tumultuous landscape, Nick called for peers in tech to cultivate an ethos of critical thinking. “You must filter this stuff,” he urged, articulating the importance of becoming not only critical consumers of information but also diligent practitioners who actively challenge the status quo.
To navigate misinformation effectively, Nick promoted structured inquiries and representative sampling within research processes. “When you build the wrong thing, it’s a big problem… it all comes back to misinformation or valid insight,” he reminded his audience, reinforcing the idea that processes should be methodical and evidence-based.
The future of user research
In conclusion, the transformation in the landscape of user research necessitates the evolution of methodologies that go beyond self-reporting and surveys, especially in a post-pandemic world. Nick argued for a shift toward behavioural design research, emphasising how understanding human behaviour is critical to developing effective products and mitigating misinformation.

As he succinctly put it, “You are and will always be better at UX research than AI.” This serves as an empowering reminder that while tools may change, the ethos of human-centric research remains vital — you can hear it all in his talk and see the slides just below.