I have led dozens of field surveys in Marrakech, in Safi, in rural villages, in working-class neighbourhoods, and in tourist areas. On every mission, I open with the same question: "Have you ever taken part in a survey, a poll, or a study?". In almost every case, the answer is no.
This is not an anecdote. It is a warning signal. Because in the meantime, dozens of reports, PowerPoint decks, barometers, and studies circulate in ministries, consulting firms, and companies, claiming to represent Moroccan public opinion. If most Moroccans have never been surveyed, whose voice are these numbers really carrying?
In the scientific literature, this is called self-selection bias (or volunteer bias). It occurs when respondents choose themselves to participate, instead of being randomly drawn from a defined population. Olsen, writing in the Encyclopedia of Survey Research Methods (Sage, 2008), warns that "threats to validity peak with self-selected samples — a category into which far too many Internet polls fall".
Bethlehem, a leading methodologist on web surveys, goes further: without probability sampling, "estimates are often substantially biased", and statistical theory simply ceases to apply. In plain terms: an online survey with 5,000 respondents can be less reliable than a face-to-face survey of 500 people properly sampled.
The Moroccan context compounds this bias. Three layers stack on top of each other:
Result: we are not measuring what Morocco thinks. We are measuring what an urban, young, connected, engaged sub-segment thinks, and then presenting that as the national voice.
The consequences are rarely discussed, but they are serious:
A proper survey is not sending a Google Form to a WhatsApp group. It requires:
Without these, we produce decoration. Not knowledge.
At M.PATH, we made a demanding methodological choice: returning to stratified face-to-face, physically walking through neighbourhoods and territories, training our enumerators, controlling quality, triangulating sources. It is longer, costlier, more demanding. It is also the only way to produce data that genuinely resembles the country it claims to describe.
Bad data is always more dangerous than no data: it creates the illusion of knowing. And no one decides worse than someone who thinks they know.
By Ayoub El Asraoui — M.PATH