“Sometimes the questions are complicated and the answers are simple” (Dr. Seuss). Dr. Perrodin centers this episode to the seven reasons he loathes surveys and lays out a vastly better alternative for gathering relevant input to inform decision making. WHAT IS A SURVEY – THE NUTS AND BOLTS. Fundamentally, a survey is a method of gathering information from a sample of people, traditionally with the intention of generalizing the results to a larger population. Surveys provide a critical source of data and insights for nearly everyone engaged in the information economy, from businesses and the media to government and academics. There are several steps to creating surveys, but the pillars of any surveys are the constructs. In the context of a survey, a construct is the abstract idea or underlying theme. Constructs can be direct or indirect. Direct is easily and reliably measured, such as height and weight. These also will have a very high level of inter-rater reliability. On the other hand, indirect constructs, such as happiness, frustration and satisfaction are more challenging to assess and splattered with issues of inter-rater reliability as happiness will hold a meaning unique to the individual. THE 7 FLAWS OF SURVEYS. (1) Surveys aggregate, or combine, data from many survey takers. For example, one might deduct from collective findings of a youth risk survey of 300 high school students that “15% of youth surveyed had suicidal thoughts at least twice during the past year”. At first glance, this appears like sound, useful information. It isn’t. In fact, it’s largely useless. Why? Who are the 15% of students that have considered suicide? How does one exactly recall at least 2 events within the past 365 days. We already know the forgetting curve wreaks havoc in the courtroom. (2) Response rates - how many surveys do you receive and actually complete? People dislike filling our long forms and response rates for emailed surveys might hover at 2%. Almost everyone will ignore a survey. (3) Positionality of person(s) writing the questions. Positionality is the practice of a researcher delineating his or her own position in relation to the study, with the implication that this position may influence aspect of the study, such as the data collected or the way in which it is interpreted. The survey will mirror the mind of its author – and that often can lead to bias. I mean, how many human resources want to craft a survey that will reveal the true level of disdain simmering within employees? (4) Survey takers are not able to ask seek clarification of the questions. Surveys are one-way. Good luck! (5) It’s not easy to ask “good” questions. Formulating constructs takes thought and operational definitions. The most effective surveys have the fewest questions, like 20, and they must pepper construct-aligned questions throughout the survey instead of clumping them into sections. (6) Survey question vernacular, register or reading level are all ways to point out that most surveys are written with industry jargon and won’t be understood by all survey takers. When considering youth and adults with disabilities or language barriers, comprehension plummets and you largely end up with people guessing as they simply don’t understand the questions. This might even be a form of passive discrimination. Nobody does a readability check on a survey – even though such a task can be done online for free in a 5 minutes. (7) People generalize survey findings beyond the unit of measure. For example, a survey from, and applied to, one elementary school is much more useful than taking surveys from 100 elementary schools, combining the findings and then distilling blanket conclusions. Contexts and situations are lost under such common practices and the more you aggregate findings the less you lose of the “unit of measure.” THE BETTER OPTION – FOCUS GROUPS. Dr. Perrodin regularly conducts focus groups – in fact, he has facilitated eight focus groups of 6-8 people within the past 2 months! In this episode, he talks in detail about how to carry out a focus group. Advantages of focus groups. The main advantages of focus groups are: they are useful to obtain detailed information about personal and group feelings, perceptions and opinions. You can record them, code them, field or ask immediate clarifying questions and be open to un-anticipated divergent input! FOLLOW DR. PERRODIN: Twitter @SafetyPhD and subscribe to The Safety Doc YouTube channel & Apple Podcasts. SAFETY DOC WEBSITE & BLOG: www.safetyphd.com David will respond to comments & emails. The Safety Doc Podcast is hosted & produced by David Perrodin, PhD. ENDORSEMENTS. Opinions are those of the host & guests and do not reflect positions of The 405 Media or supporters of “The Safety Doc Podcast”. The show adheres to nondiscrimination principles while seeking to bring forward productive discourse & debate on topics relevant to personal or institutional safety. Email David: thesafetydoc@gmail.com LOOKING FOR DR. TIMOTHY LUDWIG, PHD? Dr. Perrodin’s “Safety Doc Podcast” negotiates school and community safety. To be informed about industrial safety, please contact Appalachian State University Professor Dr. Timothy Ludwig, PhD, at www.safety-doc.com.
First Upon An Accident | Interview with Justin Dooley
Online Predator Tactics | Child Grooming Awareness with Hector Solis
The 4 Self-Awareness Archetypes & Introspection's Fatal Flaw
Hawaii Missile Alert: The STRANGE Narrative - Interview with Jim Malliard
Video Gaming the System - Are Video Games a Debilitating Addiction?
Irrational Desire for Perfection or Dread of Social Failure - Why are Younger Adults are so Depressed?
Army; DHS Prep Teachers for Active Shooters with Video Games - Will it Work?
2017 in Review & What I Learned from Custer's Last Stand
The Mass Psychology of Disasters: 8 Findings That Don’t Fit the Narrative
The Anatomy Of Panic
Rhetoric Wins As School Trip To DC Canceled Over Fears Of Attack
The Equifax Credit Breach - Here's What You Need To Do Now!
Subjective Reality Versus Objective Reality
The Humor Response - A Deeper Look
Comedy After Tragedy? Larry Roberts & David Perrodin
"Projected Benchmarking" - Garbage Media Ploys Following A Mass Shooting
Cajun Navy Insider - Katie Pechon Interview / TRUE STORIES
Economic Argument For Price Gouging In Disasters
Hashtag Hurricane Rescues Are Here To Stay - Pros; Cons
Houston Dunkirk, Cajun Navy; Fixing FEMA
Create your
podcast in
minutes
It is Free
Navigating Life After 40
Teaching Learning Leading K-12
Regenerative Skills
The Jordan B. Peterson Podcast
The Mel Robbins Podcast