Evaluation of Polar Vortex Reader Questionnaire · 9:00pm Jul 16th, 2019
Now catching up with the tasks I intended to do months ago. Here is a report on the reader questionnaire for Polar Vortex. Thanks to everyone who completed that. Sorry this is a bit technical and written for science communication evaluation nerds (I have done courses on this). I’ll write something fun, with Pinkie Pie in it, next week...
Evaluation of Polar Vortex (My Little Pony SciComm Fanfiction): Results of Reader Questionnaire
This report gives the results of a reader questionnaire designed to assess the effectiveness of the story ‘Polar Vortex’ at communicating science. This story was written with the goal of using the pony characters to explain the concept of the polar vortex, something which is often misunderstood due to misuse of the term in media reports.
The questionnaire can be read here: https://docs.google.com/forms/d/e/1FAIpQLSdsT4m61Z2VxZlJr6-_VmRNTDA88wm7SHenAQmJa4Ki44WCwQ/viewform
Are reader questionnaires a good way to evaluate the impact of fan fiction?
They are a useful tool. This questionnaire was completed by 38 readers. As of 16 July 2019 the story has 370 views, 43 likes, 0 dislikes, 18 comments. The number of responses is therefore over 10% of the total number of readers. While Fimfiction.net has good functions (likes, favourites, comments) to judge how a story is rated, this questionnaire allowed further information to be collected.
Who are the readers?
The figures below show the distribution of the age, gender, and geographical location of readers. This shows 76% are male, 68% from the USA or Canada. The largest age group is 25-29 years old, but there are readers aged from 14 to 64. This could be biased towards groups more likely to complete the questionnaire.
Readers are fans of science. Over 97% of respondents rated their general interest in science as 4 or 5 on a scale of 1 to 5.
1 = Not at all, 5 = Very much
How successful is the story at communicating science?
84% of those completing the questionnaire indicated they felt better informed about the polar vortex after reading the story. None claimed to feel more confused.
47% indicated the story had made them want to learn more about the polar vortex. Only 5% indicated it had made them less interested.
58% indicated that the story had made them more likely to read about, or otherwise engage with, science in the future. None indicated it has made them less likely to do so.
1 = No now more confused than before, 5 = Yes, now feel better informed.
1 = No, now less interested, 5 = Yes, now more interested
1 = Less likely, 5 = More likely.
Further Questions
Why did you choose to read the story "Polar Vortex"?
This question received 37 responses. The most common reasons given were readers had liked previous work by the author (30%), and/or the story looked interesting (30%). Only 16% mentioned science in their response. This suggests while nearly all readers are interested in science, that is not the main reason why most readers choose to the read the story.
Who is your favourite pony?
This question received 37 responses naming 16 different ponies. Twilight Sparkle was the most popular (given in 24% of responses). Luna, Rarity, Sunset Shimmer, and Fluttershy were also popular. This suggests nearly all readers were sufficiently big fans to have a favourite pony. The readers are a diverse group within the fandom, but Book Horse is No. 1.
Any other comments?
15 responses. A selection:
"I really enjoy your stories."
"Magic and science are a powerful mix."
"All stories need more Pinkie Pie lol. Seriously though the stories explaining a scientific concept are great and I like how I learn something new or perhaps I knew it already but I can appreciate how the author can retell it in a new way in the world of MLP."
"Science communication via ponies really is a unique approach and that alone is a good reason to follow it. By taking something funny and 'childish' to explain largely not-dumbed down science I think it can reach a broader audience since it doesn't feel like 'learning' right off the get-go."
"Yay science?"
Why did you say the same thing twice?
Science, or Mad Science!
i63.tinypic.com/10htv12.jpg
I can’t remember if I participated in the survey or not, but I will say that I enjoy reading things that put complex concepts into simple terms that I can understand.
Given how many people read and comment on my mechanic blogs, and how few of my readers are actually mechanics, I think that there’s certainly a market for that kind of thing.
5089672
To double the fun
5089680
Is that a question?
5089714
I enjoy reading your mechanic blogs and I don't even own a car.
5089714
I'm with 5089933 here, including the lack of vehicle ownership. Your blog is awesome and you should feel awesome.
5089933
It’s better that way. I sometimes wish I didn’t own a car, and instead I’m stuck with, like, nine of them.
5089957
Y’know, I was thinking of something vaguely snarky to say, but then I remembered that I like watching play-throughs of Mario Maker levels, and I don’t even own a Nintendo Switch, so I do get it. And if you can get along in life without a car, good for you! Saves a ton of money, and it’s good for the planet.
Thank you!