The PONIES Power Rating System · 12:29am Sep 28th, 2017
I'm finally ready to reveal PONIES Power, my new story rating system!
No, not Power Ponies. The other way around!
It's similar in appearance to horizon's HORSE feedback system (CC 4.0). The similarities are superficial, however, so I don't think I need to maintain the license. For one thing, this isn't a relative ranking system.
There are six criteria in PONIES Power. Each criterion is ranked between zero and four hooves, and each hoof is worth 25 HP (horsepower). The total of all six categories yields the full HP for the story, which can range from 0 to 600 HP.
In addition to the numeric rating system, the following information should be included:
Why: Why this work was selected for review.
Bias: Modification to HP to correct for imperfections in the system. Bias should be +0 HP as often as possible, and should never be used to send a story's HP below 0 HP or above 600 HP—only to bump HP up or down just enough to reach the appropriate Rank.
Rank: Recommendation Rank based on HP plus Bias. These categories will be defined further down (after the criteria are defined).
I'll be using PONIES Power to rate the stories I review and to sort them into bookshelves. So, without further ado, here is a description of each criterion.
Plot
Applejack will tell it to you straight: more than anything, a story is defined by its Plot. Fiction is a contract between author and reader, and contracts require honesty and follow-through. If you make a promise, well, missy, you'd best deliver on it! Even in the tallest tale, foreshadowing needs to lead somewhere, the sequence of events should make horse sense to the reader at some point, and the most important details need to be wrapped up in the end.
Plot covers foreshadowing, plot development, and the end resolution. Stories with strong Plot will feature clear forward and backward references, the sequence of events will make sense eventually, and the ending will contain a solid payoff. It's okay if there are unanswered questions if the intent is to leave the reader with something to ponder, but the reader should be left wanting more, not feeling like they were flim-flammed.
Note that traditional mysteries have a higher bar to meet for Plot, since leaving clues for the reader is an integral part of the story.
PPPP: This story had a solid payoff, and the plot was well-connected throughout the story. The pieces of the story meshed perfectly, and the ending tied it all together. The author provided foreshadowing and backward references in a way that prevented the reader from forgetting the important details. You could probably read this twice and get something new out of it, because the resolution of the story reframed the narrative in a way that made sense.
PPP: Almost everything fit together. Maybe the ending left off discussion of something nonessential. There may have been minor plot holes, but they could easily be ignored. If those weren't an issue, then either the plot connections were overly complicated, or the story didn't make significant use of foreshadowing or callbacks to better integrate the events.
PP: There were a few noticeable plot issues which detracted from enjoyment of the story. The plot development may have been boring and routine, or the ending was a little incomplete. Some loose ends may not have been tied up properly. Perhaps there was an obvious but clearly unintentional plot hole that undermined the narrative, or something important was introduced but never touched upon later. The reader might need to go back and check earlier parts of the story for context.
P: There were significant problems with the plot which made the story feel disconnected or confusing. It contained plot holes or major loose threads at the end, or perhaps some of the story elements didn't lead anywhere. The ending wasn't complete, or else the structure of the story was too confusing for it to make sense. It may have felt like the author was stringing the reader along, as if the story were primarily a joke at the expense of the reader's time spent reading.
-: The elements of this story felt very jumbled and disconnected. The tale meandered and interposed non-sequitur scenes that had no bearing on the theme or resolution. Important things in the story may have been ignored or abandoned entirely without explanation. The ending did not make the story feel complete, and there might not have been any resolution.
Originality
Rarity will gladly take time out of her busy day to explain the importance of Originality in creative design. As a self-made mare, she understands the sacrifices necessary to achieve greatness. The most important of these is the generous amount of inspiration and design necessary for a work of art to stand apart from the crowd. Art isn't interesting if there is no uniqueness in its inception. You must dedicate your time and energy to develop something your audience hasn't seen before—or at the very least, offer them a fresh new perspective on an old standby. To do it properly, originality often entails taking risks and pushing yourself as an artist.
Originality represents the new ideas a story uses in a central or pivotal role, and any atypical approaches used to tell the story. Whether an idea is new or an approach atypical depends entirely on the cultural context in which the story was written, which means Originality cannot be assessed without knowing when and where the story was first made available to readers. When two stories in close proximity cover the same otherwise-unique subject matter, the first one will score higher. Stories with strong Originality will take more risks, which may provide novelty to the reader even when the experiment doesn't pan out.
Note that sequels and parodies have a much higher bar to meet for Originality, and that elements drawn from the fandom itself do not count against Originality if they have neither been widely used in fanfiction nor elaborated upon in canon.
OOOO: This story is brimming with new ideas, and it makes proper use of them. It takes at least a small amount of risk by not leaning on cliche tropes and devices, or else it redefines them in a new context. There's something in this story that you've never seen before, and it leaves you with a lot to think about.
OOO: The story covers substantial new ground in a thought-provoking way, but some of the key concepts it focuses upon have already been explored. Alternately, the story may be entirely original, but the ideas are not fully fleshed-out in the way they deserve to be. Still, the reader will be left with new ideas and fresh perspectives.
OO: This is a story that mostly relies on established ideas, but at least it offers a new perspective on them or combines them in a different way. It may take a few limited risks in the approach to telling the story, but probably not in a way that offers significant novelty. Alternately, the story may be very experimental and unusual in its presentation, but offer no new ideas within the narrative.
O: This story reuses old ideas in a slightly different fashion, and that's about all it does. There might be some attempts to make the story stand out, but they aren't anything new and they don't provide anything to the story's benefit.
-: There's nothing new here at all. It might not be outright plagiarism, but this exact story has been told before.
Notability
Pinkie Pie knows that a party isn't a party without laughter, and laughter comes from happy ponies! Whether or not you have a large crowd, it's important to decide who the audience will be when you send out your invitations. If an event has less Notability because it is aimed at a very specific audience, potential visitors need to know that even though they're welcome to stop by, those who weren't invited are less likely to enjoy themselves.
Notability expresses the idea that some stories are more relatable than others. Stories don't need to be popular, but ideally most ponies should be able to find something they can identify with if they decided to give the story a chance. Stories with high Notability will focus on at least one major theme that most readers would be able to appreciate.
Common knowledge from the fandom and knowledge from a prequel do not count against a story's Notability score, but knowledge required from a crossover genre does.
NNNN: The theme of the story covers feelings and events that anypony of young adult age or older could identify with, and readers will be able to draw parallels between the story and their own life experiences. If there is anything in the story the average reader couldn't directly relate to, that topic is clearly intended to seem foreign or alien. It is difficult for stories with explicit graphic material to earn this score.
NNN: This story could be appreciated by nearly anypony, but some readers will get significantly more out of the story because it focuses intensely on a theme where familiarity is relevant (e.g. the experience of mind-altering drugs), or else the theme or style of storytelling isn't going to be appreciated by some readers (e.g. graphic descriptions of combat).
NN: This is a story aimed at a specific audience, but a large proportion of readers could get something out of it if they tried to. Alternately, most readers could appreciate the story and understand the majority of it, but some will be confused by the references. Sexually explicit stories that are short on plot and non-obtuse crossovers frequently fall into this category.
N: You will only enjoy or even understand this story if you fall into a select audience that shares the author's particular fetishes or experiences.
-: This story is aimed at specific individuals. It relies on in-jokes and previous knowledge that only a hoofful of people will have access to. It might even have been written for the author alone to appreciate.
Intensity
Rainbow Dash is keenly aware that captivating your audience requires keeping them on the edge of their seats. If you want to show true loyalty to your fans, you'd better knock the socks off their hooves! A good performance needs Intensity. It should to start out strong, and move from event to event in a way that keeps the viewers interested and excited for more. Make sure you give them enough time to see the details, but keep things moving and always go for the wow factor.
Intensity covers a story's hook, pacing, action, and proper setting of mood. A story with high Intensity will draw your interest with descriptions and actions that won't leave you bored. It will hook you from the very beginning, and you won't be able to put it down until you've finished it—but it will do it without rushing over important details and descriptions that deepen your immersion.
Note that Intensity doesn't consider how coherent or enjoyable a narrative is, only whether or not it draws a reader's attention and feels appropriately paced.
IIII: The story has a strong hook that won't let go. It doesn't feel slow, doesn't skip over important details, and never seems boring or rushed. The mood always matches what the story seems to be focused on.
III: The story has good passion in it, with one or two minor stumbles. It may take a while to get started, or there may be some lulls here and there, but most of the story is captivating and parts of it will draw your complete attention.
II: The story does contain some passion and action, but it drops you into tedium at times. Alternately, it rushes past important details and passes up opportunities to use descriptions to establish a consistent mood, which could leave the reader with uncertain expectations.
I: The story barely establishes mood, and most of the action and descriptions are bland. There are a few good points hidden in the text that make for interesting reading, but most of the time you're either bored or confused. Much of the story should have ended up being cut. Alternately, the story races at such a madcap pace that the action lacks the details necessary to make it feel realistic.
-: This story is totally blah. It's challenging to read because there is nothing interesting or colorful about how the world is described. It either plods incredibly slowly, or is so barren of details it feels more like an outline of a story than a proper story. The mood is absent, or else it varies constantly and inexplicably. If there is action, it feels pointless or completely random. Alternately, this may read like a stream of consciousness with no solid foundation.
Expression
Take it from Twilight Sparkle: the magic is in the presentation! You can't share something important with your friends without Expression. You must be able to express your ideas clearly, and with precision. Not all ponies learn in the same way, so it's up to the pony giving the lecture to make sure that each of their friends has the ability to follow along in a logical, orderly manner.
Expression represents the writing, composition, and textual structure of a story. When handled properly, Expression is all about what you don't notice: spelling and grammatical errors, repetitive word choices, and confusing presentation of descriptions, ideas, and dialogue. A story with good Expression will be a smooth read, even if what you're reading is boring or makes no sense.
Note that Expression doesn't involve whether or not the transitions between scenes or ideas makes any logical sense, only whether or not sentences are arranged in a way that won't distract the reader from what the text is literally saying.
EEEE: The spelling, grammar, and composition of this story are nearly flawless, and the text is easy to read as a result. If there are any errors, they're rare and easily overlooked.
EEE: There are a few minor grammatical issues, structural choices, or word choices that distract you from the story. They may pull the reader out of the story temporarily, but these are infrequent events and they don't detract from the story in other ways.
EE: You're pulled out of the story a few times by the quality of the writing. It isn't constantly distracting, but there are problems throughout the story. You might be a little confused by the language and need to reread a sentence here or there.
E: Most of the writing is poor and either awkward or difficult to follow as a result. There are parts of the text where you can't decipher exactly what the author means, and you're constantly aware of the compositional issues.
-: The writing is so incoherent that trying to figure out what many of the sentences said became a hopeless puzzle. You might even wonder if somepony used Google Translate to import this story from another language.
Subtext
Fluttershy understands the value of being understated. Kindness can take many forms, and a kind act isn't always obvious—it might be hidden within the Subtext. Sometimes you need to be direct, while at other times it pays to be subtle. What makes a story worth reading is how well the reader can connect to its intended message. This requires maintaining a delicate balance between bluntness and sly implication.
Subtext covers the overarching theme and message of a story, as well as the subtlety of indirectly conveying feelings and ideas without explicitly telling the reader what they should feel or think. The latter aspect is often called "show don't tell" in fiction writing. For the larger theme, what is the story supposed to do for the reader? Some stories simply want to make you laugh or cry, while other stories have a deeper message to extract. When you read a story, Subtext represents how well the author delivered those crucial feelings and ideas to the reader. A story with good Subtext will have a clear point to make, and will make that point with the right amount of subtlety: the author's intent will seem clear, but readers will be tricked into feeling like the emotions and ideas in the story came from within themselves.
Note that Subtext does not include whether or not the message or experiences are relatable, only how well those elements are conveyed to the reader.
SSSS: The author had a goal in mind and it came across precisely. The story didn't tell you what to think or feel, and did not explicitly narrate the moral, but it still made the reader experience the feelings and ideas the author seemed to intend.
SSS: The thrust of the story is pretty clear, but the reader may be uncertain whether or not they understand the mindset of the author or the true purpose of the story. Alternately, the meaning might come across perfectly, but the story is a little too explicit at hitting the message home. Some descriptions in the story might be a little "telly".
SS: The story probably lacks subtlety, and the message could be muddled. It might succeed in sending the overall message or feeling without overdoing it, but the individual descriptions in the story are "telly" or overdramatic. Alternately, it could be appropriately subtle with specific descriptions but explicitly state the message it's trying to convey, the way the cartoon often does when characters state the moral aloud.
S: The text is dominated by "telly" descriptions and action in most places, and if drama exists, it's usually overwrought. The story's purpose is difficult to guess, or it's a thinly-veiled author tract.
-: This story is either an explicit author tract that states its message and reads like a speech, or a meaningless mood piece that tells the reader exactly what they are supposed to feel every step of the way. Alternately, the story is so bizarre and devoid of any meaning or direction that you can't imagine why anypony would have written it.
Rank
Final Rank is a combination of HP and Bias.
I will probably tweak the numerical boundaries later based on data from actual reviews.
525-600 HP: Strong Recommend
If this story has any flaws, they're easily overlooked. It's interesting and reading it is worth anypony's time.
425-500 HP: General Recommend
This story may have some minor flaws, but they do little to detract from its enjoyment. It's definitely worth reading.
325-400 HP: Recommend with Reservations
This story may not be for everypony. The flaws may be impossible to overlook, but the story is interesting enough that they might be worth suffering through. This would still be worth reading for many readers.
225-300 HP: Equivocal Support
This story has significant flaws and needs work to make it shine. A limited number of readers would be able to look past the flaws and enjoy it.
125-200 HP: Do Not Recommend
This story is so flawed it isn't worth most readers' time. There just isn't a lot to enjoy here.
0-100 HP: Recommend Against
This is absolutely terrible. Is it a trollfic? Is the author seven years old? Why did you write this?
That's the system! As for how I'll be translating the overall HP values to bookshelves, I'll wait until I've reviewed enough stories to get an idea of the typical HP distribution for stories I'm likely to read.
Nice.
Well, you can take the beans out of the fridge, they are officially cool.
Always neat to see another attempt to quantize quality. Notability is an especially interesting criterion. I don't think I've ever seen someone work accessibility and audience compatibility into a scoring system before.
Nice. Care to give a few example ratings? Feel free to use one of my awful stories for a low horsepower demonstration ;)
4680384
Sure you have. It's the "Conditional" scoring level used by reviewers like PresentPerfect, except that it shouldn't be a scoring level. Something can be accessible only to a specific audience but still have high or low quality.
I look forward to seeing this in action.
This looks pretty clever and comprehensive. I'll be interested to see it in use.
Are you going to review some well-known stories using it, to give us all some "standard candles" of both the system and your reviewing?
4680379
yoink! I’m stealing that phrase.
That's pretty darn cool. :D
Poor horizon, with such antiquated ideas that we build our new-fangled systems off of.
Nice to see another ranking system. I look forward to see this for the next Writeoff round.
4680397
I'm tempted to put up ratings for my own stories first, even though I'm clearly biased.
This has been a long time coming
This seems very well thought out, and also fairly in-line with how I tend to think about stories.
Thanks for sharing it!