This document originated in the Age of Kings Heaven forums, and is designed to be a recommendation of how to review Utilities.
Thanks go out to everybody, especially to AnastasiaKafka and Ingo van Thiel, who helped to define the categories and to Thurdl01, who wrote the Random Map Script Reviewing Tutorial from were I copied some text to create this document, which was written to make reviews of Utilities more common.
Up until now, Utility reviews lacked any formal structure and the few reviews that existed were completely free form, with a single overall scoring category. This lack of structure was causing reviewers to not know what to focus on when reviewing and as a result, the reviews and ratings were not as helpful for the authors and visitors as they could have been. The remainder of this document will present the new reviewing system which is composed of four general categories and a rating system. They are easy for anyone to understand and they cover all the important aspects of a utility. The four categories are Utility, Novelty, Quality and Instructions. Each category will be covered in detail but before we get started with the categories, it's important to note that although the file type is different and the categories are new, the basic concepts laid out in the Campaign & Scenario Reviewing Tutorial still hold true here. Please be sure to read that tutorial first as we will not repeat advice given there, but focus only on the new aspects of Utility reviewing categories.
UTILITY
Under this category we rate if the utility is useful in any aspect of the game and to what degree it produces an adequate or desired result, this includes game play and scenario design. A utility does not have to be new to be useful; it can be better and/or different. The use of a utility can be practical, helpful, effective or adding ease of use.
A few questions that should be asked to determine the Utility score:
-Is/does or has the utility the capacity for what it is intended to be or to do?
-Is the utility useful to game play and/or scenario design and to what degree?
-Is the utility practical, helpful, effective or adding ease of use?
NOVELTY
QUALITY
INSTRUCTIONS
Under this category we rate the user friendliness of the utility. Obviously this means how well is the user instructed about the purpose, the use or the possibility of replication of the utility. We all have a vague idea what to expect by downloading a scenario. More than for a scenario the instruction for a utility starts with the title of the download and the author’s description page.
A few questions that should be asked to determine the Instructions score:
-does the title of the download reflect the purpose of the utility?
-does the information on the author’s description page explain the utility’s content?
-are the instructions and explanations of a utility's use and/or replication sufficient?
FINAL THOUGHTS
The final score for any Utility will be the average of the four rating categories. Therefore, for a Utility to be truly exceptional, it must excel at all four areas.
If your average is a 3.0 or 2.5 for example, just click the number in the provided box for the rating. In the following rating the reviewer should weigh the importance of the given ratings for the specific category and round up or down.
Utility: 3 Creativity: 3 Quality: 3 Instruction: 4 Final score: 3.25
That may seem a little random, but the reviewer should have the liberty to decide if the utility deserves a 3.0 or a 3.5 here, as long he is consistent in his ratings.
As with all reviews, the text of the review should not just be a series of numbers. Each category should be well explained, especially if they tend towards the high or low end of the spectrum, describing what could be better and what mistakes could be learned from. Always remember that reviews serve two purposes: one to give the visitor a better idea of what they are downloading and two, to give the author some advice on how to make improvements and some explanation on your rating. Reviews ultimately benefit the entire community so keep that in mind as you write your reviews.
The creation of Utilities is a lot of fun and it is our hope that with this reviewing process in place, the best artists will get some more recognition for their work and perhaps some of their utilities will get regularly used by the visitors of Heaven Games.
That's about it!
Thank you for reading and please feel free to comment, this is only a draft.
This topic will be updated according to progress with an appropriate text and an explanation of all categories as well as a score breakdown for each of them.
[This message has been edited by Tanneur99 (edited 01-08-2003 @ 12:36 PM).]