Features
Metrics
Quality metrics to evaluate the results
Basics
Responses from the style transform endpoint include quality metrics when the include_quality
parameter is set to True. The quality metrics show differences between the unpersonalized
text, which is the AI-generated text without Vaero styling, the personalized
text, which is the text after Vaero styling, and ground_truth
text, which is the dataset used for fine-tuning the model.
-
Sentence length statistics
- Mean - the mean sentence length in the text
- Median - the median sentence length in the text
- Std dev - the standard deviation in sentence length in the text
-
Lexical diversity
- MATTR - Moving-Average Type-Token Ratio
- MTLD - Measure of Textual Lexical diversity
- HDD - Hypergeometric Distribution Diversity
-
Readability
- Flesch Reading Ease
- Flesch Kincaid Grade level