We have some basic handling to ignore quoted content for tone check (and some other checks).
Currently this checks
- If the content is in a <blockquote>
- If the first chracter is the matched range is inside quotes. This is done by counting the quotes either side of that offest.
This misses cases where most of the text is quoted, e.g. paragraph 2 here: https://en.wikipedia.org/w/index.php?title=Henry_Hudson_(artist)&oldid=1347919439#A_Rake_Revisited
Possible solutions:
- Let ignoreQuotedContent set a % of how much content should be quoted before the whole paragraph is ignored, e.g. if 80% of the paragraph is inside quotes, ignore the check.
- Mask quoted content before passing it to the model, e.g.
He was described as "the greatest artist ever" by his contemporaries, and "an inspiration" by his partner.
V
He was described as "----" by his contemporaries, and "----" by his partner.