Autoscale ignoring annotations

Is there a way to configure auto-scaling to ignore annotations?
I have a graph that can be anywhere between 0 and 100 in the Y scale.
I want to add annotations (lines / rectangles) to show “areas” in the Y scale (eg. 0 to 50 in y values with a red background, and label “bad”; 50 to 80 in orange, reading “fair”, etc.)

However if the scatter graph is only between (say) 70 and 90, I don’t really need to see the 0 to 50 part of the y scale.