Turn off hover for specific markers

I want to draw a collection of filled rectangles with the label in a center of each, and a hover box displayed when I hover over each rectangle.
I also want that the labels are completely excluded from hovering.

I tried setting hoverinfo = "none" for the labels. However, that just disables the display of hoverboxes for labels, but their bounding boxes still occlude the rectangles and prevent their hoverboxes from appearing.
Is there any way to make labels “transparent” for hovering?

Ok, I figured it out, should use hoverinfo="skip" instead of "none".