Add multiindex to annotated_heatmap

What I want is to make an annotated heatmap looks like the following (any function is ok)

number of rows varies sometime.

I know how to make a heatmap with create_annotated_heatmap function, but only a heatmap with a single index

Any solution?