Is functionality of {'visible': 'legendonly'} in custom button 'arg'/'arg2' editable?


I’m working with custom buttons to toggle visibility of clusters in a UMAP (scatter) plot.

When the button’s ‘arg2’ is set to {‘visible’: ‘legendonly’} like in my code below

button2 = dict(method='restyle',
               args2 = [{'visible': 'legendonly'}],

the result when the ‘All’ button is pressed is this:

How can I make it so that when groups of points are in ‘legendonly’ visibility, that the legend labels (numbers) are visible and interactive but the legend marker points are not visible? Like in this mock-up I made below:

Thanks in advance.