Pass in outlier points to precomputed box plot

Creating box plots derived from millions of points requires pre-calculating quartile stats as outlined here: https://plot.ly/python/box-plots/#box-plot-with-precomputed-quartiles

works great, and in a simple case with one box per axis point it’s easy to overlay a scatter trace with outlier points if desired. In a grouped case with multiple boxes per axis point I have found no way to align a scatter trace to each box trace. Is there a way to pass outlier points to a Box trace directly so it can self align or somehow offset scatter trace positions to box trace offsets?

image

It would be useful to pass over a set of outlier points