Solved, since the dragcover layer that is created during zooming and dragging does not allow events to pass to the elements that are below, especially to the containing layer, so we trap the dracover events and pass them to the container in this way I can now move the labels on axes while dragging
this.layer.onmousedown = e => {
if(e.layerX > 0 && e.layerX <= this.width && e.layerY > 0 && e.layerY <= this.height) {
document.querySelector(".dragcover").onmousemove = e => {
this.layer.dispatchEvent(new MouseEvent("mousemove", e))
The dragcover is created at the mousedown of the containing layer, so there we take the opportunity to add a listener to the mousemove of the dracover and pass the event to the mousemove of the container
The only problem left is to ensure that the stickies are not hidden when dragging