Well, you could constrain the label's width with AutoMinWidth/AutoMaxWidth, stopping it from resizing.

The problem, though, would be if you were using the gripper to move the label, which I suspect you are.

You could use (label)Cursor (pathtocursor), but that would probably go off for the whole label, and not just the area you want.