As a side note to this, I have to say that it is very difficult for me to hover over the X to even click it.
The hit-box is quite small, and I don't think that it changes when you switch the marker style (that is, switching to the Rectangle or VerticalLine still has the same, small click area.)