It's an issue with using VB. In VB the creation of the annotation has to be separate from setting its properties.
For instance, if you take the code above and change the type from "highlight" to "circle" and remove the quads property, it will make a perfect, fully functional circle annotation. It's what I'm using now until something better comes along.