I did eventually realize that it was the intersecting edges from overlapping polygons that caused the mysteriously bizarre output.
PS. I'll also mention that I created the output using libshapefile, loading it in QGIS and just taking a screenshot. So I guess there are a few steps where something could go awry.
Running on Linux and using Boost master branch except for geometry where I'm using develop.