Those are probably a consequence of beveling the edge, the messy geometry comes out for free. You can always try it out on simpler geometry as a test, so you can start noticing how it behaves.
I noticed the same. Just popped up suddenly in Kaizens video. I just left the initial bevel and extrude as is and applied the bevel weight with the same result.