they are not native to north america but can spread or escape from gardens or be moved around by animals, wind, water, soil...
as a two year plant they don't seem to persist in many areas unless there is some kind of soil disturbance and the native plants are not apex forest trees.
that said, i just double checked myself and yes, they are determined to be invasive, so gotta keep an eye on them where you plant them (they haven't become so here because i've removed a lot of them in the past 20yrs but also rust disease took them down quite a bit).