I actually sort of have the reverse problem, or at least I did (I took Spanish in high school and freshman college, but that was a while ago and I am really, really rusty.)
My problem was that, despite living in the US, where Latin American Spanish is the common form, it so happens that, by coincidence, all of my Spanish teacher were actually from Spain, so I wound up with a pretty distinct Castilian accent. It wasn't a big deal in school (since everyone else had the same teacher, and therefore the same accent), and most people are OK with it, but there are some SA Spanish speakers who react a bit funny to it (in some Spanish speaking circles, speaking with a Castillian accent sort of gets the same reaction that speaking with a British accent with English when you're not actually British; it's considered by some pretentious and sort of "talking down" to them.)