I had a similar experience in Caracas, Paul. And I had a degree in Spanish! But with zero contact with Latin American Spanish, either written or spoken.
About all I understood was when I told the taxi driver I was heading on to the east of the country, Oriente, and he said 'Oh, you'll find it hard to understand them there - they speak really fast!'.
This is a really useful article for learners, I think, offering an accessible and practical way to improve their skills.