I come from a VB background as well. I've found that the knowledge transfers really well between VB & Java. Plus, there are TONS of samples in Java but only a handful in VB.
I did a lot of VB programming, and later Visual Basic for Applications. It is all pretty much the same thing, although there are some syntax differences that can trip you up. No big deal to switch.