JForum 2.3 has seen numerous bug and security fixes as well as new features. The page I pointed you to has the release notes, so you can judge for yourself whether that amounts to "big differences" in your mind. Given that JForum 2.1 is dead, the security fixes alone make it a no-brainer to use the newer version, IMO.