I think it is a good idea to try and figure out how to add a JButton to a Jtable as a way for you to learn. However, it isn't really necessary for you to do this for the assignment. So if you get frustrated and can't figure it out, don't feel bad.
Where do you add the ActionListener code?
Mark