Welcome to JavaRanch.
That depends on what you want to do with it
Are you building a third-party project that happens to use POI, or do you want to use the API yourself for something? But in general, just putting it into your classpath (or lib directory, in the case of Ant) should be sufficient.