Apache has an HTTP web server. It is very popular for languages like PHP.
But, the Container that you are probably referring to is Apache Tomcat which is different in the sense that it understands how to process JSP/Servlets. You also need the jar file (servlet-api.jar) that contains the classes and interfaces required for JSP/Servlet development.
Tomcat provides you with additional services like Threading, Security,
servlet life cycle, logging, etc
Finally, there is J2EE Server that you use for your EJB deployment. Glassfish server is an example. It also provides additional EJB specific services including Transaction Management, Life cycle management, etc.