This question is way too open ended - A web GUI, a desktop GUI? Create,delete,edit,upload - what? where?
As far as Spring supporting these - yes - Spring can work in desktop apps and web apps. Your model and data layer will be more responsible for implementing "create, delete, edit, upload" - but Spring can control how method calls are wired together to call these through other classes, or provide Spring enabled "template" classes if you're using something like
JDBC or Hibernate.
As for where to learn more about Spring - the
Spring MVC step-by-step tutorial (uses both core Spring and Spring MVC web framework) and the
Spring Reference Documentation is probably the best place to start.