You could use a JSplitPane, but that deals only with two components. So, to achieve the effect shown, you need to split those components into one or more components themselves. But you don't need per se a JSplitPane, you can set a decent LayoutManager that can handle more then just one other panel. FlowLayout, GridLayout, BorderLayout, et cetera. So do have a look at the Oracle tutorial about LayoutManagers:
layout managers