• Post Reply Bookmark Topic Watch Topic
  • New Topic

Database for Storing info from hdf5  RSS feed

 
Tom Storm
Ranch Hand
Posts: 31
Fedora Firefox Browser Java
  • Mark post as helpful
  • send pies
  • Quote
  • Report post to moderator
Hi there,

I'm working with the sample of the one million song dataset. I have found and edited code to take the data from the hdf5 format and then write it to a text file. However, I would now like to add it to a table and then search through it for common factors. It doesn't have to have GUI components like JTable. Is JTable what I'm looking for or do I need a more powerful solution. It's 10000 rows with around 8 columns each I think. It's 2.5GB uncompressed.

Thanks to all who reply.
TS
 
Ulf Dittmer
Rancher
Posts: 42972
73
  • Mark post as helpful
  • send pies
  • Quote
  • Report post to moderator
I'm confused. You state "It doesn't have to have GUI components like JTable" and then proceed to ask "Is JTable what I'm looking for". Are you or are you not looking to build a GUI? If you are, is the GUI for displaying data, or is it for the search GUI?

Also, what data is this? It's hard to see how a mere 80000 data values amount to 2.5GB of data (unless there is a lot of text in it). And according to what criteria do you intend to search it?
 
Tom Storm
Ranch Hand
Posts: 31
Fedora Firefox Browser Java
  • Mark post as helpful
  • send pies
  • Quote
  • Report post to moderator
My apologies if I caused confusion. I do not need a GUI in my program. However if JTable would work I have no problem implementing it. The collection of hdf5 files amounts to 2.5GB. I am currently able to take data from those files and I would like to write it to a table that I can then filter. The following link shows the columns in that data - http://labrosa.ee.columbia.edu/millionsong/pages/example-track-description. I would like to be able to filter for certain similarities within that table. In conclusion I would like the best method of storing this data and then being able to search through it.
Thanks.
TS
 
Ulf Dittmer
Rancher
Posts: 42972
73
  • Mark post as helpful
  • send pies
  • Quote
  • Report post to moderator
So by "table" you mean a DB table? If so, you can use the JDBC API both for storing the data in the DB, and for selecting/filtering those items that are of interest: http://docs.oracle.com/javase/tutorial/jdbc/index.html
 
Tom Storm
Ranch Hand
Posts: 31
Fedora Firefox Browser Java
  • Mark post as helpful
  • send pies
  • Quote
  • Report post to moderator
I'll try writing that.
Thank you,
TS
 
Consider Paul's rocket mass heater.
  • Post Reply Bookmark Topic Watch Topic
  • New Topic
Boost this thread!