• Post Reply Bookmark Topic Watch Topic
  • New Topic

Very big data structures

 
Mihai Radulescu
Ranch Hand
Posts: 918
IntelliJ IDE Java Linux
  • Mark post as helpful
  • send pies
  • Quote
  • Report post to moderator
Hi

I work on application which allows the user to change the properties for one or more objects. My problem is that the number of objects can be peaty big (10000...100000 or even more) and one change in an object can trigger changes in the other objects (e.g. a change in the first element will produce changes in all the other elements so if I deal with 10000 one small action triggers 10000 changes).

I build my self some sort of fast access data model, a List which contains Maps, this access model allows me to access the properties map where the specific property has a specific value. This works good with 1000...5000 elements but if I have more then 10000 it slows down (remember one change in one component can affect/change all the other).

My question is, there are also other solution for this problem ? (like other collection type ?)

Regards,
M
 
Pat Farrell
Rancher
Posts: 4678
7
Linux Mac OS X VI Editor
  • Mark post as helpful
  • send pies
  • Quote
  • Report post to moderator
Normally, one thinks about data structures when the collection of data fits well into memory. The amount of memory one has varies a lot, from tiny embedded systems to servers with many gigabytes of RAM.

When you stop thinking about storing it all in RAM, think database.
 
  • Post Reply Bookmark Topic Watch Topic
  • New Topic
Boost this thread!