Win a copy of Murach's Python Programming this week in the Jython/Python forum!
  • Post Reply Bookmark Topic Watch Topic
  • New Topic

Process Thread Relation  RSS feed

 
Ganesh Malaichamy
Greenhorn
Posts: 27
  • Mark post as helpful
  • send pies
  • Quote
  • Report post to moderator
Hi,

I am planning for a database synchronization tool which need to move a set of data from production server to test server.I am expecting load of some 50,000 to 1,00000 records from various tables.
If i intend to do it in a generic way to handle more load than that,
1) Do i need to create multiple threads from a single java application or
2) Create a several process(java program) which will have limited threads (like clusters)
3) Whats the better alternative to handle this type of scenario.

Which model will have more scalability if the load is huge?

Kindly let me know this.

Thank you.




 
Nitesh Kant
Bartender
Posts: 1638
IntelliJ IDE Java MySQL Database
  • Mark post as helpful
  • send pies
  • Quote
  • Report post to moderator
Which database are you using?
All databases come with a replication setup that can be used to keep multiple databases in sync. I am not aware of a valid reason why you would want to do it yourself programmatically.
 
Ganesh Malaichamy
Greenhorn
Posts: 27
  • Mark post as helpful
  • send pies
  • Quote
  • Report post to moderator
Hi Nitesh,

Thanks for the response.Replicating the database is out of the choice.The database is too huge and that too the datas are real time production data which cannot be shared.
I tried some open source tool used in database migration.But they are pulling the data from the selected table.But i need the complete chain of that data ( foreign key data fully) for a consistent update.DB2 and oracle are used. I planned to use jdbc libraires to move the data.


Regards
Ganesh M
 
Wouter Oet
Bartender
Posts: 2700
IntelliJ IDE Opera
  • Mark post as helpful
  • send pies
  • Quote
  • Report post to moderator
What is the size of your database? Because a table with 100.000 rows is absolutely nothing for a database such as Oracle and DB2.

And why do you think that you can implement it in a better way then the creators of the databases? Just look for synchronization or replication.
 
Ganesh Malaichamy
Greenhorn
Posts: 27
  • Mark post as helpful
  • send pies
  • Quote
  • Report post to moderator
Hi,

The datas are real time production data which cannot be shared and also we need the subset of data with referentially intact row-sets from the production server. I agree that the synchronization and replication are standard approaches to have the same data .But for some business reasons those options are ruled out. I found a open source tool which is doing the same.http://jailer.sourceforge.net/. Thank you for the response.
 
With a little knowledge, a cast iron skillet is non-stick and lasts a lifetime.
  • Post Reply Bookmark Topic Watch Topic
  • New Topic
Boost this thread!