Search...
FAQs Subscribe
Pie
FAQs
Recent topics Flagged topics Hot topics Best topics
Search...
Search within hadoop Search Coderanch
Advance search Google search
Register / Login
thread boost granny book review grid advertise on coderanch polymorphism
Win a copy of Cloud Application Architecture Patterns: Designing, Building, and Modernizing for the Cloud this week in the Cloud/Virtualization forum!
  • Post Reply Bookmark Topic Watch Topic
  • New Topic
programming forums Java Mobile Certification Databases Caching Books Engineering Micro Controllers OS Languages Paradigms IDEs Build Tools Frameworks Application Servers Open Source This Site Careers Other Pie Elite all forums
meaningless drivel building better world book thread boost advertise on coderanch book review grid
this forum made possible by our volunteer staff, including ...
Marshals:
  • Campbell Ritchie
  • Tim Cooke
  • paul wheaton
  • Paul Clapham
  • Ron McLeod
Sheriffs:
  • Jeanne Boyarsky
  • Liutauras Vilda
Saloon Keepers:
  • Tim Holloway
  • Carey Brown
  • Roland Mueller
  • Piet Souris
Bartenders:

Data Validation in Hive

 
syruss kumar
Ranch Hand
Posts: 108
posted 7 years ago
  • Mark post as helpful
  • send pies
    Number of slices to send:
    Optional 'thank-you' note:
    Send
  • Quote
  • Report post to moderator
Hi All,

In our application we are migrating huge volume of data from teradata to Hive.
Need to validate the data between source and target.We are planning to do it using python & pandas dataframe.
My queries are
1.Will pandas data-frame can handle around 15 million of data ?
2.Is there any other way to do it ?

What is the best way to achieve the above using python ?

Thanks in advance

All search starts with beginner's luck and all search ends with victor's severly tested.

 
wood burning stoves
reply
reply
    Bookmark Topic Watch Topic
  • New Topic
Boost this thread!
Similar Threads
More...