Win a copy of OCP Oracle Certified Professional Java SE 11 Programmer I Study Guide: Exam 1Z0-815 this week in the Programmer Certification forum!
  • Post Reply Bookmark Topic Watch Topic
  • New Topic
programming forums Java Mobile Certification Databases Caching Books Engineering Micro Controllers OS Languages Paradigms IDEs Build Tools Frameworks Application Servers Open Source This Site Careers Other all forums
this forum made possible by our volunteer staff, including ...
Marshals:
  • Campbell Ritchie
  • Liutauras Vilda
  • Junilu Lacar
  • Jeanne Boyarsky
  • Bear Bibeault
Sheriffs:
  • Knute Snortum
  • Devaka Cooray
  • Tim Cooke
Saloon Keepers:
  • Tim Moores
  • Stephan van Hulst
  • Tim Holloway
  • Ron McLeod
  • Carey Brown
Bartenders:
  • Paweł Baczyński
  • Piet Souris
  • Vijitha Kumara

Oozie Workflows - Strange behaviour

 
Greenhorn
Posts: 1
  • Mark post as helpful
  • send pies
  • Quote
  • Report post to moderator
I am fairly new to Hadoop so my question might be a simple one but I am hoping that someone can answer it for me

My scenario is this, I have created a workflow that forks 5 hive actions and then at the end joins them again ( the join is purely for fork/join validity)

I have then created a Coordinator that launches this workflow ever 10 minutes

When I look at the Coordinator status I see that there is 1 current action in a "RUNNING" status and an additional 4 future actions in a "WAITING" Status

When I look at the WorkFlow I can see that it has spawned 5 HIVE actions each of which are in a "RUNNING" Status

My problem is that these 5 actions remain in a running state forever, none of these hive actions ever complete and never go to SUCEEDED

Now the strange part is if I take this exact same scenario above but just change to have only 3 HIVE actions then everything works fine, the Coordinator launches the Workflow, the Workflow forks the 3 Hive actions and all 3 HIVE actions SUCCEED

What could the problem be and more importantly the solution?

I have a feeling it might be to do with resources and the various datanodes but am not sure where or what to check?

Thanks
Mark
 
CLUCK LIKE A CHICKEN! Now look at this tiny ad:
Java file APIs (DOC, XLS, PDF, and many more)
https://products.aspose.com/total/java
  • Post Reply Bookmark Topic Watch Topic
  • New Topic
Boost this thread!