Member Avatar for Rocky_6

I'm looking for help on CloudFormation Template for Glue Jobs orchestration for below scenario:

Suppose I have 10 AWS Glue Jobs, 4 jobs should be executed parallel and 6 jobs should be executed sequentially. If any job failure, send Workflow "Failure" notification along with the failed Glue Jobname.

Job1 Job2----job5-->job6-->job7 job3 job4--->job8-->Job9-->job10

Thanks in Advance.. I really appreciate, for your help !!!

  • 2 Contributors
  • 1 Reply
  • 34 Views
  • 10 Hours Discussion Span
  • Latest Post Latest Post by rproffitt
Member Avatar for rproffitt

It appears no one can answer for many reasons. No one can guess if you are using the nice visual AWS Glue Studio or you were trying to do this in hard core script. If you were trying to do this in script you would share the script for all to see. Frankly I'd stick to AWS Glue Studio.

Be a part of the DaniWeb community

We're a friendly, industry-focused community of developers, IT pros, digital marketers, and technology enthusiasts meeting, networking, learning, and sharing knowledge.