Parallel Processing

Discussion of Dovetailed Technologies Dataset Pipes tools
Post Reply
mmulconry
Posts: 2
Joined: Mon Oct 01, 2018 2:53 pm

Parallel Processing

Post by mmulconry » Mon Oct 01, 2018 2:59 pm

Is it possible to execute multiple file transmissions to the same mainframe host in parallel? In other words can I do something like:

cozcontrol start -t user@hostname.com
todsn //DATA.SET.ONE < file.one &
todsn //DATA.SET.TWO < file.two &
<wait until the todsn commands are done >
cozcontrol stop

(note: the above is just for illustration)

Thanks,
Mark Mulconry

dovetail
Site Admin
Posts: 1856
Joined: Thu Jul 29, 2004 12:12 pm

Re: Parallel Processing

Post by dovetail » Mon Oct 01, 2018 4:05 pm

Sure. Have you tried it and had a problem?

You can use multiple concurrent processes in all kinds of ways.
For example:
cozcontrol start -t -ssh user@host.com
fromdsn //data.set.one | grep "something" | todsn //data.set.one.subset
This is running fromdsn, grep, and todsn in three separate processes concurrently, connected by a pipe.

mmulconry
Posts: 2
Joined: Mon Oct 01, 2018 2:53 pm

Re: Parallel Processing

Post by mmulconry » Tue Oct 02, 2018 7:30 am

We're trying it, the issues we've run into were from issuing the cozcontrol stop before the forked processes were finished. We found a way to do that now so we're redoing our script and will continue testing.

Just wanted to make sure there weren't any issues from the product perspective...

Thanks for the prompt reply!

Post Reply