Author Topic: Ingestion via Daemon  (Read 4586 times)

jeffs42885

  • Guest
Ingestion via Daemon
« on: March 20, 2014, 06:15:56 AM »
Hello,

We are looking to ingest files into OnDemand as they get dropped on to a share. All of our application groups have the same name as the application, and that will always be the case

I am wondering if a simple ARSLOAD daemon can handle this?

arsload -nfv -I instance-g AGROUP /files/software/tood/APP.1234123.123421 -t 120 &

or something like

arsload -nvf -I instance -g AGROUP /files/dropoffdirectory -t 120 &

Thoughts

swat_is_back

  • Guest
Re: Ingestion via Daemon
« Reply #1 on: March 20, 2014, 10:56:33 AM »
I would say that use the MVS dataset option -A and -G and have the naming convetion is such a way that with the file name the application group is being determined.
dig more into ARSLOAD options.

jeffs42885

  • Guest
Re: Ingestion via Daemon
« Reply #2 on: March 20, 2014, 12:00:46 PM »
I have been dealing with a few options so far for this and since the file name wont have a .ARD I cant run it in daemon. I will probably just shell script it to run every 120sec or so.

files will come down to directory xyz named as JEFFTEST1234.1241234.12341243

Application and Application group are both setup as JEFFTEST1234

jeffs42885

  • Guest
Re: Ingestion via Daemon
« Reply #3 on: March 25, 2014, 02:56:32 PM »
Almost where I need to be :) Just need some feedback/help!

arsload -vf -I instance -AMVS -g JEFFTEST -d /opt/ecm/jeff -t 60 & <-This works when I specify the application group. I tried JEFFTEST.ARD, JEFFTEST.1234.12342134.ARD, JEFFTEST.12341234.1241234.21341234.ARD, etc.

It's not efficient to have a daemon running for each application group in the system, and I have tried a variety of -A/-G combos, yet nothing works..Still says that it cannot determine the application group. I have also referred to the documentation.

rick

  • Guest
Re: Ingestion via Daemon
« Reply #4 on: March 25, 2014, 10:05:34 PM »
I guess, this happens as -g is hard coded in the daemon. Can you try this too?

arsload -vf -I instance -A MVS -G MVS -d /opt/ecm/jeff -t 60 &

jeffs42885

  • Guest
Re: Ingestion via Daemon
« Reply #5 on: March 26, 2014, 05:15:51 AM »
Tried that a few times.

[admin@hostjeff]$ arsload -vf -I instance -A MVS -G MVS -d /opt/ecm/jeff -t 60 &
[3] 1190
[admin@hostjeff]$ ARS4336I The arsload instance instance is ready
ARS4315I Processing file >/opt/ecm/jeff/JEFFTEST.ARD<
ARS1110E The application group >< does not exist or user >admin< does not have permission to access the application group
ARS4318E Processing failed for file >/opt/ecm/jeff/JEFFTEST.ARD<
ARS4324E File >/opt/ecm/jeff/JEFFTEST.ARD< renamed to >/opt/ecm/jeff/JEFFTEST.ARD.Failed<.  Correct problems and resubmit file.

Greg Ira

  • Full Member
  • ***
  • Posts: 240
    • View Profile
Re: Ingestion via Daemon
« Reply #6 on: March 26, 2014, 10:49:07 AM »
I'm assuming MP CMOD has this(I use z/OS) but did you try the -B parm?
  -B  "AG.IGN.IGN.IGN.EXT"

used to load JEFFTEST.1234.1234.1234.ARD   

Leave out the -g


Strike that, just checked and it looks like MP ARSLOAD doesn't have this.
« Last Edit: March 26, 2014, 10:58:53 AM by Greg Ira »

LWagner

  • Guest
Re: Ingestion via Daemon
« Reply #7 on: March 26, 2014, 03:02:28 PM »
The CMOD Configurator program will read up to 10 load directories on any one server.

Better, IMHO, to use one directory, and load all reoports there for ingestion.

We use three index servers to upload up to 900 container PDFs of 200 bills in three hours or less, to CMOD on AIX.

jeffs42885

  • Guest
Re: Ingestion via Daemon
« Reply #8 on: March 27, 2014, 06:14:43 AM »
We figured this out, I was using a bad input file name, in my case I had to use the -B flag, and viola....87s!

kasim

  • Guest
Re: Ingestion via Daemon
« Reply #9 on: May 29, 2014, 10:26:20 PM »
Hi jeffs

I am facing same problem please chk my post
http://www.odusergroup.org/forums/index.php?topic=1387.0
thanks