Author Topic: CFSODExporter  (Read 3444 times)

jeffs42885

  • Guest
CFSODExporter
« on: September 29, 2014, 01:29:58 PM »
Greetings all,

Came across a situation last weekend with loading a very large file into CMOD, that federates into P8. Just to preface, we use the Crontab to kickoff the exporter to federate from CMOD to P8 every 5 minutes.

The business loaded a file with 1.2 Million rows and I believe it was federating 5000 at a time, causing the process to run out of control, at one point there was several instances of the exporter running. The OOM on the machine kicked in and killed other services which brought down ICN/P8.

Has anyone ever used Tivoli Scheduler to run CFSODExporter? I don't like using the Crontab. And I am not aware of any other scheduling systems in play - aka autosys or something like that.

Justin Derrick

  • IBM Content Manager OnDemand Consultant
  • Administrator
  • Hero Member
  • *****
  • Posts: 2230
  • CMOD Guru for hire...
    • View Profile
    • Tenacious Consulting
Re: CFSODExporter
« Reply #1 on: September 30, 2014, 03:36:49 AM »
Generally speaking, it's best if you can write a script that is aware of itself -- that is, the process writes it's own Process ID (PID) to a file, and all future iterations of the code looks for that file, reads it's contents, then checks for a running process ID with that number.  If it can't find a running process with that ID, it overwrites the PID, and starts.  If it DOES find another live process with that ID, it just exits quietly.

That's a quick and dirty way to prevent the type of runaway process you sometimes get with cron.

-JD.
IBM CMOD Professional Services: http://TenaciousConsulting.com
Call:  +1-866-533-7742  or  eMail:  jd@justinderrick.com
IBM CMOD Wiki:  https://CMOD.wiki/
FREE IBM CMOD Education & Webinars:  https://CMOD.Training/

Interests: #AIX #Linux #Multiplatforms #DB2 #TSM #SP #Performance #Security #Audits #Customizing #Availability #HA #DR

jeffs42885

  • Guest
Re: CFSODExporter
« Reply #2 on: September 30, 2014, 10:40:56 AM »
I think we are trying to push them down the path of using the enterprise scheduling solution, since they have it.

This isn't CMOD related at all but I am trying to figure out how it queues things, say for example we have a a script to run hourly, but it takes an hour and a half before it sends the exit 0, does the next scheduled run take place?

Frederick Tybalt

  • Full Member
  • ***
  • Posts: 124
    • View Profile
    • Personal Website
Re: CFSODExporter
« Reply #3 on: October 06, 2014, 01:44:02 AM »
crontab does not validate for the return codes and start the next thread. Instead it runs the process in the interval it is scheduled with out any validation. As said by JD application needs to validate the status of previous runs when process are triggered on crontab.
rIcK
======------------------======
www.rick.co.in | www.tekbytz.com