Author Topic: LOAD SIMULTANEOUSLY REPORTS IN CMOD  (Read 4282 times)

Binesh

  • Guest
LOAD SIMULTANEOUSLY REPORTS IN CMOD
« on: October 01, 2010, 05:37:33 AM »
Hi

We are using CMOD 8.4.1.2 in WINDOWS 2003 server. Is there any way to make the ARSLOAD poll multiple reports simultaneously?

Any other methods to reduce the loading time.

Thanks


« Last Edit: October 01, 2010, 05:40:39 AM by Binesh »

pankaj.puranik

  • Guest
Re: LOAD SIMULTANEOUSLY REPORTS IN CMOD
« Reply #1 on: October 01, 2010, 05:56:55 AM »
One option could be to have multiple folders with files to be loaded.
Monitor each of these folders simultaneously.

Start the automated load process on each of these folders (kind of multi-threading).

Justin Derrick

  • IBM Content Manager OnDemand Consultant
  • Administrator
  • Hero Member
  • *****
  • Posts: 2231
  • CMOD Guru for hire...
    • View Profile
    • Tenacious Consulting
Re: LOAD SIMULTANEOUSLY REPORTS IN CMOD
« Reply #2 on: October 01, 2010, 08:43:55 AM »
Pankaj is right -- if you use multiple folders (some customers use one folder per Application Group) then you can run multiple instances of arsload.  Of course, this won't help you get more data into a SINGLE Application Group faster, but it will help prevent a number of small loads from being stuck behind a large load.

If you are having load performance issues, you might need to tune DB2, or look more closely at your TSM configuration.

-JD.
IBM CMOD Professional Services: http://TenaciousConsulting.com
Call:  +1-866-533-7742  or  eMail:  jd@justinderrick.com
IBM CMOD Wiki:  https://CMOD.wiki/
FREE IBM CMOD Education & Webinars:  https://CMOD.Training/

Interests: #AIX #Linux #Multiplatforms #DB2 #TSM #SP #Performance #Security #Audits #Customizing #Availability #HA #DR

Binesh

  • Guest
Re: LOAD SIMULTANEOUSLY REPORTS IN CMOD
« Reply #3 on: October 04, 2010, 12:37:01 AM »
Hi Justin/Pankaj

We are not using the OnDemand Load Data service to load reports.
We are invoking the ARSLOAD.EXE to load reports. Earlier we had faced issues of the reports not getting loaded properly however that has been rectified by modifying the TCP/IP parameters in registry.
Now we want to increase the loading speed since we would have to load around 200K reports from a single folder to a single application group.

Any suggestions.

Thanks
Binesh

Alessandro Perucchi

  • Global Moderator
  • Hero Member
  • *****
  • Posts: 1002
    • View Profile
Re: LOAD SIMULTANEOUSLY REPORTS IN CMOD
« Reply #4 on: October 04, 2010, 04:46:55 AM »
Hi Justin/Pankaj

We are not using the OnDemand Load Data service to load reports.
We are invoking the ARSLOAD.EXE to load reports. Earlier we had faced issues of the reports not getting loaded properly however that has been rectified by modifying the TCP/IP parameters in registry.
Now we want to increase the loading speed since we would have to load around 200K reports from a single folder to a single application group.

Any suggestions.

Thanks
Binesh
Hello Binesh,

from my experience, archiving to one application group means sequential. Even if you do 5 load in parallels, it will take nearly the same time as you were doing one big sequential load.
My advice would be to cut it in several application group... but that might be difficult depending on your data model...

Cheers,
Alessandro
Alessandro Perucchi

#Install #Migrations #Conversion #Educate #Repair #Upgrade #Migrate #Enhance #Optimize #AIX #Linux #Multiplatforms #DB2 #Windows #Oracle #TSM #Tivoli #Performance #Audits #Customizing #Availability #HA #DR #JavaApi #ContentNavigator #ICN #WEBi #ODWEK #Services #PDF #AFP #XML

Justin Derrick

  • IBM Content Manager OnDemand Consultant
  • Administrator
  • Hero Member
  • *****
  • Posts: 2231
  • CMOD Guru for hire...
    • View Profile
    • Tenacious Consulting
Re: LOAD SIMULTANEOUSLY REPORTS IN CMOD
« Reply #5 on: October 04, 2010, 02:31:46 PM »
If you are experiencing problems with the duration of time it takes to perform a load, you'll need to look in the following places to try and find performance enhancements:

  • Tune DB2 - increase memory usage, ensure DB2 transaction logs are on separate disks
  • Check TSM - you're not waiting for slow storage devices like optical or tape, are you?
  • AG Config in CMOD - are you using too many indexes?

I'm sure others on the forums have their own recommendations.
IBM CMOD Professional Services: http://TenaciousConsulting.com
Call:  +1-866-533-7742  or  eMail:  jd@justinderrick.com
IBM CMOD Wiki:  https://CMOD.wiki/
FREE IBM CMOD Education & Webinars:  https://CMOD.Training/

Interests: #AIX #Linux #Multiplatforms #DB2 #TSM #SP #Performance #Security #Audits #Customizing #Availability #HA #DR