Author Topic: Supressing messages to System Log/ System Load  (Read 2926 times)

pankaj.puranik

  • Sr. Member
  • ****
  • Posts: 374
    • View Profile
Supressing messages to System Log/ System Load
« on: June 04, 2013, 04:22:24 AM »
Hi

When we are doing high volume loading, the process bottlenecks at the System Log/System Load.
This happens from what I understand because the loading to App Group (system log/load) is sequential.

So the threading I do in my shell script to ensure that at any gives point in time each thread is loading data into a different app group doesnot help to improve loading performance as it would anyway bottleneck at system log/load app group.

Then I suppressed all the messages that are logged to system log.
But I still see 87, 88 and 329 message numbers.

Is it possible to completely stop this logging?

Note that we are doing historical data loading and would switch on loading when we start day forward stuff.

Thanks
Pankaj.

pankaj.puranik

  • Sr. Member
  • ****
  • Posts: 374
    • View Profile
Re: Supressing messages to System Log/ System Load
« Reply #1 on: June 04, 2013, 08:53:37 AM »
See it tool 12 seconds to load this small file.

05/31/2013 03:06:13   ADMIN         37840   Info   Yes       87   Application Group Load: Name(Loans) LoadId(5162-0-0-17FAA-15840-15840) File(/cfsc/RM/scripts/tempDir/21823576/pcit0030.alpha.20130514.20130514.121212.927679.batch.rpt) InputSize(10760) OutputSize(2016) Rows(1) Time(11.8640) Appl(xxxxxxxxxxxxxxxxx)   
05/31/2013 03:06:13   ADMIN         37840   Info   No       32   Logoff   
05/31/2013 03:06:07   ADMIN         37840   Info   No       82   Application Group Object Store: Name(Loans) Agid(5162) NodeName(-CACHE-) Nid(0) Server(-LOCAL-) ObjName(17FAAA) Time(0.003)   
05/31/2013 03:06:07   ADMIN         37840   Info   No       86   Application Group Load Database: Name(Loans) Agid(5162) Rows(1)   
05/31/2013 03:06:07   ADMIN         37840   Info   No       82   Application Group Object Store: Name(Loans) Agid(5162) NodeName(-CACHE-) Nid(0) Server(-LOCAL-) ObjName(17FAA1) Time(0.002)   
05/31/2013 03:06:01   ADMIN         37840   Info   No       30   Login: xxxxxxxxxxxxxxxxxxxxxxxxxxxxx non-SSL (AIX) (ARSLOAD) (8.5.0.5)   

Frederick Tybalt

  • Full Member
  • ***
  • Posts: 124
    • View Profile
    • Personal Website
Re: Supressing messages to System Log/ System Load
« Reply #2 on: June 05, 2013, 04:11:09 AM »
I guess using arsadmin load skips the 87/88 messages in system log and 82/86 messages can be turned off from AG settings.
rIcK
======------------------======
www.rick.co.in | www.tekbytz.com

Justin Derrick

  • IBM Content Manager OnDemand Consultant
  • Administrator
  • Hero Member
  • *****
  • Posts: 2230
  • CMOD Guru for hire...
    • View Profile
    • Tenacious Consulting
Re: Supressing messages to System Log/ System Load
« Reply #3 on: June 05, 2013, 06:41:51 AM »
Are you using DB2 HADR?

You can also reduce the amount of logging per-Application Group by unchecking the logging for Object Store and Object Retrieve.

Can you paste in the output from arsload?  That will tell us where the bottleneck is (indexing vs. loading).

Also, try to get a database snapshot (or read the diagnostic log) for those 12 seconds, to see if there are any deadlocks, either in the AG or the System Log.

-JD.
IBM CMOD Professional Services: http://TenaciousConsulting.com
Call:  +1-866-533-7742  or  eMail:  jd@justinderrick.com
IBM CMOD Wiki:  https://CMOD.wiki/
FREE IBM CMOD Education & Webinars:  https://CMOD.Training/

Interests: #AIX #Linux #Multiplatforms #DB2 #TSM #SP #Performance #Security #Audits #Customizing #Availability #HA #DR

Alessandro Perucchi

  • Global Moderator
  • Hero Member
  • *****
  • Posts: 1002
    • View Profile
Re: Supressing messages to System Log/ System Load
« Reply #4 on: June 19, 2013, 02:00:46 AM »
Hello Pankaj,

just a small question, do you use also the "arslog"?, if yes it could also have an influence in the time for logging. And maybe to "deactivate" it could also help.

Sincerely yours,
Alessandro
Alessandro Perucchi

#Install #Migrations #Conversion #Educate #Repair #Upgrade #Migrate #Enhance #Optimize #AIX #Linux #Multiplatforms #DB2 #Windows #Oracle #TSM #Tivoli #Performance #Audits #Customizing #Availability #HA #DR #JavaApi #ContentNavigator #ICN #WEBi #ODWEK #Services #PDF #AFP #XML