Topics

16

Report Indexing / Issues with PPDs + Resources

« on: August 08, 2023, 03:35:23 PM »

We are seeing an issue with PDFs with our last month-end run. PDF files are now being returned with the full resource block for the entire file. About 35 MB worth, even though the PDF itself is only around 170KB. There is also now a fear of NPI data breach.

Example - Customer XYZ is picking up a resource that should only be shown to customer ABC.

We're using PPD's for this:

INDEXSTARTBY=1
RESTYPE=ALL
INDEXMODE=INTERNAL
REMOVERES=YES
BOOKMARKS=NO

Has anyone seen this before.. or does anyone have any suggestions?

Thanks

17

z/OS Server / ARSMAINT - Catchup after migration

« on: July 11, 2023, 12:55:03 PM »

Hi All,

we are planning on running arsmaint after not running it for a few months - due to moving to a new Z/OS platform.

Is there any way to "Simulate" a document count of what would be expired..if that makes sense.

We plan on just using arsmaint -d -g <app group>

We'd like to know how much we have to get caught up on.

Thanks!

18

z/OS Server / Is it possible to run arstblsp remotely against ZOS?

« on: April 18, 2023, 07:11:34 AM »

Our use case is that us CMOD Devs occasionally will need to view open tables, close tables - etc. And currently we need to engage our Z/OS DB2 folks.

I have my library server running on Z/OS, and a utility server that has CMOD, the database cataloged, etc.

I can connect to the database with an instance that was setup on the box, no issue - view all the tables, etc.

db2 connect to CMODDEV user <guestpass> using <password>

Within ARS.ini- I defined the INSTANCE as CMODDEV and the instance owner as archive (the local instance on the box)

I added the Z/OS DB2 guestpass/userid to the stash file - and within ars.ini - I am pointing to that stash file.

I switch to the archive user and here's what I get (Just trying to view now, for a POC..)

Code: [Select]

[archive@server ~]$ arstblsp -a 3 -g APPGROUP -h CMODDEV
ARS0013E DB Error: [IBM][CLI Driver][DB2] SQL0204N  "SYSIBMADM.DBCFG" is an undefined name.  SQLSTATE=42704  -- SQLSTATE=42S02, SQLCODE=-204, File=arssys.c, Line=332
ARS1107E An error occurred.  Contact your system administrator and/or consult the System Log.  File=arstblsp.c, Line=1929

19

Report Indexing / Ignore 2GB File Limit with Daemon

« on: April 10, 2023, 11:50:33 AM »

Hi All,

Just wondering if anyone is using:

Code: [Select]

ARS_LOAD_IGN_2GB_DOCUMENT_LIMIT_ERROR=1
With a load daemon - Or if this is something that we can specify in ars.cfg? We currently have to manually execute it every time we go to load a certain subset of files.

Would an

Code: [Select]

export ARS_LOAD_IGN_2GB_DOCUMENT_LIMIT_ERROR=1 in the profile that runs our load Daemon also work?

Thanks!

20

Report Indexing / Failure with special character

« on: March 02, 2023, 06:25:01 PM »

We have an issue when loading a name field.

 ARS1127E Row 1:  The string "JUAN CARLOSÑORTEGA                                               " has a length of 83 and the field has a maximum length of 80

The special character added by what I am assuming the "Ã" is causing the field to spill into 83 characters. I've tried removing space, removing tab, etc.

the only fix that I was able to get working in a "timely" matter - is recreate the AG, and for the field info:

String: Case(Mixed)
Type: Variable

IBM suggested that - But I am wondering if anyone knows of a way to do it at the application level so I don't have to recreate an application group.

21

MP Server / Sample Post Processor - Email when a file loads

« on: January 10, 2023, 07:46:49 AM »

Hi all.

We got a request for when a file loads - to drop an email.

In the past this is simple, since we use shell scripts to dual load. Since we use to Z/OS - We don't dual load.. We use daemons.

We also have limited access to "arslog" since it runs on our Z/Os box- and that'd require getting our mainframe folks - Which is--needless to say, difficult.

Does anyone have a suggestion as to a post processor script - That I can create/execute at the application level that basically will dispatch an email and say - Hey! This file loaded.

Even if its something simple-

Code: [Select]

#!/usr/bin/bash

mailx -something blah blah File.ARD - loaded
Thanks!

22

MP Server / Filtering out/handing file failures

« on: December 12, 2022, 08:27:43 AM »

We see files that fail, for whatever reason - Usually due to inconsistent data being sent by our business partners.

ARS1127E Row 1:  The string "12345" has a length of 5 and the field has a maximum length of 4
ARS1129E Row 3:  The string "" could not be converted to a date from the format of %m/%d/%Y %H:%M:%S
ARS4309E Indexing failed
ARS1112E Unable to open the file >/files/dropoff/ondemand/CS01.SHARE.BANKING.BANKING.20221201.003834.ARD.out<

We need to report these failures back to our business partners just so they can handle them.

Does anyone have a systematic way of handling large amounts of file failures, easily determining what they are? I cant figure out an easy way - Since these '88' messages are essentialy stored as documents.

Perhaps an enhancement request - an additional folder field in the system log to log any error codes - for easy searching.

Example - ARS1129E correlates, to invalid date.

Thanks all.

23

MP Server / Filtering out/handing file failures

« on: December 12, 2022, 08:26:24 AM »

We see files that fail, for whatever reason - Usually due to inconsistent data being sent by our business partners.

ARS1127E Row 1:  The string "12345" has a length of 5 and the field has a maximum length of 4
ARS1129E Row 3:  The string "" could not be converted to a date from the format of %m/%d/%Y %H:%M:%S
ARS4309E Indexing failed
ARS1112E Unable to open the file >/files/dropoff/ondemand/CS01.SHARE.BANKING.BANKING.20221201.003834.ARD.out<

We need to report these failures back to our business partners just so they can handle them.

Does anyone have a systematic way of handling large amounts of file failures, easily determining what they are? I cant figure out an easy way - Since these '88' messages are essentialy stored as documents.

Perhaps an enhancement request - an additional folder field in the system log to log any error codes - for easy searching.

Example - ARS1129E correlates, to invalid date.

Thanks all.

24

Content Navigator / Creating profile to deploy ICN

« on: November 29, 2022, 08:32:06 AM »

Hi All,

I've done this before - But I dont remember the steps 100%

I am trying to setup ICN on my cloud environment. I installed WAS no issues. I am trying to create a profile.

Does anyone have the steps as to which type of profile to setup. When I run configmgr - it does not find the defined cell. I am not sure if there's a port thats not open on the GCP side or what.

Thanks all

25

MP Server / Anyone using native google storage"

« on: November 15, 2022, 09:43:12 AM »

Just wondering if anyone is storing directly to google buckets.

Looking for the goods/the bads - and if anyone can share some possible experiences.

thanks!

26

Report Indexing / Possible Issue with PPD's

« on: October 14, 2022, 08:21:19 AM »

We are getting large files from Open Text, and they are failing. Here's the issue:

: ARS4919E Word search or extraction error
: ARS4923E ArspSearchDocPages error code 536936462 Expected a dict object.
: ARS4902I Number of input pages = 1876598
: ARS4922I ARSPDOCI 10.5.0.4 completed code 4
2022-10-13 13:17:05.535722: ARS4309E Indexing failed
2022-10-13 13:17:05.535771: ARS4318E Processing failed for file

Based on the sample PPD that is provided based in the documenation, I noticed in our PDF that the one field, which is a name field..Is not completed properly. Notice CustomerName

Code: [Select]

/PieceInfo <</IBM-ODIndexes <</Private


                                <</DocId(AAA)
                                 /BankNumber(0000000001)
                                 /AcctNumber(00000000000111111111)
                                /CustomerName(David Robertson &
                                 /NoticeType(W)
                                 /StmtDate(20120507)
                                >>
                               /LastModified(D:20120619000000Z)
                        >>
                >>
Can this cause an issue with the PDF Indexer failing?

27

MP Server / ARSLOAD Return Codes

« on: October 04, 2022, 08:21:41 AM »

I am creating a script that loads some files, and moves things around after load.

I was tinkering around with a basic rc=$?; echo $rc after arsload and heres what I am seeing:

Code: [Select]

ARS1609W Specifying passwords on the command line is not secure due to the text being visible. See the Installation and Configuration Guide for your platform for information about the arsstash command or using Unified Login.
ARS1106E Connection cannot be established for the >wrongserver< server
2
so based on this, I'd assume that rc2 = connection issue

And then of course - here's the winner.

Code: [Select]

ARS1609W Specifying passwords on the command line is not secure due to the text being visible. See the Installation and Configuration Guide for your platform for information about the arsstash command or using Unified Login.
0

28

Report Indexing / RC 0 with ACIF/Line - File still fails

« on: September 27, 2022, 09:33:26 AM »

We're trying to load a line data file, V10.5, loading from RHEL into Z/OS, db2 of course. Anyone have thoughts.

Code: [Select]

2022-09-27 10:30:02.385741: ARS4302I Indexing started, 5738 bytes to process
                          : APK415I CC=YES
                          : APK415I CCTYPE=A
                          : APK415I CONVERT=NO
                          : APK415I CPGID=500
                          : APK415I MCF2REF=CPCS
                          : APK415I TRC=NO
                          : APK415I FILEFORMAT=RECORD
                          : APK415I TRIGGER1=*,100,X'D9E4D540C4C1E3C5',(TYPE=GROUP)
                          : APK415I FIELD1=0,110,10,(TRIGGER=1,BASE=0)
                          : APK415I FIELD2=4,67,10,(TRIGGER=1,BASE=0)
                          : APK415I INDEX1=X'D9C481A385',FIELD1,(TYPE=GROUP,BREAK=YES)
                          : APK415I INDEX2=X'C5C481A385',FIELD2,(TYPE=GROUP,BREAK=YES)
                          : APK415I DCFPAGENAMES=NO
                          : APK415I UNIQUEBNGS=YES
                          : APK415I IMAGEOUT=ASIS
                          : APK415I INDEXOBJ=GROUP
                          : APK415I INDEXSTARTBY=1
                          : APK415I INSERTIMM=NO
                          : APK415I RESTYPE=NONE
                          : APK415I INPUTDD=/file.ARD
                          : APK415I OUTPUTDD=/dev/null
                          : APK415I INDEXDD=/file.ind
                          : APK415I RESOBJDD=/dev/null
                          : APK440I ACIF AT PH34181 HAS COMPLETED NORMALLY WITH RETURN CODE 0.
2022-09-27 10:30:02.410835: ARS4308I Indexing completed
2022-09-27 10:30:02.410931: ARS4312I Loading started, 5738 bytes to process
2022-09-27 10:30:02.417521: ARS1146I Loaded 0 rows into the database
2022-09-27 10:30:02.417560: ARS4311E Loading failed
2022-09-27 10:30:02.418853: ARS4318E Processing failed for file >file.ARD<
2022-09-27 10:30:02.568891: ARS4327E Processing has stopped.  The remaining files will NOT be processed.
I still get a return code 0, but the file fails, from a trace (ALL=15)

Code: [Select]

193386:140103472973632 09/27/2022 10:22:13:537542 ERROR arsloadc.c(1187)ArcLOADCP_Stash:Current state msg_id=641
193386:140103472973632 09/27/2022 10:22:13:669974 ERROR arsload.c(12188)ArcLOADP_LoadArchive:Current state msg_id=1161
193386:140103472973632 09/27/2022 10:22:13:671257 ERROR arsload.c(18112)ArcLOAD_ProcessFile:Current state msg_id=1168
193386:140103472973632 09/27/2022 10:22:13:828007 ERROR (null)(0)(null):Sending message to library server msg timestamp=2022-09-27 10:22:13.671384 msg userid=ADMIN msg severity=2 msg num=88 msg text=ARS0088E Application Group Failed Load: Name(AG) LoadId(--INDEXING ONLY--) File(file.ARD) msg appl=T msg logid=164557526
193386:140103472973632 09/27/2022 10:22:13:828016 ERROR (null)(0)(null):CONSOLE message msg num=88
193386:140103472973632 09/27/2022 10:22:13:828035 ERROR (null)(0)(null):ARSLOG message msg num=88
193386:140103472973632 09/27/2022 10:22:13:831973 ERROR arsloadc.c(4486)ArcLOADC_Main:Current state msg_id=1177

29

Report Indexing / Best Practice - Index vs Filter

« on: August 12, 2022, 08:48:36 AM »

It's been a long time since I've done report development, but Im trying to come up with some standards. Also, I am not a DBA by any stretch of the imagination

Wondering about AG fields - Here are my below assumptions I'd assume are correct.

1) Is there any reason why I would not always use an index as field type?
2) Referring to question 1 - Would I only use an index on fields that are searched commonly, AKA - Account, SSN, Name, ETC.
3) Dates- Should they be filters?
4) "Dropdown Boxes" - should they be filters?

Wondering how everyone does it and if i can get some tips. In the mean time, I'll be hitting up mr google. Thanks

30

MP Server / log4j question within jars dir

« on: August 02, 2022, 06:24:02 PM »

Not a java dev, just wondering if the log4j, or anything within /opt/ibm/xx/ondemand/jars is used for anything, other than ODWEK?

Do any other binaries use it?

Thanks