Messages

46

Report Indexing / Loading large CSV using Generic indexer

« on: March 04, 2021, 07:35:49 AM »

We loaded a large test CSV file to CMOD.  File loaded successfully although the 87 message contained  this information:

Loading started, 570696197 bytes to process
Warning:  A document of size >570696197< bytes was processed.  It is not recommended to store documents in OnDemand greater than 50MB in size.  Although data may
OnDemand Load Id = >90353-10-0-1FAA-0-0-90354<
Loaded 1 rows into the database
Document compression type used - OD77.  Bytes Stored = >44760080< Rows = >1<
Loading completed

When the users attempted to view in Content Navigator they received this, FILE NOT LOADED COMPLETELY

Spreadsheet contained 1196248 rows but they were only able to see 1048576.

Does anyone know if CMOD has a limit to size it can ingest?

47

Windows Client / Re: UNLOADING issue

« on: February 10, 2021, 03:48:21 AM »

We were thinking that too.  But our ids are all defined as System Administrators.  The ids themselves however aren't defined on the Application Group.  The issue is intermittent when it does occur.  The next time we see this type of thing, I'll capture more details.  As always, I appreciate your feedback!

Take care

Dave

48

Windows Client / UNLOADING issue

« on: February 09, 2021, 07:10:03 AM »

We have run into an issue when attempting to do an UNLOAD of different APPLICATION GROUPS.  All our id's are defined as ADMINISTRATORS but when attempting to do an UNLOAD via System Load in the admin client we all get "The user is not permitted to perform the operation"  Any idea why?   We have performed this function many times on other unload attempts. So it appears to be a setting on these Application Groups

49

MP Server / Re: Report Viewing

« on: January 28, 2021, 11:23:25 AM »

Justin,

We were approached by someone here to provide them a listing of CMOD reports coming from the mainframe that haven't been view the last 2 years....Apparently they are trying to do cleanup of unneeded mainframe jobs so save on resources.  Last I heard our engineering person was going to try and provide them the list.  As of now not sure who he plans on doing that.  If/when I hear anything, I'll provide that information.  As always, I appreciate your response!


Take care

Dave

50

MP Server / Report Viewing

« on: January 27, 2021, 11:18:37 AM »

Not sure what best forum to post this.  We have received a request to provide a list of CMOD reports that haven't been viewed in the last 2 years.  Off hand not sure even how to approach this even if it can be done.  Currently we are ingesting mainframe reports which use both ACIF and OS/390 indexers.  We also ingest server to server reports.  Any thoughts or ideas how this maybe done.  Currently we have over 17600 reports defined to CMOD.

51

Windows Client / Re: Adding new accesses by multiple users

« on: September 29, 2020, 10:28:39 AM »

Will do Justin....We receive our requests via an access form submission system.  Most times they are just one off adds.  But at times they can come in clusters which would make it nice if more than one person can process them at one time.  Before we realized what was happening it was baffling when we received the User id or UID already exists..Because we knew the id didn't exist it pointed to something related to the UID....Checking, we determined someone else was trying to do the same thing at the same time.  Once we waited until they completed their task and then did a F5 on our session, we could process the request.   It seems when you go to do the add, it grabs the next UID number.  If someone else goes to add an id, at the same time, it also tries to use that same UID number.  Then we see the error. 

52

Windows Client / Adding new accesses by multiple users

« on: September 29, 2020, 06:18:10 AM »

We are using the Windows admin client 10.1.0.5 for adding new CMOD user access requests.  We've found that only one of our CMOD Admins can do any requests at one time when ADDING new users.  If more than one Admin attempts to add new user requests (different users) at the same time, we'll receive an error indicating that the UID number already exists.  I know its a timing issue but was wondering if there is anyway to avoid this?  At times we can have many requests pending and it would be nice to have multiple Admins being able to process requests at the same time.  As indicated, this only happens when trying to add new users.  Updating existing users isn't an issue.

53

Report Indexing / Re: COLUMN DELIMITER ERROR

« on: September 28, 2020, 04:55:05 PM »

Totally agree Justin...But as I'm sure you are more than aware, its can be more than frustrating getting answers or fixes from those who are the ones generating the data.  Even after showing them exactly what is occurring they have no answers.  This particular group has frustrated us in the past.  Most recently with field lengths.  After confirmation of max lengths they will be sending, in more than one occasion they have randomly increased some of them which has cause max field length exceded ingestion errors.  Our only solution we found was to create a new application group with the new field lengths.  The issue is we need to rename the existing one to a different name so they can keep using the same naming convention when sending the files all the while still being able to access archived data.  Sorry to get off topic here...Just needed to vent!!  haha..As always appreciate everyones input and expertise!  Take care.  Dave

54

Report Indexing / Re: COLUMN DELIMITER ERROR

« on: September 28, 2020, 04:46:54 PM »

Thanks ED!

55

Report Indexing / Re: COLUMN DELIMITER ERROR

« on: September 28, 2020, 09:58:20 AM »

Justin,

I just heard back this AM from our CMOD engineering person...He actually used a UNIX command to find the issue (I'm not Unix person!! haha)...Apparently PSPAD didn't show this (as you said it may now)...Hoping the explanation below makes sense...;-)

The 88 msg of EMXDEFLT is caused by the tab character.  As it’s showing the same as a space, it’s very elusive.
The way to find them is by using unix command: grep "$(printf '\t')" filename
After running that, it shows me there is a total of 19 tab characters (\t) in the input file.

For now, I have replaced all tab character with space (cat 1414319.1.EMXDEFLT.EMXDEFLT.2020925.10.ard.Failed.org|sed s/"$(printf '\t')"/' '/g > test.txt), and ingested that file into ERR successfully. 
But this has to be corrected by the team who generated the input file in the future.
Please forward this email to that team.  And let them know they can capture tab character by searching for "$(printf '\t')" .

56

Report Indexing / Re: COLUMN DELIMITER ERROR

« on: September 28, 2020, 03:34:47 AM »

I've attached a screen shot of bad line from PSPAD

57

Report Indexing / COLUMN DELIMITER ERROR

« on: September 27, 2020, 04:39:19 PM »

I'm trying to load a text file into CMOD.  Keeps getting the same error:

 Loading started, 3100678 bytes to process
 Row 178:  The string "/BENEFICIARY   CURRENCYFAIR" has the column delimiter in it

I've opened the file in PSPAD under HEX Editor and only find 2 instances of this exact line. Never found the proceeding / character anywhere.  I've tried editing both lines be inserting a x'20' character (space) in front of BENEFICIART and it still gets the same error.  Am I missing something? 

58

Report Indexing / Re: Character translation

« on: September 21, 2020, 07:31:23 AM »

Gotcha!...I hadn't looked at your link you included yet....I know Justin and mentioned CodePage maybe being a issue!  I appreciate the help!!!!!

59

Report Indexing / Re: Character translation

« on: September 21, 2020, 07:19:24 AM »

Changing the CodePage to 37 worked...Now showing | and not !...How did you decipher what Codepage the mainframe dataset was using?  Appreciate the help!!!!

Take care

Dave

60

Report Indexing / Re: Character translation

« on: September 18, 2020, 07:28:15 AM »

Hi Justin,

We are running CMOD 10.1.0.5.  Running Content Navigator. Version: 2.0.3 Build: icn203.813.478. 

This file is created as a mainframe dataset and then loaded into CMOD via ACIF indexer.  The dataset itself is allocated as FBA with a record length of 261.

The CMOD definition is defined with a Codepage of 500.  CC=Yes, RECFM=Fixed, LRECL=261, CC Type=Ansi

Both Client and Navigator are showing the same character.  Looking at it, this is the only character not showing correctly.  Not aware of any type of translation being used.