Topics

61

MP Server / ARSSOCKD crash when adding application to app group

« on: November 10, 2020, 07:55:10 AM »

Azure POC environment, 10.1.0.5, RHEL 8.2, DB2 V11, Cache for now..

I am trying to test an extract script. I am using an IBM lab to load a test file with PPD's. I setup the basic application group with 3 fields. Added an application to the AG, made no changes- just to get it setup (Also happens when I add the indexing parameters)

When I click save - "Connection cannot be established for  - 10.0.4.4", and arssockd dies.

I have seen something similar to this years ago but I don't recall the fix. Anyone have thoughts?

62

Report Indexing / arsload not finding ARSACIF

« on: November 08, 2020, 11:06:22 AM »

Never seen this error before - obviously, arsacif exists within /app/ibm/ondemand/V10.1/bin/

running on azure with Redhat 8.2, DB2 11, 10.1.0.5

[archive@cmodpoc bin]$ ./arsload -nvf -u admin -p ondemand -h archive -g test /app/testData/testFile.ARD.txt
ARS1609W Specifying passwords on the command line is not secure due to the text being visible. See the Installation and Configuration Guide for your platform for information about the arsstash command or using Unified Login.
2020-11-08 18:04:23.839594: ARS4315I Processing file >/app/testData/testFile.ARD.txt<
2020-11-08 18:04:23.839669: ARS4334I Load Version <10.1.0.5>  Operating System <Linux> <#1 SMP Mon Jul 20 15:02:29 UTC 2020.4.18.0-193.14.3.el8_2.x86_64>  OS Userid <ADMIN>  Install Location </app/ibm/ondemand/V10.1/> Data(unlimited KB) Stack(8192 KB) Core(unlimited 512-blocks) Cpu(unlimited seconds) File(unlimited 512-blocks) Nofiles(1024) Threads(0) Processes(31112)
2020-11-08 18:04:23.839700: ARS4335I Server Version <10.1.0.5>  Operating System <Linux> <#1 SMP Mon Jul 20 15:02:29 UTC 2020.4.18.0-193.14.3.el8_2.x86_64>  Database <DB2> <11.01.0404>
2020-11-08 18:04:24.094004: ARS4339I Application Group >test<
2020-11-08 18:04:24.094046: ARS4340I Application >test<
2020-11-08 18:04:24.094072: ARS4341I Storage Set >Cache Only - Library Server<
2020-11-08 18:04:24.094093: ARS4342I Storage Node >Cache Only - Library Server<
2020-11-08 18:04:24.094113: ARS4347I Encryption >None<
2020-11-08 18:04:24.094179: ARS4302I Indexing started, 214 bytes to process
                          : sh: /app/ibm/ondemand/V10.1/bin/arsacif: No such file or directory
2020-11-08 18:04:24.097500: ARS4309E Indexing failed
2020-11-08 18:04:24.097574: ARS4318E Processing failed for file >/app/testData/testFile.ARD.txt<
2020-11-08 18:04:24.246726: ARS4327E Processing has stopped.  The remaining files will NOT be processed.


[archive@cmodpoc config]$ echo $PATH
/usr/local/bin:/usr/bin:/app/ibm/ondemand/V10.1/bin
[archive@cmodpoc config]$ arsacif
-bash: /app/ibm/ondemand/V10.1/bin/arsacif: No such file or directory


Fixed this-

[jeff@cmodpoc server]$ sudo yum install libstdc++.so.6

63

Windows Client / POC System - Admin/FAT wont connect

« on: October 29, 2020, 01:09:48 PM »

Hi All,

I am working on a solution based on Azure, I installed DB2/CMOD successfully, ARSSOCKD is up and running. Port 1445 is open which I've seen cause this, actually had a PMR about it a few years back.

For some reason my client will not connect to the server. I'm using the public IP address for the virtual machine, but I think something else on the server is blocking connection. I also saw this when I ran the same installation and configuration steps running on my laptop in a Hyper-V environment, wouldn't connect!

Laptop is just a vanilla windows 10 environment, with all firewalls/anti-virus disabled

Anyone have any ideas?

Thanks

64

MP Server / Verify Login Credentials

« on: October 12, 2020, 12:47:01 PM »

I have a small script that is running an extract process,

Code: [Select]

$ARSDOC get $MyParams
returnCode=$?
if [ $returnCode -ne 0 ]; then
echo "it didnt work!"
else
echo "it worked!"

A colleague was not in the stash file, and it returned "It worked!" instead of  "It didnt work"

Is there a way that I can verify that a login works, I can add it as a function in my script. Other than using ODWEK.

Thanks in advance

65

MP Server / Reconciliation via arsdoc query

« on: August 14, 2020, 09:07:27 AM »

This isn't rocket science or reinventing the wheel, but I have a request to verify that a series of documents are loaded, or are not loaded into CMOD.

I approached this as basic as possible, I have a list like this that I loop through ARSDOC query, when the response is less than 1, I then echo the "missing" metadata to a text file for the business to resend. That part works fine.

12341234,313433
12341333,312343
12343333,331111

My problem is that they have 200,000,000 rows they need to validate. Using arsdoc query + bash, this is extremely slow as I expected. It would take 1month to complete going 24/7

We could go through the database tables directly, which is probably what our DBA will want us to do. Just wondering if anyone else has any good ideas.

66

MP Server / Admin client cannot connect to VM (local)

« on: July 08, 2020, 11:00:48 AM »

Strange issue here-

On my Desktop - I'm running a RHEL VM on VMware Workstation ... with CMOD 10.1 and DB2. Everything is up and runnign fine.

I can putty in from my desktop where the VM is running, and my laptop across my network. But I cannot connect to the admin client. Suspect it's a simple network/firewall on the windows 10 PC's, but not sure.

Also - Could it be a connection setting in the VM that I have to work?

67

MP Server / db2move vs backup and restore

« on: July 06, 2020, 11:10:36 AM »

Looking at doing a migration between two boxes. I've only done the extract/reload method before.

One of the ways I did this back in 2015.. In a windows environment, was I used db2look/db2move to extract the old 8.5 tables to a fresh 9.5 box. After that, I just made sure the cache file systems are lined up in the config files.

My newest task is doing the same thing in a linux environment. One of my colleagues who is a db2 dba also, suggested doing a db2 backup and restore on the old db and restoring to the new. I'm confident it might work, especially because we are going from linux to linux. We also are only using cache file systems..But we have about 100TB.

Existing - 9.5 RHEL 6...?, DB2 11.1
New - 10.1, RHEL 7.3, DB2 11.1

Any thoughts on doing db2look/db2move vs backup and restore?

Thanks!

68

MP Server / Default location for trace file?

« on: July 02, 2020, 09:57:53 AM »

We are running trace, and I'm trying to figure out where the file is output to. It's set to -

    [TRACE]
TRACE_FILE=ARCHIVE.trace.log
TRACE_LEVELS=DB=3,SOCKET=3,SRVR=3

I verified it's running. But Can't find the file. In reading the documentation (if i understand it correctly), it shold goto ARS_TMP..which It's not.

It's also not in /config and /bin .. My thoughts are its writing somewhere and it might fill up a file system. We have to run arsmaint to purge 100mil+ docs, and that smells like trouble to me.

anyone have any thoughts?

69

MP Server / Migration question, each load is 1 doc + arsmaint segment date Question

« on: March 02, 2020, 09:04:52 PM »

got a 2 questions, hopefully quick.

I'm working on a migration (100 million docs..) and The client loads documents one by one. Each 87 record contains a single record.

It looks like this is the case for all of their documents after combing through their logs. My script I plan on writing will do an arsdoc and retrieve all files based on doc_name, but I am wondering since it's going to be running rapidly generating millions of files at a time, how bad this could get, taxing on resources.. This is my only option at the time.

I did this approach about a year ago and it worked perfect, but it was a mixture of documents like this and some single AFP files that had 30000 docs per, no issues there.


Next part of this going back to part 1, I'm going to be extracting this and reloading it into a 10.1 system. They are currently using "date loaded" as their segment date and that's what arsmaint is using to expire on.

Any suggestions on how to handle this since I am re-ingesting, and basically resetting the clock. They hinted to me that the last time they were going to try this they ran into this, So..they just stopped..

Thanks all!

70

Content Navigator / trying to deploy ICN3.0.5 with 10.1

« on: December 14, 2019, 10:54:43 AM »

Hi All, I am trying to deploy cmod 10.1 with ICN 3.0.5.. everything is installed.. Getting this error-

Installation directory: The ODAPI.jar file is not in the specified folder. Ensure that the Content Manager OnDemand Web Enablement Kit is installed and that the directory is correct.

I pointed the WebSphere classpath to /opt/ibm/ondemand/V10.1/www/api   and change the path in icn configmgr to reflect this. still not working. I even tried uppercase and lowercase ODAPI.jar.

Any ideas why this isn't finding the jar file?

71

MP Server / Need help with a query, DB2.

« on: October 14, 2019, 09:26:40 AM »

This is probably a very simple query, but not sure of the best way to approach it. anyways instead of just asking for someone to DO it for me, here's my scenario.

I need to query datatables for two things

1) row count for total docs loaded
2) total number of doc names

Concern of course is for when there's tables that go above our 25,000,000 row limit, or whatever we have it setup in prod as.

I am thinking for this the arsseg table is a good way to start. I can query-

select a.name, b.table_name from arsag a, arsseg b where a.agid=b.agid

Why am I doing this?

Writing a little script so my ops team can see, "where an extraction process is at"

thanks in advance, as always I am open to any other approaches

72

MP Server / Determining metrics for specific application?

« on: October 08, 2019, 07:55:17 AM »

got a requirement from our application team to figure out-

Application XYZ, which is part of AG 123, takes up XXX GB in TSM.

Does anyone have a query handy, or something to determine this. I have a feeling it will require some fancy footwork behind the scenes to do this.

73

MP Server / License count + arsdoc

« on: September 30, 2019, 10:14:13 AM »

I have a script that runs arsdoc to retrieve files. The script runs with no problems against most application groups. It runs to about 80% and then I've noticed that the licence count spikes-

OnDemand license limit has been exceeded, currently 13 running only 10 are entitled.  Please contact an IBM Service Representative.

    root 20971548        1   0   Sep 29      -  3:29 arssockd: license (Cur(13), Max(10))
    root 25165968 20971548   0   Sep 29      -  0:03 arssockd: cmd

This is our QA system, not much activity going on. Here's a question. Never seen this before, but could the retrieval of a certain file, maybe a large one, or a file with a certain file structure be causing this? I've also tried slowing down how fast the script runs. This application group is loaded with tons of resources from exstream. Once the license is exceeded, obviously my retrievals stop. Has anyone seen something similar? Btw, 8.5.0.6

74

MP Server / tmp filling up quickly with retrieval

« on: September 04, 2019, 05:48:42 AM »

Hi all, Middle of a migration- 8.5.0.6, AIX 6..

I am performing a retrieval of an entire application group on my test system. It's not really a big app group since it's a test, but prod makes me concerned.....But /tmp is filling up quickly.

Unfortunately, when this system was created, they used /tmp for ARS_TMP=/tmp .. easy fix though

I'm seeing tons of files like this, totalling over 5gb-

-rw-r--r--    1 jeff  image     311492189 Sep 03 15:21 21364738.5622.5623.596.ARSRESGRP

I'm writing the in/out/res files to an nfs mount, and all of them look like they are retrieving correctly. Of course, my script runs fine retrieving everything until /tmp fills up and then it cores out. Strangely enough- This only happens against this one particular application group with one application defined (afp stream from exstream).

I think that my "work around" is going to be define ARS_TMP to something like /ars_temp and make it a large file system..instead of trying to pick and pull and fix, especially since we want to get off 8.5, but that's just a work around. I'm sure in production I will see a much higher volume. My NFS mount is 10TB. So, maybe even I can place something like-- /nfsmount/tmp...? Not sure how that would impact performance either!

Whats everyones thoughts?

75

MP Server / corrupted trace file - 10.1.0.4

« on: August 19, 2019, 05:42:24 PM »

I'm running on - CMOD 10.1.0.4, RHEL 7.4, DB2 11, ICOS..

Has anyone ever seen this in 10.1 (or even an older version...)

I did a system trace (ALL=15) and I'm trying to format the trace file so I can take a look at it..

[jeff@cmodtech tmp]$ arstfmt -i 08092019_cmodtech.trace.log -o trxout
fatal error 'invalid character 0x10' at line: 3999​

This is happening on 3 otherwise fully functioning systems with the same specs. Ive tried permissions, different file systems, etc. No luck.