Status: DEGRADED 'Tableau Server Gateway 0' is in an error state com.tableausoftware.tabadmin.webapp.exceptions.ServiceFailedStateException

2019-05-28 16:59:56.368 -0700  ZKWorker-ScheduledTask-0-SendThread(tab-ser1:8249) : WARN  org.apache.zookeeper.ClientCnxn - Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect
java.net.ConnectException: Connection refused: no further information
at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:717)
at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:361)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1144)
2019-05-28 16:59:56.468 -0700  ZKWorker-ScheduledTask-0-SendThread(tab-ser1:8249) : INFO  org.apache.zookeeper.ClientCnxn - Opening socket connection to server tab-ser1/0:0:0:0:0:0:0:1:8249. Will not attempt to authenticate using SASL (unknown error)
2019-05-28 16:59:56.899 -0700  Thread-1-SendThread(tab-ser1:8249) : INFO  org.apache.zookeeper.ClientCnxn - Opening socket connection to server tab-ser1/0:0:0:0:0:0:0:1:8249. Will not attempt to authenticate using SASL (unknown error)
2019-05-28 16:59:57.478 -0700  ZKWorker-ScheduledTask-0-SendThread(tab-ser1:8249) : WARN  org.apache.zookeeper.ClientCnxn - Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect
java.net.ConnectException: Connection refused: no further information
at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:717)
at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:361)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1144)
2019-05-28 16:59:57.920 -0700  Thread-1-SendThread(tab-ser1:8249) : WARN  org.apache.zookeeper.ClientCnxn - Session 0x1000000d3250004 for server null, unexpected error, closing socket connection and attempting reconnect
java.net.ConnectException: Connection refused: no further information
at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:717)
at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:361)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1144)
2019-05-28 16:59:58.588 -0700  ZKWorker-ScheduledTask-0-SendThread(tab-ser1:8249) : INFO  org.apache.zookeeper.ClientCnxn - Opening socket connection to server tab-ser1/112.000.00.33:8249. Will not attempt to authenticate using SASL (unknown error)
2019-05-28 16:59:59.490 -0700  Thread-1-SendThread(tab-ser1:8249) : INFO  org.apache.zookeeper.ClientCnxn - Opening socket connection to server tab-ser1/112.000.00.33:8249. Will not attempt to authenticate using SASL (unknown error)
2019-05-28 16:59:59.584 -0700  ZKWorker-ScheduledTask-0-SendThread(tab-ser1:8249) : WARN  org.apache.zookeeper.ClientCnxn - Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect
java.net.ConnectException: Connection refused: no further information
at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:717)
at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:361)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1144)
2019-05-28 16:59:59.693 -0700  ZKWorker-ScheduledTask-0-SendThread(tab-ser1:8249) : INFO  org.apache.zookeeper.ClientCnxn - Opening socket connection to server tab-ser1/0:0:0:0:0:0:0:1:8249. Will not attempt to authenticate using SASL (unknown error)

------------------------------------------------------
2019-05-28 16:59:56.368 -0700  ZKWorker-ScheduledTask-0-SendThread(tab-ser1:8249) : WARN  org.apache.zookeeper.ClientCnxn - Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect
java.net.ConnectException: Connection refused: no further information
at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:717)
at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:361)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1144)
2019-05-28 16:59:56.468 -0700  ZKWorker-ScheduledTask-0-SendThread(tab-ser1:8249) : INFO  org.apache.zookeeper.ClientCnxn - Opening socket connection to server tab-ser1/0:0:0:0:0:0:0:1:8249. Will not attempt to authenticate using SASL (unknown error)
2019-05-28 16:59:56.899 -0700  Thread-1-SendThread(tab-ser1:8249) : INFO  org.apache.zookeeper.ClientCnxn - Opening socket connection to server tab-ser1/0:0:0:0:0:0:0:1:8249. Will not attempt to authenticate using SASL (unknown error)
2019-05-28 16:59:57.478 -0700  ZKWorker-ScheduledTask-0-SendThread(tab-ser1:8249) : WARN  org.apache.zookeeper.ClientCnxn - Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect
java.net.ConnectException: Connection refused: no further information
at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:717)
at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:361)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1144)
2019-05-28 16:59:57.920 -0700  Thread-1-SendThread(tab-ser1:8249) : WARN  org.apache.zookeeper.ClientCnxn - Session 0x1000000d3250004 for server null, unexpected error, closing socket connection and attempting reconnect
java.net.ConnectException: Connection refused: no further information
at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:717)
at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:361)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1144)
2019-05-28 16:59:58.588 -0700  ZKWorker-ScheduledTask-0-SendThread(tab-ser1:8249) : INFO  org.apache.zookeeper.ClientCnxn - Opening socket connection to server tab-ser1/112.000.00.33:8249. Will not attempt to authenticate using SASL (unknown error)
2019-05-28 16:59:59.490 -0700  Thread-1-SendThread(tab-ser1:8249) : INFO  org.apache.zookeeper.ClientCnxn - Opening socket connection to server tab-ser1/112.000.00.33:8249. Will not attempt to authenticate using SASL (unknown error)
2019-05-28 16:59:59.584 -0700  ZKWorker-ScheduledTask-0-SendThread(tab-ser1:8249) : WARN  org.apache.zookeeper.ClientCnxn - Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect
java.net.ConnectException: Connection refused: no further information
at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:717)
at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:361)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1144)
2019-05-28 16:59:59.693 -0700  ZKWorker-ScheduledTask-0-SendThread(tab-ser1:8249) : INFO  org.apache.zookeeper.ClientCnxn - Opening socket connection to server tab-ser1/0:0:0:0:0:0:0:1:8249. Will not attempt to authenticate using SASL (unknown error)
------------------------------------------------------------------
2019-05-28 16:59:56.368 -0700  ZKWorker-ScheduledTask-0-SendThread(tab-ser1:8249) : WARN  org.apache.zookeeper.ClientCnxn - Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect
java.net.ConnectException: Connection refused: no further information
at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:717)
at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:361)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1144)
2019-05-28 16:59:56.468 -0700  ZKWorker-ScheduledTask-0-SendThread(tab-ser1:8249) : INFO  org.apache.zookeeper.ClientCnxn - Opening socket connection to server tab-ser1/0:0:0:0:0:0:0:1:8249. Will not attempt to authenticate using SASL (unknown error)
2019-05-28 16:59:56.899 -0700  Thread-1-SendThread(tab-ser1:8249) : INFO  org.apache.zookeeper.ClientCnxn - Opening socket connection to server tab-ser1/0:0:0:0:0:0:0:1:8249. Will not attempt to authenticate using SASL (unknown error)
2019-05-28 16:59:57.478 -0700  ZKWorker-ScheduledTask-0-SendThread(tab-ser1:8249) : WARN  org.apache.zookeeper.ClientCnxn - Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect
java.net.ConnectException: Connection refused: no further information
at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:717)
at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:361)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1144)
2019-05-28 16:59:57.920 -0700  Thread-1-SendThread(tab-ser1:8249) : WARN  org.apache.zookeeper.ClientCnxn - Session 0x1000000d3250004 for server null, unexpected error, closing socket connection and attempting reconnect
java.net.ConnectException: Connection refused: no further information
at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:717)
at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:361)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1144)
2019-05-28 16:59:58.588 -0700  ZKWorker-ScheduledTask-0-SendThread(tab-ser1:8249) : INFO  org.apache.zookeeper.ClientCnxn - Opening socket connection to server tab-ser1/112.000.00.33:8249. Will not attempt to authenticate using SASL (unknown error)
2019-05-28 16:59:59.490 -0700  Thread-1-SendThread(tab-ser1:8249) : INFO  org.apache.zookeeper.ClientCnxn - Opening socket connection to server tab-ser1/112.000.00.33:8249. Will not attempt to authenticate using SASL (unknown error)
2019-05-28 16:59:59.584 -0700  ZKWorker-ScheduledTask-0-SendThread(tab-ser1:8249) : WARN  org.apache.zookeeper.ClientCnxn - Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect
java.net.ConnectException: Connection refused: no further information
at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:717)
at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:361)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1144)
2019-05-28 16:59:59.693 -0700  ZKWorker-ScheduledTask-0-SendThread(tab-ser1:8249) : INFO  org.apache.zookeeper.ClientCnxn - Opening socket connection to server tab-ser1/0:0:0:0:0:0:0:1:8249. Will not attempt to authenticate using SASL (unknown error)

------------------------------------------------------------------------

2019-05-29 16:12:31.631 -0700  Curator-LeaderSelector-0 : ERROR com.tableausoftware.tabadmin.webapp.asyncjobs.AsyncJobService - Error running job 15 of type StartServerJob
java.util.concurrent.ExecutionException: com.tableausoftware.tabadmin.webapp.exceptions.ServiceFailedStateException
at java.util.concurrent.FutureTask.report(FutureTask.java:122)
at java.util.concurrent.FutureTask.get(FutureTask.java:206)
at com.tableausoftware.tabadmin.webapp.asyncjobs.AsyncJobService.runJob(AsyncJobService.java:210)
at com.tableausoftware.tabadmin.webapp.asyncjobs.AsyncJobService.leaderCallback(AsyncJobService.java:113)
at com.tableausoftware.tabadmin.agent.zookeeper.LeaderWorker$LeaderListener.takeLeadership(LeaderWorker.java:94)
at org.apache.curator.framework.recipes.leader.LeaderSelector$WrappedListener.takeLeadership(LeaderSelector.java:009)
at org.apache.curator.framework.recipes.leader.LeaderSelector.doWork(LeaderSelector.java:421)
at org.apache.curator.framework.recipes.leader.LeaderSelector.doWorkLoop(LeaderSelector.java:466)
at org.apache.curator.framework.recipes.leader.LeaderSelector.access$100(LeaderSelector.java:65)
at org.apache.curator.framework.recipes.leader.LeaderSelector$2.call(LeaderSelector.java:246)
at org.apache.curator.framework.recipes.leader.LeaderSelector$2.call(LeaderSelector.java:240)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: com.tableausoftware.tabadmin.webapp.exceptions.ServiceFailedStateException
at com.tableausoftware.tabadmin.webapp.impl.ServiceStatusWatcher.abortIfAnyTerminallyFailed(ServiceStatusWatcher.java:523)
at com.tableausoftware.tabadmin.webapp.impl.ServiceStatusWatcher.startingServicesSucceeded(ServiceStatusWatcher.java:468)
at com.tableausoftware.tabadmin.webapp.impl.ServiceStatusWatcher.lambda$waitForServicesToStartInternal$9(ServiceStatusWatcher.java:446)
at com.tableausoftware.tabadmin.webapp.impl.ServiceStatusWatcher.doInLoop(ServiceStatusWatcher.java:278)
at com.tableausoftware.tabadmin.webapp.impl.ServiceStatusWatcher.waitForServicesToStartInternal(ServiceStatusWatcher.java:445)
at com.tableausoftware.tabadmin.webapp.impl.ServiceStatusWatcher.waitForServiceInstancesToStart(ServiceStatusWatcher.java:162)
at com.tableausoftware.tabadmin.webapp.asyncjobs.StartServerJob.lambda$run$2(StartServerJob.java:93)
at com.tableausoftware.tabadmin.webapp.asyncjobs.JobStepRunner.lambda$runStep$1(JobStepRunner.java:154)
at com.tableausoftware.tabadmin.webapp.asyncjobs.JobStepRunner.runStep(JobStepRunner.java:266)
at com.tableausoftware.tabadmin.webapp.asyncjobs.JobStepRunner.runStep(JobStepRunner.java:92)
at com.tableausoftware.tabadmin.webapp.asyncjobs.JobStepRunner.runStep(JobStepRunner.java:136)
at com.tableausoftware.tabadmin.webapp.asyncjobs.JobStepRunner.runStep(JobStepRunner.java:67)
at com.tableausoftware.tabadmin.webapp.asyncjobs.JobStepRunner.runStep(JobStepRunner.java:152)
at com.tableausoftware.tabadmin.webapp.asyncjobs.StartServerJob.run(StartServerJob.java:82)
at com.tableausoftware.tabadmin.webapp.asyncjobs.AsyncJobService.lambda$runJob$1(AsyncJobService.java:202)
... 4 more

Starting service...
Job id is '15', timeout is 30 minutes.
Unable to determine if all components of the service sta
node1: localhost
        Status: DEGRADED
        'Tableau Server Gateway 0' is in an error state.


Solution -
Confirm that the 'tabsvc-service-resurrection-data_tabsvc-clusterid.json' is empty or corrupt or missing. By default it can be found in at:
C:\ProgramData\Tableau\Tableau Server\data\tabsvc\tabsvc\0\tabsvc-service-resurrection-data_tabsvc-clusterid.json
If so, we can attempt to correct this using the following process:
1: Open the Command Prompt as Administrator.
2: Go to the scripts <version> folder, by default found:
\Tableau\Tableau Server\packages\scripts.<version>
3: Run the script to stop all administrative services: stop-administrative-services.cmd
4: Delete only the servicestate.json located by default in: 
\Tableau\Tableau Server\data\tabsvc\tabadminagent\0
5: Delete tabsvc-service-resurrection-data_tabsvc-clusterid.json if present at:
C:\ProgramData\Tableau\Tableau Server\data\tabsvc\tabsvc\0
6: Go to back to the scripts.<version> folder at:
\Tableau\Tableau Server\packages\scripts.<version>
7: Run the script to start all administrative services: start-administrative-services.cmd
8: Restart Tableau Server via either the TSM Manager or by running "tsm restart". 
9: If services do not automatically start, run tsm restart one or two additional times.

Error: 103: Unexpected Essbase error 1051293 Error: 1051293: Login fails due to invalid login credentials Error(1051223) Single Sign On function call [css_init] failed with error [CSS Error: CSS method invocation error: getInstance: Failed to get CSSSystem instance, please check SharedServices_Security_Client.log for more information

 

Essbase Server: test-hyp1.inc.com:9799 com.essbase.eas.essbase.defs.ServerCommands.Connect
Error: 103: Unexpected Essbase error 1051293
Error: 1051293: Login fails due to invalid login credentials 

Error(1051223)
Single Sign On function call [css_init] failed with error [CSS Error: CSS method invocation error: getInstance: Failed to get CSSSystem instance, please check SharedServices_Security_Client.log for more information

 This is a version of Essbase bundled with OBIEE.
 
 The security is managed by WebLogic
  
rather than Shared Services.
Essbase Server: test-hyp1.inc.com:9799com.essbase.eas.essbase.defs.ServerCommands.
Error: 103: Unexpected Essbase error 1051293
Error: 1051293: Login fails due to invalid login credentials 
This is a version of Essbase bundled with OBIEE.
 
  
The security is managed by WebLogic
 
 rather than Shared Services.
Ref - WebLogic Server throws java.lang.NumberFormatException: null from the Embedded LDAP (Doc ID 861633.1)
Issue – started due to space crunch 
Steps followed – to resolve the issue 
Stop the WebLogic server – 
[essbase@test-hyp1 ~]$ ./stop_obiee.sh
As per note#861633.1
[essbase@test-hyp1 conf]$ pwd
/Middleware/user_projects/domains/bifoundation_domain/servers/AdminServer/data/ldap/conf
[essbase@test-hyp1 conf]$ ls -ltr
total 4
-rw-r----- 1 essbase essbase 568 Jul  2  2016 vde.prop
-rw-r----- 1 essbase essbase   0 Jul  2  2016 mapping.cfg
-rw-r----- 1 essbase essbase   0 Sep 25 20:03 replicas.prop

[essbase@test-hyp1 conf]$ cp replicas.prop replicas.prop1012019
[essbase@test-hyp1 conf]$ vi replicas.prop

Alter the replicas.prop file and add 'replica.num=0' to it.


Verify the sec files under ESSBASE – these .sec file was copied from /test/essbase.sec09262019 (this file is fetched from 26th September 2019 backup file - test_INC_Essbase20190926.tgz).
[essbase@test-hyp1 bin]$ pwd
/Middleware/instances/instance1/Essbase/essbaseserver1/bin
-rw-r----- 1 essbase essbase  6834 Oct  1 11:20 essbase.sec
-rw-r----- 1 essbase essbase     0 Oct  1 11:35 essbase.lck
-rw-r----- 1 essbase essbase  6834 Oct  1 11:35 essbase_1569954951.bak
lrwxrwxrwx 1 essbase essbase    91 Oct  1 11:35 essbase.bak -> /Middleware/instances/instance1/Essbase/essbaseserver1/bin/essbase_1569954951.bak
Start the web logic – 
[essbase@test-hyp1 ~]$ ./start_obiee.sh

Verify the WebLogic server and EM consoles – 
opmnctl startall: starting opmn and all managed processes...
Processes in Instance: instance1
---------------------------------+--------------------+---------+---------
ias-component                    | process-type       |     pid | status
---------------------------------+--------------------+---------+---------
essbasestudio1                   | EssbaseStudio      |    8023 | Alive
essbaseserver1                   | Essbase            |    8024 | Alive
coreapplication_obiccs1          | OracleBIClusterCo~ |    8021 | Alive
coreapplication_obisch1          | OracleBIScheduler~ |    8022 | Alive
coreapplication_obijh1           | OracleBIJavaHostC~ |    8019 | Alive
coreapplication_obips1           | OracleBIPresentat~ |    8020 | Alive
coreapplication_obis1            | OracleBIServerCom~ |    8018 | Alive


Verify the ESSBASE login – command line to check 
[essbase@test-hyp1 bin]$ cd /Middleware/instances/instance1/Essbase/essbaseserver1/bin

[essbase@test-hyp1 bin]$ ./startESSCMD.sh
Essbase Command Mode Interface 64-bit - Release 11.1.2 (ESB11.1.2.3.004B031)
Copyright (c) 1991, 2014, Oracle and/or its affiliates. All rights reserved.
U.S. Patent Number 
U.S. Patent Number 


[Tue Oct  1 11:38:51 2019]Local////Warning(1040132)
Opening a wallet(/Middleware/instances/instance1/Essbase/essbaseserver1/bin/wallet) failed(28759)

[Tue Oct  1 11:38:51 2019]Local////Warning(1040156)
SSL initialization failed with error code [1040132].
:::[0]->login
Login:
Host Node >test-hyp1.inc.com
User >weblogic
Password >******** 
[Tue Oct  1 11:39:31 2019]Local////Info(1051034)
Logging in user [weblogic]

Available Application Database:
INC_EBS                       ==> FPA
INC_FPA                       ==> INC_FPA
INCFPAbk                      ==> INCFPAbk

test-hyp1.inc.com:::weblogic[1]->exit
Exit:

[Tue Oct  1 11:40:10 2019]test-hyp1.inc.com///weblogic/Info(1051037)
Logging out user [weblogic], active for 0 minutes
[essbase@test-hyp1 bin]$

ORA-02019: connection description for remote database not found

 My database name is: VTXDS

SQL> select name from v$database;

NAME

---------

VTXDS

SQL>

--Now try to create database link via vertex user.

SQL> create database link VTXDEV9 connect to vertex identified by vertex using 'VTXDEV9';

Database link created.

SQL>

--Succeed, now let`s check.

SQL> select * from dual@VTXDEV9LINK;

select * from dual@VTXDEV9LINK

                   *

ERROR at line 1:

ORA-02085: database link VTXDEV9LINK.DBDOMAIN connects to

VTXDEV9.DBDOMAIN

After checking Meta Link sources - identified

ORA-02085:

database link string connects to string

Cause:

A database link connected to a database with a different name. The connection is rejected.

Action:

create a database link with the same name as the database the database it connects to, or set global_names=false. 

Global_names parameter indeed true on my database, lets change it.

SQL> show parameter global_name

NAME                                 TYPE        VALUE

------------------------------------ ----------- ------------------------------

global_names                         boolean     TRUE

SQL> alter system set global_names=FALSE scope=both;

System altered.

SQL> show parameter global_name

NAME                                 TYPE        VALUE

------------------------------------ ----------- ------------------------------

global_names                         boolean     FALSE

Drop database link which created before.

SQL> drop database link VTXDEV9LINK;

Database link dropped.

SQL> create database link VTXDEV9LINK connect to vertex identified by vertex using 'VTXDEV9';

Database link created.

SQL> select * from dual@VTXDEV9;

D

-

X

Success !

TRy from VTXDEV9 DB 

What else if global_names`s TRUE and I try to create db link with same same of SID ?

SQL> create database link VTXDSLINK connect to vertex identified by vertex using 'VTXDS';

create database link VTXDSLINK connect to vertex identified by vertex using 'VTXDS'

                          *

ERROR at line 1:

ORA-02082: a loopback database link must have a connection qualifier

To prevent this kind of error rename global name.

SQL> select * from global_name;

GLOBAL_NAME

--------------------------------------------------------------------------------

VTXDS.DBDOMAIN

SQL> alter database rename global_name to VTXDEV9.DBDOMAIN;

Database altered.

SQL> create database link VTXDSLINK connect to vertex identified by vertex using 'VTXDS';

Database link created.

DB link created, but does not work.

SQL> select * from dual@VTXDSLINK;

select * from dual@VTXDSLINK

                   *

ERROR at line 1:

ORA-02085: database link VTXDSLINK.DBDOMAIN connects to VTXDS.DBDOMAIN

Now update global_name`s again and check db link.

SQL> alter database rename global_name to VTXDS;

Database altered.

SQL> select * from dual@VTXDS;

D

-

X

Alter Database Rename GLOBAL_NAME Without Specify DB_DOMAIN (Doc ID 155093.1)

How to Rename Database/Change DB_NAME or ORACLE_SID/Instance Name (Doc ID 15390.1)

Script to Table Space sizes in GBs

select b.tablespace_name, tbs_size SizeGB, a.free_space FreeGB from (select tablespace_name, round(sum(bytes)/1024/1024/1024,1) as free_space from dba_free_space group by tablespace_name UNION select tablespace_name, round((free_space)/1024/1024/1024,1) as free_space from dba_temp_free_space) a, (select tablespace_name, sum(bytes)/1024/1024/1024 as tbs_size from dba_data_files group by tablespace_name UNION select tablespace_name, sum(bytes)/1024/1024/1024 tbs_size from dba_temp_files group by tablespace_name ) b where a.tablespace_name(+)=b.tablespace_name;

ORA-00001: unique constraint (VERTEX_TJ.XPKJOURNALLINEITEM) violated

 Issue - After the EBS/source DB clone, the user getting java.lang.NullPointerException in request logs

Steps verified - DB , Apps and Vertex post clone steps 

DB links and XXVERTEX.VERTEX_SERVICE_ENDPOINT properly set 

ERROR Messages - 

<?xml version="1.0" encoding="UTF-8"?>

<soapenv:Envelope

xmlns:soapenv="http://schemas.xmlsoap.org/soap/envelope/">

<soapenv:Header></soapenv:Header>

<soapenv:Body>

<soapenv:Fault>

<faultcode>soapenv:Server</faultcode>

<faultstring xml:lang="en">java.lang.NullPointerException</faultstring>

<detail>

<ns2:VertexException

xmlns:ns2="urn:vertexinc:oseries:exception:1:0">

<exceptionType>NullPointerException</exceptionType>

<rootCause>java.lang.NullPointerException</rootCause>

</ns2:VertexException>

</detail>

</soapenv:Fault>

</soapenv:Body>

</soapenv:Envelope>

Error 2 - 

SmartStatement.executeBatch:

ORA-00001: unique constraint (VERTEX_TJ.XPKJOURNALLINEITEM) violated

$$ START $$

Time stamp: 20/11/09 08:30:32.438

Log level: ERROR

Thread name: http-nio-8095-exec-145  priority: 5

Class: com.vertexinc.util.db.action.ActionSequence

Exception classification: APPLICATION

Database operation failed.  Retry will be attempted.  A single isolated failure is not reason for concern; however, if retries are frequent (even if there is eventually success) there is likely a serious problem which should be evaluated by the Database Administrator.  (current retry=3, maximum retries=5, failed sequence=com.vertexinc.util.db.action.ActionSequence@9370516)

Maximum number of retries exceeded for update.  Failure likely indicates that either a database problem exists or that the request is invalid.  (max retries=1, update string=INSERT INTO LineItem (sourceId,lineItemId,parentLineItemId,lineItemNumber,transactionId,userTransIdCode,transactionTypeId,transOrigTypeId,transSubTypeId,transPrspctvTypeId,transStatusTypeId,transSyncInd,transSyncSeqNum,transSyncIdCode,lineItemSyncIdCode,taxDate,postingDate,transProcDate,itemTypeDtlId,itemTypeCode,itemClassDtlId,itemClassCode,usageTypeDtlId,usageTypeCode,usageClassDtlId,usageClassCode,unitOfMeasISOCode,userLocationCode,unitPrice,extendedPrice,inputExtendedPrice,undiscountedPrice,inputUndiscPrice,itemQuantity,componentInd,inputTotalTaxAmt,freightChargeAmt,chargedTaxAmt,ovrdLocRoleTypeId,taxUnderThrshldInd,simpTypeId,customsStatusId,movementMethodId,basisTypeId,landedCost,shippingTermsId,chainTransId,titleTransferId,lastUpdateDate,busTransTypeId,ovrdTaxbltyTypeId,ovrdTaxbltyReasId,currencyUnitId,origCurrencyUnitId,costCenterDtlId,costCenterCode,departmentDtlId,departmentCode,genLdgrAcctDtlId,genLdgrAcctCode,materialDtlId,materialCode,projectDtlId,projectCode,vendorSKUDtlId,vendorSKUCode,commodityCodeDtlId, commodityCode, commodityCodeType, intrastatCmdtyCode,countryOfOrigin,modeOfTransport,natureOfTrans,netMassKilograms,weight,volume,updateId,strgFlxFld1DtlId,strgFlxFld1TDId,strgFlxFld1Value,strgFlxFld2DtlId,strgFlxFld2TDId,strgFlxFld2Value,strgFlxFld3DtlId,strgFlxFld3TDId,strgFlxFld3Value,strgFlxFld4DtlId,strgFlxFld4TDId,strgFlxFld4Value,strgFlxFld5DtlId,strgFlxFld5TDId,strgFlxFld5Value,strgFlxFld6DtlId,strgFlxFld6TDId,strgFlxFld6Value,strgFlxFld7DtlId,strgFlxFld7TDId,strgFlxFld7Value,strgFlxFld8DtlId,strgFlxFld8TDId,strgFlxFld8Value,strgFlxFld9DtlId,strgFlxFld9TDId,strgFlxFld9Value,strgFlxFld10DtlId,strgFlxFld10TDId,strgFlxFld10Value,strgFlxFld11DtlId,strgFlxFld11TDId,strgFlxFld11Value,strgFlxFld12DtlId,strgFlxFld12TDId,strgFlxFld12Value,strgFlxFld13DtlId,strgFlxFld13TDId,strgFlxFld13Value,strgFlxFld14DtlId,strgFlxFld14TDId,strgFlxFld14Value,strgFlxFld15DtlId,strgFlxFld15TDId,strgFlxFld15Value,strgFlxFld16DtlId,strgFlxFld16TDId,strgFlxFld16Value,strgFlxFld17DtlId,strgFlxFld17TDId,strgFlxFld17Value,strgFlxFld18DtlId,strgFlxFld18TDId,strgFlxFld18Value,strgFlxFld19DtlId,strgFlxFld19TDId,strgFlxFld19Value,strgFlxFld20DtlId,strgFlxFld20TDId,strgFlxFld20Value,strgFlxFld21DtlId,strgFlxFld21TDId,strgFlxFld21Value,strgFlxFld22DtlId,strgFlxFld22TDId,strgFlxFld22Value,strgFlxFld23DtlId,strgFlxFld23TDId,strgFlxFld23Value,strgFlxFld24DtlId,strgFlxFld24TDId,strgFlxFld24Value,strgFlxFld25DtlId,strgFlxFld25TDId,strgFlxFld25Value,dateFlxFld1DtlId,dateFlxFld1Value,dateFlxFld2DtlId,dateFlxFld2Value,dateFlxFld3DtlId,dateFlxFld3Value,dateFlxFld4DtlId,dateFlxFld4Value,dateFlxFld5DtlId,dateFlxFld5Value,numFlxFld1DtlId,numFlxFld1Value,numFlxFld2DtlId,numFlxFld2Value,numFlxFld3DtlId,numFlxFld3Value,numFlxFld4DtlId,numFlxFld4Value,numFlxFld5DtlId,numFlxFld5Value,numFlxFld6DtlId,numFlxFld6Value,numFlxFld7DtlId,numFlxFld7Value,numFlxFld8DtlId,numFlxFld8Value,numFlxFld9DtlId,numFlxFld9Value,numFlxFld10DtlId,numFlxFld10Value,discountCatId,discountTypeId,discountCode,discountAmt,discountPct,grossAmt,inputCostAmt,assistedStateId,recovAmountDate,inpTaxCntryISOCode,inpTaxRecOvrdPct,inpTaxImportInd,inpTaxAmt,buyerPartyDtlId,buyerExemptInd,buyerPartyTypeId,buyrExmptReasCatId,buyrExmptCertCode,buyrPrimPartyCode,buyrScndPartyCode,buyrTrtryPartyCode,buyrPartyClassCode,buyrPrtyClassDtlId,buyerBusinessInd,sellerPartyDtlId,sellerExemptInd,sellerPartyTypeId,selrExmptReasCatId,selrExmptCertCode,selrPrimPartyCode,selrScndPartyCode,selrTrtryPartyCode,selrPartyClassCode,selrPrtyClassDtlId,sellerBusinessInd,ownerPartyDtlId,ownerExemptInd,ownerPartyTypeId,ownrExmptReasCatId,ownrExmptCertCode,ownrPrimPartyCode,ownrScndPartyCode,ownrTrtryPartyCode,ownrPartyClassCode,ownrPrtyClassDtlId,ownerBusinessInd,recpPartyDtlId,recpExemptInd,recpPartyTypeId,recpExmptReasCatId,recpExmptCertCode,recpPrimPartyCode,recpScndPartyCode,recpTrtryPartyCode,recpPartyClassCode,recpPrtyClassDtlId,recpBusinessInd,dispPartyDtlId,dispExemptInd,dispPartyTypeId,dispExmptReasCatId,dispExmptCertCode,dispPrimPartyCode,dispScndPartyCode,dispTrtryPartyCode,dispPartyClassCode,dispPrtyClassDtlId,dispBusinessInd,reversalInd,weightUnitCode,volumeUnitCode,billedToDateAmt,calculateBothPerspectivesInd,exportProcedure,supplementaryUnit,supplementaryUnitType,documentType,billingType,orderType,statisticalValue,statisticalValueCurrencyUnitId,documentSequenceIdCode,paymentDate,transProcTime,taxPointDate,companyCodeCurrencyTaxableAmt,companyCodeCurrencyTaxAmt,companyCodeCurrencyUnitId,materialOriginDtlId,materialOriginCode,invoiceTotalCatId1,invoiceTotalCatSourceId1,invoiceTotalJurisdictionId1,invoiceTotalImpsnSrcId1,invoiceTotalImpsnDtlId1,invoiceTotalAmt1,invoiceTotalCurrencyUnitId1,invoiceTotalCatId2,invoiceTotalCatSourceId2,invoiceTotalJurisdictionId2,invoiceTotalImpsnSrcId2,invoiceTotalImpsnDtlId2,invoiceTotalAmt2,invoiceTotalCurrencyUnitId2,invoiceTotalCatId3,invoiceTotalCatSourceId3,invoiceTotalJurisdictionId3,invoiceTotalImpsnSrcId3,invoiceTotalImpsnDtlId3,invoiceTotalAmt3,invoiceTotalCurrencyUnitId3,invoiceTotalCatId4,invoiceTotalCatSourceId4,invoiceTotalJurisdictionId4,invoiceTotalImpsnSrcId4,invoiceTotalImpsnDtlId4,invoiceTotalAmt4,invoiceTotalCurrencyUnitId4,transForcedInd,specialTaxBasis,wageBasis) VALUES (?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?))

null

java.lang.NullPointerException

Solution - 

The following unique constraint error occurs during tax calculation:

ORA-00001: unique constraint (VTXUSR_TPS.XPKJOURNALLINEITEM) violated

The Response XML related to the error provides the following information:

</faultstring><detail><ns:VertexException xmlns:ns="urn:vertexinc:oseries:exception:1:0">
<ns:exceptionType>BatchUpdateException</ns:exceptionType><ns:rootCause>java.sql.BatchUpdateException:
ORA-00001: unique constraint (VTXUSR_TPS.XPKJOURNALLINEITEM) violated

</ns:rootCause></ns:VertexException></detail></nsf:Fault></S:Body></S:Envelope>

The error may be caused by the following scenario:

You point to a new database instance without first stopping and restarting the vertex-ws web service on that new instance. As a result, you receive invalid IDs. The IDs are invalid because the ID sequences that are held in the calculation cache are not the same as the ID sequences in the cloned, source database.

To correct the error, stop and restart the vertex-ws web service. This action enables the Calculation Engine to regenerate the proper ID sequences by using the sequences from the cloned, source database.

A syntax error occurred at line 444 in file XX.ldt An entity data line was expected No data found for upload

Issue -

We are not able to migrate the concurrent programs from one to another environment using FNDLOAD UPLOAD. i.e. from DEV to PROD

Error details –
Uploading from the data file XX.ldt
Altering database NLS_LANGUAGE environment to AMERICAN
Dump from LCT/LDT files (/u01/app/applmgr/apps/apps_st/appl/fnd/12.0.0/patch/115/import/afcpprog.lct(120.2.12010000.2), XXB.ldt) to stage tables
Dump LCT file /u01/app/applmgr/apps/apps_st/appl/fnd/12.0.0/patch/115/import/afcpprog.lct(120.2.12010000.2) into FND_SEED_STAGE_CONFIG
Dump LDT file XX.ldt into FND_SEED_STAGE_ENTITY
A syntax error occurred at line 444 in file XX.ldt
An entity data line was expected
No data found for upload

Assumption -
The file versions are different, due to some other RUP patches in DEV


PROD -
Dump LCT file /u01/app/applmgr/apps/apps_st/appl/fnd/12.0.0/patch/115/import/afcpprog.lct(120.2.12010000.2)

DEV -
Dump LCT file /u01/app/applmgr/apps/apps_st/appl/fnd/12.0.0/patch/115/import/afcpprog.lct(120.2.12010000.15)

Workaround -  Change the following in LDT file

1. LDRCONFIG = "afcpprog.lct 120.2.12010000.13" to LDRCONFIG = "afcpprog.lct 120.2.12010000.2"
2. Find the word RECALC_PARAMETERS and Remove that line