Weblogic Fatal error in NodeManager server Identity key store file not found


I got Weblogic Nodemanager start error during the Primavera P6 EPPM 18.8 installation.


When i look at the log files of weblogic, I have seen following errors.

NODEMGR_HOME is already set to /u01/app/user_projects/domains/PrimaveraP6EPPM/nodemanager
+ /usr/java/jdk1.8.0_181-amd64/bin/java -server -Xms32m -Xmx200m -Djdk.tls.ephemeralDHKeySize=2048 -Dcoherence.home=/u01/app/wlserver/../coherence -Dbea.home=/u01/app/wlserver/.. -Dweblogic.RootDirectory=/u01/app/user_projects/domains/PrimaveraP6EPPM -Djava.system.class.loader=com.oracle.classloader.weblogic.LaunchClassLoader -Djava.security.policy=/u01/app/wlserver/server/lib/weblogic.policy -Dweblogic.nodemanager.JavaHome=/usr/java/jdk1.8.0_181-amd64 weblogic.NodeManager -v
<Mar 6, 2019 3:58:53 PM EET> <INFO> <Loading domains file: /u01/app/user_projects/domains/PrimaveraP6EPPM/nodemanager/nodemanager.domains>
<Mar 6, 2019 3:58:54 PM EET> <INFO> <Loading identity key store: FileName=/u01/app/user_projects/domains/PrimaveraP6EPPM/security/DemoIdentity.jks, Type=jks, PassPhraseUsed=true>
<Mar 6, 2019 3:58:54 PM EET> <SEVERE> <Fatal error in NodeManager server>
weblogic.nodemanager.common.ConfigException: Identity key store file not found: /u01/app/user_projects/domains/PrimaveraP6EPPM/security/DemoIdentity.jks
at weblogic.nodemanager.server.SSLConfig.loadKeyStoreConfig(SSLConfig.java:225)
at weblogic.nodemanager.server.SSLConfig.access$000(SSLConfig.java:33)
at weblogic.nodemanager.server.SSLConfig$1.run(SSLConfig.java:118)
at java.security.AccessController.doPrivileged(Native Method)
at weblogic.nodemanager.server.SSLConfig.<init>(SSLConfig.java:115)
at weblogic.nodemanager.server.NMServer.<init>(NMServer.java:169)
at weblogic.nodemanager.server.NMServer.getInstance(NMServer.java:134)
at weblogic.nodemanager.server.NMServer.main(NMServer.java:589)
at weblogic.NodeManager.main(NodeManager.java:31)

+ status=1
+ set +x


Go to Primavera domain directory


[oracle@MehmetSalih scripts]$ cd /u01/app/user_projects/domains/PrimaveraP6EPPM/
[oracle@MehmetSalih PrimaveraP6EPPM]$
[oracle@MehmetSalih PrimaveraP6EPPM]$ cd bin/
[oracle@MehmetSalih bin]$
[oracle@MehmetSalih bin]$ ls -ltr
total 88
drwxrwx---. 2 oracle oinstall 4096 Mar 6 15:35 server_migration
drwxrwx---. 2 oracle oinstall 4096 Mar 6 15:35 service_migration
drwxrwx---. 2 oracle oinstall 4096 Mar 6 15:35 patching
drwxrwx---. 2 oracle oinstall 4096 Mar 6 15:35 nodemanager
-rwxr-x---. 1 oracle oinstall 794 Mar 6 15:38 setStartupEnv.sh
-rwxr-x---. 1 oracle oinstall 7295 Mar 6 15:38 startWebLogic.sh
-rwxr-x---. 1 oracle oinstall 2132 Mar 6 15:38 stopWebLogic.sh
-rwxr-x---. 1 oracle oinstall 2821 Mar 6 15:38 startManagedWebLogic.sh
-rwxr-x---. 1 oracle oinstall 2659 Mar 6 15:38 stopManagedWebLogic.sh
-rwxr-x---. 1 oracle oinstall 14679 Mar 6 15:38 setDomainEnv.sh
-rwxr-x---. 1 oracle oinstall 2644 Mar 6 15:38 generateArchive.sh
-rwxr-x---. 1 oracle oinstall 919 Mar 6 15:38 setNMJavaHome.sh
-rwxr-x---. 1 oracle oinstall 1023 Mar 6 15:38 stopNodeManager.sh
-rwxr-x---. 1 oracle oinstall 1088 Mar 6 15:38 startNodeManager.sh
-rwxr-x---. 1 oracle oinstall 688 Mar 6 15:38 startRSDaemon.sh
-rwxr-x---. 1 oracle oinstall 821 Mar 6 15:38 stopRSDaemon.sh
-rwxr-x---. 1 oracle oinstall 2253 Mar 6 15:38 startComponent.sh
-rwxr-x---. 1 oracle oinstall 1917 Mar 6 15:38 stopComponent.sh
[oracle@MehmetSalih bin]$



Execute setDomainEnv.sh script to set environment.


[oracle@MehmetSalih bin]$ . ./setDomainEnv.sh


go to $DOMAIN_HOME/security directory

[oracle@MehmetSalih bin]$ cd ../security/
[oracle@MehmetSalih security]$
[oracle@MehmetSalih security]$ ls -ltr
total 44
-rw-rw----. 1 oracle oinstall 64 Mar 6 15:37 SerializedSystemIni.dat
-rw-rw----. 1 oracle oinstall 31790 Mar 6 15:37 XACMLRoleMapperInit.ldift
-rw-rw----. 1 oracle oinstall 2822 Mar 6 15:37 DefaultRoleMapperInit.ldift
-rw-r-----. 1 oracle oinstall 3321 Mar 6 15:40 DefaultAuthenticatorInit.ldift
[oracle@MehmetSalih security]$
[oracle@MehmetSalih security]$


execute following java query to generate certificate

[oracle@MehmetSalih security]$ java utils.CertGen -keyfilepass DemoIdentityPassPhrase -certfile democert -keyfile demokey -strength 2048 -noskid
Generating a certificate with common name MehmetSalih.localdomain and key strength 2048
issued by CA with certificate from /u01/app/wlserver/server/lib/CertGenCA.der file and key from /u01/app/wlserver/server/lib/CertGenCAKey.der file
[oracle@MehmetSalih security]$



If above step is completed successfully then execute following.

[oracle@MehmetSalih security]$ java utils.ImportPrivateKey -keystore DemoIdentity.jks -storepass DemoIdentityKeyStorePassPhrase -keyfile demokey.pem -keyfilepass DemoIdentityPassPhrase -certfile democert.pem -alias demoidentity
No password was specified for the key entry
Key file password will be used
<Mar 6, 2019 5:41:42 PM EET> <Info> <Security> <BEA-090905> <Disabling the CryptoJ JCE Provider self-integrity check for better startup performance. To enable this check, specify -Dweblogic.security.allowCryptoJDefaultJCEVerification=true.>
<Mar 6, 2019 5:41:42 PM EET> <Info> <Security> <BEA-090906> <Changing the default Random Number Generator in RSA CryptoJ from ECDRBG128 to HMACDRBG. To disable this change, specify -Dweblogic.security.allowCryptoJDefaultPRNG=true.>

Imported private key demokey.pem and certificate democert.pem
into a new keystore DemoIdentity.jks of type jks under alias demoidentity
[oracle@MehmetSalih security]$


If you got below error when you generate certificate then check your Oracle home and Java Home

[oracle@MehmetSalih security]$ java utils.CertGen -keyfilepass DemoIdentityPassPhrase -certfile democert -keyfile demokey -strength 2048 -noskid
Error: Could not find or load main class utils.CertGen
[oracle@MehmetSalih security]$


Now we have solved certificate problem, we can start Weblogic Nodemanager like following.

nohup sh /u01/app/user_projects/domains/PrimaveraP6EPPM/bin/startNodeManager.sh &


If Weblogic Nodemanager Started successfully, then start weblogic server like following.

nohup sh /u01/app/user_projects/domains/PrimaveraP6EPPM/bin/startWebLogic.sh -Dweblogic.management.username=weblogic -Dweblogic.management.password=dev12345 &


Mehmet Salih Deveci

I am Certified Expert about Oracle & SQL Server database, Goldengate, Exadata Machine, Oracle Database Appliance administrator with 10+years experience.I have OCA, OCP, OCE RAC Expert Certificates I have worked 100+ Banking, Insurance, Finance, Telco and etc. clients as a Consultant, Insource or Outsource.I have done 200+ Operations in this clients such as Exadata Installation & PoC & Migration & Upgrade, Oracle & SQL Server Database Upgrade, Oracle RAC Installation, SQL Server AlwaysOn Installation, Database Migration, Disaster Recovery, Backup Restore, Performance Tuning, Periodic Healthchecks.I have done 2000+ Table replication with Goldengate or SQL Server Replication tool for DWH Databases in many clients.If you need Oracle DBA, SQL Server DBA, APPS DBA,  Exadata, Goldengate, EBS Consultancy and Training you can send my email adress mehmetsalih.deveci@outlook.com.Oracle DBA, SQL Server DBA, APPS DBA,  Exadata, Goldengate, EBS ve linux Danışmanlık ve Eğitim için  mehmetsalih.deveci@outlook.com a mail atabilirsiniz.

Leave a Reply

Your email address will not be published. Required fields are marked *