WLS Node Manager to Start Servers: JPS-01050: Can not open Wallet, check password

related posts:
https://forums.oracle.com/thread/1087777

http://www.iamidm.com/2013/04/weblogic-error-ldap-bootstrap.html

We ran into this crazy issue today.

Problem Summary
---------------------------------------------------
Oracle 11g IDM WLS_ods1 server could not be started up JPS-01050

Problem Description
---------------------------------------------------
We installed 11G IDM with the OID only. After the installation, both Admin Server and WLS_ODS1 server are up and running.

We then reconfigured the node manager, IDM Admin Server and WLS_ODS1 server to use the Custom Certificates. Then we restarted node Manager, and we restarted Admin Server using startWeblogic.cmd under e:\oracle\idm\user_project\domains\idmdomain

Admin Server is up, but wls_ods1 is down. From Admin Server Console, I can see that the node manager is reachable. Restart WLS_ODS1 from the Admin Server Console, failed. WLS_ODS1.log is giving the following info:

JPS-01050:Opening of wallet credential store failed. PKI-02002: Unable to open the wallet. Check password.

I then tried to start WLS_ODS1 from
e:\oracle\idm\user_project\domains\idmdomain using startWeblogicManagedServer.cmd, WLS_ODS1 is started successfully.

When I tried to start Admin Server from the node manager via wlst, I got the same errors.
It appears that we have a problem to start servers from the node manager.
--------------------------------------------
Solution:
 

We have tried everything. 
 We used the ideas suggested in the above posts, such as:

(1)"using orapki you should be able to see the contents of the wallet without a password. try using this:

ORACLE_WM_HOME/oracle_common/bin/orapki wallet display -wallet ORACLE_WM_HOME/user_projects/domains/idmdomain/config/fmwconfig "

It worked. the content seemed fine.

(2) we also recreated the wallet using the following:
Oracle wallet, if it still asking password when you have cwallet.sso file, it means it corrupted.
Just generate it again:
orapki wallet create -wallet wallet path on fmwconfig -auto_login_only

That should create a new cwallet.sso.

(3)We have changed permission to e:\tmp folder and other temp folder and etc.
None of the above worked!

(4)
At the end, we decided to use FileMon to find out exactly which wallet it was trying to open. From the FileMon output, we can see that the wallet was found and used. but we found the system is looking for folder "c:\Temp; c:\TMP" and was not able to open it. 
The cause: Oracle WLS node manager or WLS server is looking for directory defined by environment variable  TEMP and TMP to locate the folder where it can write temporary files into, and could not find it.
Oracle gave extremely misleading error messages!

Once we cleaned up environment varilable TEMP and TMP to include only 1 folder. The problem went away. We can start the Admin Server from the node manager via wlst.cmd. and we can also start wls_ods1 from the admin console, which uses node manager to start the managed server.