Webui on OpenVMS V9.1-A (X86) No data displayed.

[connersegh]

(Post edited and revised 20220304 1643 EST)

I installed and configured WEBUI guided by https://vmssoftware.com/docs/webui-release-notes.pdf and https://www.youtube.com/watch?v=Yf00uFVcS1U and VSI-X86VMS-WEBUI-V0400-2-1-RELEASE-NOTES.PDF

I granted the webui_write and webui_read to users system and david.

I can connect to the gui with my browser.

Webui is not displaying any data except the incorrect date "29 October 2021 08:24" and the the name of the logged in user.

OpenVMS V9.1-A
$ product install *

1 - VSI X86VMS CIVETWEB V1.14-0C Layered Product
2 - VSI X86VMS LUA V5.3-5C Layered Product
3 - VSI X86VMS OPENSSH V8.8-1A Layered Product
4 - VSI X86VMS OPENSSH V8.6-1A Layered Product
5 - VSI X86VMS V91A_UPD V1.0 Patch (remedial update)
6 - VSI X86VMS WEBUI V4.0-2 Layered Product

I can read the api docs at http://lurch:8082/webui/docs/api.html

My .conf files:


$ sea *.conf /mat=nor "#"

******************************
CIVETWEB$ROOT:[conf]alert_images.conf;1
SQL /civetweb$root/local/sql.exe null


******************************
CIVETWEB$ROOT:[conf]civetweb.conf;2
listening_ports 8082
document_root /civetweb$root/htdocs
url_rewrite_patterns /api/**=/civetweb$root/htdocs/api/api.lua



******************************
CIVETWEB$ROOT:[conf]perfdat.conf;2
host 127.0.0.1
port 5254
user david
pass *********
debug 1

******************************
CIVETWEB$ROOT:[conf]services.conf;2
/login /civetweb$root/local/login.exe LoginHandler
/api/token /civetweb$root/local/login.exe ApiLoginHandler
/perfdat /civetweb$root/local/perfdat.exe PerfdatHandler


******************************
CIVETWEB$ROOT:[conf]threads.conf;1
/civetweb$root/local/main.exe /civetweb$root/conf/alert_images.conf


******************************
CIVETWEB$ROOT:[conf]webui.conf;2
secret_key secret123
disableJWT NO
max_ws_clients 5

These Identifiers are granted to users david and system.

Identifier Value Attributes
WEBUI_WRITE %X80010003
WEBUI_READ %X80010002

My sys$manager:systartup_vms.com section of interest

$ set verify
$ define/sys webui$report_files civetweb$root:[htdocs.reports.files]
$ define/sys webui$report_scripts civetweb$root:[htdocs.reports.scripts]
$ @sys$startup:perfdat$startup.com
$ @sys$startup:perfdat_eva$startup.com
$ @sys$startup:perfdat_snmp$startup.com
$!
$ @sys$startup:LUA$STARTUP.COM
$ @sys$startup:CIVETWEB$STARTUP.COM
$ @sys$startup:webui$restart.com
$!
$ set noverify

I can provide a log of that startup.

Any suggestions on how to debug this "no data displayed" issue?

On my firefox console - I see these errors.

Uncaught (in promise) SyntaxError: JSON.parse: unexpected character at line 1 column 1 of the JSON data

Appreciated!

[connersegh]

Some additional experiments.
I noticed that I was missing a logical in the VM from comment #1 as compared to the youtube demo

"LUA$ODS5_AVAIL" = "1"

Maybe the LUA V5.3-5C install was flawed?

I created a new clean VM.

Installed LUA V5.3-5B
Logical is present.
Installed LUA V5.3-5C
Logical is present.

$ PRODUCT SHOW HISTORY */OPERATION=INSTALL
------------------------------------ ----------- ----------- --- -----------
PRODUCT KIT TYPE OPERATION VAL DATE
------------------------------------ ----------- ----------- --- -----------
VSI X86VMS LUA V5.3-5C Full LP Install Val 06-MAR-2022
VSI X86VMS WEBUI V4.0-2 Full LP Install Val 06-MAR-2022
VSI X86VMS CIVETWEB V1.14-0C Full LP Install Val 06-MAR-2022
VSI X86VMS LUA V5.3-5B Full LP Install Val 06-MAR-2022
VSI X86VMS OPENSSH V8.7-1B Full LP Install Val 06-MAR-2022
VSI X86VMS DECNET_PHASE_IV V9.1-A Full LP Install (U) 05-MAR-2022
VSI X86VMS DWMOTIF V1.7-X4 Full LP Install (D) 05-MAR-2022
VSI X86VMS DWMOTIF_SUPPORT V9.1-A Full LP Install (U) 05-MAR-2022
VSI X86VMS KERBEROS V3.3-1 Full LP Install (D) 05-MAR-2022
VSI X86VMS OPENVMS V9.1-A Platform Install Sys 05-MAR-2022
VSI X86VMS SSL111 V1.1-1K Full LP Install (D) 05-MAR-2022
VSI X86VMS TCPIP X6.0-12 Full LP Install (D) 05-MAR-2022
VSI X86VMS VMS V9.1-A Oper System Install Sys 05-MAR-2022
------------------------------------ ----------- ----------- --- -----------
13 items found



Working from https://github.com/vmssoftware/pywebui to see what worked from the python interface.

I gleaned the URL from VSI-X86VMS-WEBUI-V0400-2-1-RELEASE-NOTES.PDF

I only have my X86 VMs to work on, Idon't know if the below would have "worked" on an IA64 OS.

>>> import pywebui
>>> c = pywebui.Connector('http://192.168.1.46:8082')
>>> c.login('system', 'password')
>>> c.get_users()
Traceback (most recent call last):
File "/usr/local/lib/python3.6/site-packages/urllib3/connectionpool.py", line 706, in urlopen
chunked=chunked,
File "/usr/local/lib/python3.6/site-packages/urllib3/connectionpool.py", line 445, in _make_request
six.raise_from(e, None)
File "<string>", line 3, in raise_from
File "/usr/local/lib/python3.6/site-packages/urllib3/connectionpool.py", line 440, in _make_request
httplib_response = conn.getresponse()
File "/usr/lib64/python3.6/http/client.py", line 1361, in getresponse
response.begin()
File "/usr/lib64/python3.6/http/client.py", line 311, in begin
version, status, reason = self._read_status()
File "/usr/lib64/python3.6/http/client.py", line 293, in _read_status
raise BadStatusLine(line)
http.client.BadStatusLine: error loading module 'vms.rtl.lib' from file '/lua$root/lib/vms/rtl/lib.exe':

Installed VSI X86VMS V91A_UPD V1.0

Rebooted

Same results, in the WEBUI GUI (No data except this wrong date "29 October 2021 08:24" and the username of the logged in user. And same python error.

[connersegh]

Progress!

Built a x86e92oe kvm vm.
Installed kits VSI-X86VMS-LUA-V0503-5CA-1.ZIP VSI-X86VMS-CIVETWEB-V0114-0CA-1.ZIP VSI-X86VMS-WEBUI-V0400-2-1.ZIP

Follow the instructions in the PDF's Some data is loading (and the date is correct)

Screenshot attached. Work in progress. Next up install and set up PERFDAT.

[jeetu.singh]

I have latest V9.2 installed and I am facing same issue. Even worst, If I loaded login pages, performed logged IN/Logout, after refresh It's keep processing and never gets login page back until I am NOT restarting civetweb process.

Please suggest if any clue. Thank you in advance.

OpenVMS V9.2 on node GT4105 16-SEP-2022 03:57:27.43 Uptime 3 14:44:17
VMware, Inc. VMware7,1

------------------------------------ ----------- ---------
PRODUCT KIT TYPE STATE
------------------------------------ ----------- ---------
VMSPORTS X86VMS PERL534 T5.34-0 Full LP Installed
VSI X86VMS AVAIL_MAN_BASE V9.2 Full LP Installed
VSI X86VMS CIVETWEB V1.14-0D Full LP Installed
VSI X86VMS CSWS V2.4-48AB Full LP Installed
VSI X86VMS DECNET_PLUS V9.2-B Full LP Installed
VSI X86VMS DWMOTIF V1.8 Full LP Installed
VSI X86VMS DWMOTIF_SUPPORT V9.2 Full LP Installed
VSI X86VMS KERBEROS V3.3-2 Full LP Installed
VSI X86VMS LUA V5.3-5D Full LP Installed
VSI X86VMS OPENSSH V8.9-1B Full LP Installed
VSI X86VMS OPENVMS V9.2 Platform Installed
VSI X86VMS SSL111 V1.1-1N Full LP Installed
VSI X86VMS TCPIP X6.0-16 Full LP Installed
VSI X86VMS VMS V9.2 Oper System Installed
VSI X86VMS WEBUI V4.1-1 Full LP Installed
------------------------------------ ----------- ---------

[connersegh]

Hi Jeetu,

After making what small progress I had, I put this away with an eye to returning to it. So nothing new to offer yet.
I'm still running E9.2, so my packages are a version behind yours.
I'm still interested, I'll start my revisiting and post what I learn.

[connersegh]

This seems significant.

Rebooted my system, started WEBUI.
I can browse the api doc - so web server is ok.
http://bshark.egh.com:8082/webui/docs/api.html

$ type/page CIVETWEB$ROOT:[logs]pthread_dump.log

%DECthreads bugcheck (version V3.23-001), terminating execution.

%Reason: lckMcsLock: deadlock detected, cell = 0x25c3280

%Running on OpenVMS E9.2 on Red Hat KVM, 11468Mb; 1 CPUs

% The bugcheck occurred at 18-SEP-2022 15:39:58.01, running image
% BSHARK$DKA100:[SYS0.SYSCOMMON.civetweb.][bin]civetweb.exe;1 in process
% 440 (named "CIVETWEB"), under username "SYSTEM". AST delivery is enabled for
% all modes; ASTs are active in user. Upcalls are disabled. Multiple kernel
% threads are disabled.
% The current thread sequence number is 2, at 0x25c3280
% Current thread traceback:
% 0: PC 0x806b5b6, SP 0x25bf5a0, ICTX 0x25bf5a0
% 1: PC 0x8079eab, SP 0x25bfc30, ICTX 0x25bfc30
% 2: PC 0x8079d90, SP 0x25bfcd0, ICTX 0x25bfcd0
% 3: PC 0x8073f4b, SP 0x25bfd00, ICTX 0x25bfd00
% 4: PC 0x8076cf3, SP 0x25bfd40, ICTX 0x25bfd40
% 5: PC 0x80745a3, SP 0x25bfd70, ICTX 0x25bfd70
% 6: PC 0x807f689, SP 0x25bfd90, ICTX 0x25bfd90
% 7: PC 0x7f41f4a, SP 0x25bfe70, ICTX 0x25bfe70
% 8: PC 0x7f4195c, SP 0x25bfe90, ICTX 0x25bfe90
% 9: PC 0x8109bb0, SP 0x25bfec0, ICTX 0x25bfec0

My login to the GUI hangs when I refresh the page.
My browser to the API docs continues to behave well.

I also have a dmp file which zips down to 6.2M.

$ dir /date/time/size

Directory CIVETWEB$ROOT:[logs]

civetweb.DMP;1 24091 18-SEP-2022 15:39:58.08

Analyzing that looks possible but sadly is over my head. (ie - so what next?)

$ ANALYZE/CRASH_DUMP CIVETWEB$ROOT:[logs]civetweb.DMP

OpenVMS system dump analyzer
...analyzing an x86-64 compressed process dump...

Dump taken on 18-SEP-2022 15:39:58.08 using version E9.2

SDA>

[brett.cameron]

Thanks for the information; we will investigate. Based on the details you have provided, this could be a thread-related issue that has been fixed post-E9.2; we will attempt to verify (one way or the other). The fact that you can browse the API documentation is interesting, and provides a useful clue.

[connersegh]

Good news - WEBUI success (so far)

Yesterday I installed my V9.2 and my V9.1-A symptoms are gone, problems seem,to be resolved, I had user system logged in to the GUI since yesterday afternoon, GUI is still updating this morning, Logged out and back in, WEBUI still seems well behaved.

I made some mistakes along the way that resulted in a broken installation.

I followed the Docs as best I could but initially missed a nuance.
I installed in the correct order (LUA, CIVET, WBUI) but was missing a directory.

CIVETWEB$ROOT:[logs]civetweb_EAGLE.log;5
Unable to open image /civetweb$root/local/login.exe: directory not found

From the WEBUI instructions:
Before installing the WebUI as described in the following section it is important to ensure that the
CivetWeb web server is installed and is running, or at a minimum that the system logical name
CIVETWEB$ROOT is defined and points to a valid CivetWeb installation. The WebUI files are installed
under the directory pointed to by this logical name. If this location is not defined or does not exist
then the WebUI installation will fail.

I uninstalled WEBUI, CIVET (in hindsight uninstalling CIVET was maybe not needed)
Reinstalled CIVET.
I started CIVET so that the required logical would be present.
@SYS$STARTUP:CIVETWEB$STARTUP.COM

I reinstalled WEBUI - and that created CIVETWEB$ROOT:[LOCAL]
$ dj CIVETWEB$ROOT:[LOCAL]

Directory CIVETWEB$ROOT:[local]

log.exe;1 18 31-MAY-2022 07:41:40.21
login.exe;1 79417 31-MAY-2022 07:41:41.98
main.exe;1 615 31-MAY-2022 07:41:43.64
perfdat.exe;1 79628 31-MAY-2022 07:41:45.22
sql.exe;1 3304 31-MAY-2022 07:41:47.95
terminal.exe;1 40 31-MAY-2022 08:43:40.43

Copied in the config files as directed.
$ set process /parse = extended
$
$ set default civetweb$root:[conf]
$ copy civetweb^.conf.webui civetweb.conf
$ copy services^.conf.webui services.conf
$ copy alert_images^.conf.template alert_images.conf
$ copy threads^.conf.template threads.conf
$ copy webui^.conf.template webui.conf

$ @SYS$STARTUP:WEBUI$RESTART.COM

My relevant section of sys$startup:SYSTARTUP_VMS.COM

$!
$ file := SYS$STARTUP:LUA$STARTUP.COM
$ if f$search("''file'") .nes. "" then @'file'
$!
$ file := SYS$STARTUP:CIVETWEB$STARTUP.COM
$ if f$search("''file'") .nes. "" then @'file'
$!
@SYS$STARTUP:WEBUI$RESTART.COM

$ product show product
------------------------------------ ----------- ---------
PRODUCT KIT TYPE STATE
------------------------------------ ----------- ---------
VMSPORTS X86VMS PERL534 T5.34-0 Full LP Installed
VSI X86VMS AVAIL_MAN_BASE V9.2 Full LP Installed
VSI X86VMS CIVETWEB V1.14-0D Full LP Installed
VSI X86VMS DECNET_PLUS V9.2-B Full LP Installed
VSI X86VMS DWMOTIF V1.8 Full LP Installed
VSI X86VMS DWMOTIF_SUPPORT V9.2 Full LP Installed
VSI X86VMS KERBEROS V3.3-2 Full LP Installed
VSI X86VMS LUA V5.3-5D Full LP Installed
VSI X86VMS OPENSSH V8.9-1B Full LP Installed
VSI X86VMS OPENVMS V9.2 Platform Installed
VSI X86VMS SSL111 V1.1-1N Full LP Installed
VSI X86VMS TCPIP X6.0-16 Full LP Installed
VSI X86VMS VMS V9.2 Oper System Installed
VSI X86VMS WEBUI V4.1-1 Full LP Installed
------------------------------------ ----------- ---------
14 items found

Logs created when I restarted WEBUI this morning. with warnings that are not fatal?

$ ty CIVETWEB$ROOT:[logs]civetweb_EAGLE.log;
$ Set NoOn
$ VERIFY = F$VERIFY(F$TRNLNM("SYLOGIN_VERIFY"))
Loading config file /civetweb$root/conf/civetweb.conf
Reading service details from /civetweb$root/conf/services.conf
Reading thread details from /civetweb$root/conf/threads.conf
22-SEP-2022 11:40:23.65: SL_CLI-I-ALRTINIT, Alert images loading:
SQL: opcom ok, intru ok, device ok, purge ok, term ok, init ok

$ type CIVETWEB$ROOT:[logs]webui_term.log;6
ssl_use_pem_file: cannot open certificate file /civetweb$root/resources/cert/server.pem: error:02001002:system library:fopen:no such file or directory
Error initializing SSL context

$ type CIVETWEB$ROOT:[logs]webui_term_error.log;
Cannot start CivetWeb - mg_start failed.


Added in 6 hours 19 minutes 15 seconds:
My related config files:

Note that I'm not using perfdat yet. I'll post my perfat success or failure when I get there.

Commented out in services.conf.
###/perfdat /civetweb$root/local/perfdat.exe PerfdatHandler


$ sea /mat=nor *.conf; #

******************************
CIVETWEB$ROOT:[conf]alert_images.conf;2

SQL /civetweb$root/local/sql.exe null

******************************
CIVETWEB$ROOT:[conf]civetweb.conf;4

listening_ports 8082
document_root /civetweb$root/htdocs
url_rewrite_patterns /api/**=/civetweb$root/htdocs/api/api.lua

******************************
CIVETWEB$ROOT:[conf]services.conf;4

/login /civetweb$root/local/login.exe LoginHandler
/api/token /civetweb$root/local/login.exe ApiLoginHandler

******************************
CIVETWEB$ROOT:[conf]threads.conf;2

/civetweb$root/local/main.exe /civetweb$root/conf/alert_images.conf

******************************
CIVETWEB$ROOT:[conf]webui.conf;2

secret_key secret123
disableJWT NO
max_ws_clients 5