Planning Analytics workspace is down

[paxuser96]

Hi,

We are unable to bring up planning analytics workspace service, below is the error message that we are seeing for some of the containers when trying to start the PAX service. The space in C: is only 28 GB now, not sure if this is enough to bring up the containers. Could you please suggest any ideas? If cleanup is needed, please send us any instructions for cleaning up the windowsfilter.

Below is the version used.
OS: Windows 2016 server standard
PAW - PAW 2.0.55
TM1 - PA .0.9.2


ERROR: for paw-ui-api Cannot start service paw-ui-api: hcsshim::CreateComputeSysteme9c70c78d5a440a06be3d62b22e8595e9b2fe75150975786e53dbfa62f65f4e2: Insufficient system resources exist to complete the requested service.
(extra info: {"SystemType":"Container","Name":"e9c70c78d5a440a06be3d62b22e8595e9b2fe75150975786e53dbfa62f65f4e2","Owner":"docker","VolumePath":"\\\\?\\Volume{99ef8690-39a6-
11eb-b8c8-9f85d74bcf9b}","LayerFolderPath":"C:\\ProgramData\\docker\\windowsfilter\\e9c70c78d5a440a06be3d62b22e8595e9b2fe75150975786e53dbfa62f65f4e2","Layers":[{"ID":"f87df
71e-96b5-5d4d-bad3-f1f5fc18a687","Path":"C:\\ProgramData\\docker\\windowsfilter\\9d4d41a039c3cf89f2fbf3e215ffe74347704d6c52cb5da6efee455d7c899e4f"},{"ID":"1795d45d-4bf1-5d5
e-a1f6-2315a403676d","Path":"C:\\ProgramData\\docker\\windowsfilter\\5a4e78d87eea11f8c8481930783c87ab19993a70b59f2ca14ae9d02faf6b62a6"},{"ID":"3160db40-4db9-5e7a-adff-6d8f9
8b4af3e","Path":"C:\\ProgramData\\docker\\windowsfilter\\89cf3e9b32dca9c989635fceb67ffb9c569226e979d68a19ade2b6fd3f29c125"},{"ID":"266cdb87-6927-5a38-8b87-4a5054a5e0dd","Pa
th":"C:\\ProgramData\\docker\\windowsfilter\\aa0f850ba7cc735d4612954f126b8f13ec61fee4d64ec95c5cb2d8c62381b5f7"},{"ID":"1f0ad460-c88d-5a49-a417-8e4b70a44b4f","Path":"C:\\Pro
gramData\\docker\\windowsfilter\\31d1972267a5f666a6f866c5efc2ff03a29f0fedde335c59bddb31f7a53d381f"},{"ID":"32513b55-3e80-59f4-865b-a319d5240453","Path":"C:\\ProgramData\\do
cker\\windowsfilter\\fa412095b71f300b4a3d51a33c0b901204f22d6351c6d761935adfeeb64a2df6"},{"ID":"ef42a02e-2539-57b6-b9e5-a884d22d2794","Path":"C:\\ProgramData\\docker\\window
sfilter\\e26b667fb8e84eca69e08cf9c592b3fef4489b4f9d7fccefceae074e92600782"},{"ID":"ecdfa463-f7c0-5fde-95a4-bfcc9d369716","Path":"C:\\ProgramData\\docker\\windowsfilter\\33d
9add530e2e06c012d43452ae13b5aea06eea06b0c7c9db61aed37901a289d"},{"ID":"4d8a387a-8a9c-5c1a-8b5d-a5e3e771e857","Path":"C:\\ProgramData\\docker\\windowsfilter\\b3496287927fed2
d8a090afb3977d23a0ab16617b3a55b1e4f5fea53efd3fe92"},{"ID":"a4aa03c8-c0b6-5808-b929-416b4df95169","Path":"C:\\ProgramData\\docker\\windowsfilter\\f750377c0adbcfe04f29a4cd020
7cb0546ff70473d5a546cbc94cc2617ae6c9c"},{"ID":"ab772d5a-e7d1-5fb6-a55f-b869d81fb21d","Path":"C:\\ProgramData\\docker\\windowsfilter\\be815a3eda5f4a52b8cf947db9621b483e5db19
dbd066bbd723fab1efae67cfe"},{"ID":"6ac2fa67-4a01-54f7-b606-ac17e4003771","Path":"C:\\ProgramData\\docker\\windowsfilter\\943abd37d4b00b9bc4076640cb30623563d129eed4aa84dbce0
a008e818bd031"},{"ID":"623f5562-ec03-5335-b575-778665c398eb","Path":"C:\\ProgramData\\docker\\windowsfilter\\ba5bb61b68f4a65816ba5993886def11e70afabe03cd2a40fcb68cbe60f309b
3"},{"ID":"bd8c539b-a13b-500a-821e-1829822cd9f5","Path":"C:\\ProgramData\\docker\\windowsfilter\\e882f8df83fcf75601c48348c6d32caf13e17afe4be01cb6039ae7485dac9704"},{"ID":"e
4f8a3ff-e3e0-5fdc-ba59-f1ffcfa8599b","Path":"C:\\ProgramData\\docker\\windowsfilter\\2f7d90e6238093004c50772f65109c3c5b9980eed13d15af5508aea702ab7c1c"},{"ID":"0af75a30-df24
-583c-a125-fbe48b8dc8da","Path":"C:\\ProgramData\\docker\\windowsfilter\\9be5e08143d679caf4a4f4babaeca0af6d02c8fe3f410a2f10a9b39da2cba92c"},{"ID":"d8870767-a0e4-5174-9b8e-e
92c5894b859","Path":"C:\\ProgramData\\docker\\windowsfilter\\e31b01e5079dad57cd5cb1cc6c2bcc99c8f9d2ea8b00610d966751ce66006ad8"},{"ID":"4c095483-287e-598b-9545-4a6763f81fbc"
,"Path":"C:\\ProgramData\\docker\\windowsfilter\\a7d7f7cdf95df37fd710dba1b40fe7e0ed88dc9e37c7877674f76bc67f177dfe"},{"ID":"2a839dbd-55bb-538b-8a5e-c22021118054","Path":"C:\
\ProgramData\\docker\\windowsfilter\\c7a3b395df9ea09b71cf26c71bc2fa4545c13815d8d9a93b8713407ef56d80a6"},{"ID":"1d0d7edc-139a-5635-908a-516287037a50","Path":"C:\\ProgramData
\\docker\\windowsfilter\\8a89432a811305855911cd8d599074d6c4fac0f41d86a6b16f64c0b496442d38"},{"ID":"ae91fd6a-5068-5ff5-8730-78cea36e6d9c","Path":"C:\\ProgramData\\docker\\wi
ndowsfilter\\0baea10c3d489effbd8e8f9b19a916e389829681c52e36af7347f2dec74edad7"},{"ID":"d1d6c6b2-1fb2-54aa-a1ab-02fbba1710f8","Path":"C:\\ProgramData\\docker\\windowsfilter\
\70d9c67636c276c0ebdf661e18d645f2dca5c82eeeec3f02a5040a0fc6437d10"},{"ID":"720c4ec5-99a
9-5a52-ac4a-ce5d23d78a9a","Path":"C:\\ProgramData\\docker\\windowsfilter\\496b50e03c9f6fc4495c23fe0b1f009c6e462c07e5f463fa6c4be5471808844e"},{"ID":"8e9f8e80-1b9f-53a1-ab44-
845b20cd34e2","Path":"C:\\ProgramData\\docker\\windowsfilter\\f8efbdd13fc35dad912f8c035d6a0f5856b8745be39cc2489eda7e6a2f836f02"}],"HostName":"e9c70c78d5a4","MappedDirectori
es":[{"HostPath":"d:\\paw_admin\\log\\paw-ui-api","ContainerPath":"c:\\log","ReadOnly":false,"BandwidthMaximum":0,"IOPSMaximum":0,"CreateInUtilityVM":false}],"HvPartition":
false,"EndpointList":["96edadf0-0c6c-43ea-a306-2144cd3fda79"],"AllowUnqualifiedDNSQuery":true})

[Wim Gielis]

Hello,

I do have a suggestion. Why don't you use a recent version of the software (and related OS) ?
You are now on software that is almist 4 years old. In PAW and PA-land this is quite a big gap.

2.0.9.2 is from July 2020.

[Steve Rowe]

Not to pile in on this but Win 2016 also does not have mainstream support from Microsoft anymore....

This kind of issue really needs to be raised with IBM support but you may struggle to access this due to the age of your install.

If you think drive space is the issue, just add some more and see what happens.

Wins 2016 installs of PAW have a reputation for being a bit unstable, things like virus scanners and so forth being invasive and stopping the containers from working, windows updates breaking the install.

If it's possible in your environment I'd suggest you restore a back-up of the VM from when it was working and start from there, rather than trying to fix an already broken build.

[paxuser96]

Thanks Steve for your response.

Our Wintel has increased the size of C: by 100 GB (we have 128 GB of free space now in C:) and reboot the server. But still the PAW startup is saying the same message as insufficient resources. Now it does not look like a space issue on C: drive. Docker engine seems to be running fine.

The problem initially started after Wintel team installed some OS patches on the server and rebooted, PAW service did not come up after that. Wintel team has rolled back the installed patches too now but no luck. It looks like there is an antivirus called Crowdstrike running on the box, I am going to have them turned off and try again. do we have the instructions for removing PAW and reinstalling again on windows 2016? could you share it. I am going to try that if turning off the antivirus does not work.

[Steve Rowe]

Hi,
Rolling back the install of the patches is not the same is not the same as rolling back the VM to before the patches were installed. The damage will already have been done, you need to have the VM recovered from a back-up.

A simple google give you the install instructions for PAW on 2016.

https://www.ibm.com/docs/en/planning-an ... erver-2016

Cheers,

[burnstripe]

Is there sufficient memory on the server? The installation of new services could have pushed the memory usage up which could cause paw to fail if the memory on the server was already marginal.

[Steve Rowe]

A fellow forumer also pointed out that the licensing conditions have changed as well. If you try to reinstall PAW you're going to need a HCL Mirantis licence, make sure you fully understand this before proceeding. The lack of a licence may block you from installing the product (though I don't know this for a fact).

[paxuser96]

Hi,

The issue is closed. IBM gave the below steps to fix the issue.

1. docker rm $(docker ps -a -q)

2. edit regedit
Computer\HKEY_LOCAL_MACHINE\SYSTEM\ControlSet001\Services\NDIS\IfTypes\23
registry name - IfUsedNetLuidIndices
do modify select all values, delete them and type in '01'
save and exit

3. reboot the windows server

4. run ./ps1.ps to create the containers

[MarenC]

Hi Paxuser,

Thank you for taking the time to update this case.

Maren