[I] Azure CI parallel jobs limit restored

[Alexander Bokovoy]

Hi,

Azure CI jobs limit was restored yesterday to 10 parallel jobs.

Thanks to Microsoft for handling the request quickly.

I restarted Azure CI in Rob's pull request
https://github.com/freeipa/freeipa/pull/6184 to see how it goes.

One thing I noticed this morning is that Build / Tox / WebUI unit test
phases do not work anymore with Fedora 34 as nodejs cannot be installed:
Error: 
  Problem: cannot install the best candidate for the job
   - nothing provides /usr/bin/pwsh needed by nodejs-1:14.19.0-2.fc34.x86_64

This is definitely a Fedora issue but it is a reminder that we should
actually switch to Fedora 35 or even Fedora 36 in Azure CI. Fedora 36
was recently branched and will go to Beta stage in March, so we should
be able to test-drive it.

[Alexander Bokovoy]

On ti, 15 helmi 2022, Alexander Bokovoy via FreeIPA-devel wrote:
> Hi,
>
> Azure CI jobs limit was restored yesterday to 10 parallel jobs.
>
> Thanks to Microsoft for handling the request quickly.
>
> I restarted Azure CI in Rob's pull request
> https://github.com/freeipa/freeipa/pull/6184 to see how it goes.
>
> One thing I noticed this morning is that Build / Tox / WebUI unit test
> phases do not work anymore with Fedora 34 as nodejs cannot be installed:
> Error:  Problem: cannot install the best candidate for the job
> nothing provides /usr/bin/pwsh needed by nodejs-1:14.19.0-2.fc34.x86_64
>
> This is definitely a Fedora issue but it is a reminder that we should
> actually switch to Fedora 35 or even Fedora 36 in Azure CI. Fedora 36
> was recently branched and will go to Beta stage in March, so we should
> be able to test-drive it.

I submitted https://github.com/freeipa/freeipa/pull/6188 to switch Azure
CI to registry.fedoraproject.org/fedora-toolbox:36 as a base. This also
gives us opportunity to run against OpenSSL 3.0.0 and OpenLDAP 2.6.

Build and docs targets worked out of the box but Web UI unit tests
failed as there is no default OpenSSL configuration anymore. I'll look
into it.

Tox build also failed as python-ldap wheel in PIP is not ready for
OpenLDAP 2.6 (attempts to link against libldap_r which is removed in
2.6).

Christian, any idea how we can update python-ldap wheel?

[Stanislav Levin]

15.02.2022 12:29, Alexander Bokovoy via FreeIPA-devel пишет:
> On ti, 15 helmi 2022, Alexander Bokovoy via FreeIPA-devel wrote:
> > Hi,
> >
> > Azure CI jobs limit was restored yesterday to 10 parallel jobs.
> >
> > Thanks to Microsoft for handling the request quickly.
> >
> > I restarted Azure CI in Rob's pull request
> > https://github.com/freeipa/freeipa/pull/6184 to see how it goes.
> >
> > One thing I noticed this morning is that Build / Tox / WebUI unit test
> > phases do not work anymore with Fedora 34 as nodejs cannot be installed:
> > Error:  Problem: cannot install the best candidate for the job
> >  - nothing provides /usr/bin/pwsh needed by
> > nodejs-1:14.19.0-2.fc34.x86_64
> >
> > This is definitely a Fedora issue but it is a reminder that we should
> > actually switch to Fedora 35 or even Fedora 36 in Azure CI. Fedora 36
> > was recently branched and will go to Beta stage in March, so we should
> > be able to test-drive it.
>
> I submitted https://github.com/freeipa/freeipa/pull/6188 to switch Azure
> CI to registry.fedoraproject.org/fedora-toolbox:36 as a base. This also
> gives us opportunity to run against OpenSSL 3.0.0 and OpenLDAP 2.6.
>
> Build and docs targets worked out of the box but Web UI unit tests
> failed as there is no default OpenSSL configuration anymore. I'll look
> into it.
>
> Tox build also failed as python-ldap wheel in PIP is not ready for
> OpenLDAP 2.6 (attempts to link against libldap_r which is removed in
> 2.6).
>
> Christian, any idea how we can update python-ldap wheel?

As far as I know Tox task was intended for checking of PyPI related
stuff (ipa-client's wheels), but freeipa-client is stuck on PyPI as
4.8.9. If PyPI is no longer the case then the tox task can be removed.

[Alexander Bokovoy]

On ti, 15 helmi 2022, Stanislav Levin wrote:
> 15.02.2022 12:29, Alexander Bokovoy via FreeIPA-devel пишет:
> > On ti, 15 helmi 2022, Alexander Bokovoy via FreeIPA-devel wrote:
> > > Hi,
> > >
> > > Azure CI jobs limit was restored yesterday to 10 parallel jobs.
> > >
> > > Thanks to Microsoft for handling the request quickly.
> > >
> > > I restarted Azure CI in Rob's pull request
> > > https://github.com/freeipa/freeipa/pull/6184 to see how it goes.
> > >
> > > One thing I noticed this morning is that Build / Tox / WebUI unit test
> > > phases do not work anymore with Fedora 34 as nodejs cannot be installed:
> > > Error:  Problem: cannot install the best candidate for the job
> > >  - nothing provides /usr/bin/pwsh needed by
> > > nodejs-1:14.19.0-2.fc34.x86_64
> > >
> > > This is definitely a Fedora issue but it is a reminder that we should
> > > actually switch to Fedora 35 or even Fedora 36 in Azure CI. Fedora 36
> > > was recently branched and will go to Beta stage in March, so we should
> > > be able to test-drive it.
> >
> > I submitted https://github.com/freeipa/freeipa/pull/6188 to switch Azure
> > CI to registry.fedoraproject.org/fedora-toolbox:36 as a base. This also
> > gives us opportunity to run against OpenSSL 3.0.0 and OpenLDAP 2.6.
> >
> > Build and docs targets worked out of the box but Web UI unit tests
> > failed as there is no default OpenSSL configuration anymore. I'll look
> > into it.
> >
> > Tox build also failed as python-ldap wheel in PIP is not ready for
> > OpenLDAP 2.6 (attempts to link against libldap_r which is removed in
> > 2.6).
> >
> > Christian, any idea how we can update python-ldap wheel?
>
> As far as I know Tox task was intended for checking of PyPI related
> stuff (ipa-client's wheels), but freeipa-client is stuck on PyPI as
> 4.8.9. If PyPI is no longer the case then the tox task can be removed.

Well, we need to update it. I think it is largely my fault as I forgot
to do that for quite some time and since Christian is busy with
Kubernetes work, we missed it.

I'll try to update PyPI this week. But this doesn't change the situation
with python-ldap and OpenLDAP 2.6. Upstream
https://github.com/python-ldap/python-ldap/pull/461 is a mess...

[Alexander Bokovoy]

On ti, 15 helmi 2022, Alexander Bokovoy via FreeIPA-devel wrote:
> On ti, 15 helmi 2022, Stanislav Levin wrote:
> > 15.02.2022 12:29, Alexander Bokovoy via FreeIPA-devel пишет:
> > > On ti, 15 helmi 2022, Alexander Bokovoy via FreeIPA-devel wrote:
> > > > Hi,
> > > >
> > > > Azure CI jobs limit was restored yesterday to 10 parallel jobs.
> > > >
> > > > Thanks to Microsoft for handling the request quickly.
> > > >
> > > > I restarted Azure CI in Rob's pull request
> > > > https://github.com/freeipa/freeipa/pull/6184 to see how it goes.
> > > >
> > > > One thing I noticed this morning is that Build / Tox / WebUI unit test
> > > > phases do not work anymore with Fedora 34 as nodejs cannot be installed:
> > > > Error:  Problem: cannot install the best candidate for the job
> > > >  - nothing provides /usr/bin/pwsh needed by
> > > > nodejs-1:14.19.0-2.fc34.x86_64
> > > >
> > > > This is definitely a Fedora issue but it is a reminder that we should
> > > > actually switch to Fedora 35 or even Fedora 36 in Azure CI. Fedora 36
> > > > was recently branched and will go to Beta stage in March, so we should
> > > > be able to test-drive it.
> > >
> > > I submitted https://github.com/freeipa/freeipa/pull/6188 to switch Azure
> > > CI to registry.fedoraproject.org/fedora-toolbox:36 as a base. This also
> > > gives us opportunity to run against OpenSSL 3.0.0 and OpenLDAP 2.6.
> > >
> > > Build and docs targets worked out of the box but Web UI unit tests
> > > failed as there is no default OpenSSL configuration anymore. I'll look
> > > into it.
> > >
> > > Tox build also failed as python-ldap wheel in PIP is not ready for
> > > OpenLDAP 2.6 (attempts to link against libldap_r which is removed in
> > > 2.6).
> > >
> > > Christian, any idea how we can update python-ldap wheel?
> >
> > As far as I know Tox task was intended for checking of PyPI related
> > stuff (ipa-client's wheels), but freeipa-client is stuck on PyPI as
> > 4.8.9. If PyPI is no longer the case then the tox task can be removed.
>
> Well, we need to update it. I think it is largely my fault as I forgot
> to do that for quite some time and since Christian is busy with
> Kubernetes work, we missed it.
>
> I'll try to update PyPI this week. But this doesn't change the situation
> with python-ldap and OpenLDAP 2.6. Upstream
> https://github.com/python-ldap/python-ldap/pull/461 is a mess...

I fixed Tox task by providing a symlink for libldap_r.so to libldap.so.
This is OK because in most Linux distributions OpenLDAP was and is built
with POSIX threads which makes libldap.so from OpenLDAP 2.6 and
libldap_r.so from OpenLDAP 2.4 the same.

Web UI task was setting a bogus OpenSSL configuration which is now
causing a failure to parse with OpenSSL 3.0.0. If that one is removed,
PhantomJS will still fail internally as OpenSSL 3.0.0 is not able to
parse their configuration file. I need to add a compatible
configuration.