CPAN Search Going Away

[Dave Cross]

See https://log.perl.org/2018/05/goodbye-search-dot-cpan-dot-org.html

This means that the URLs included in RPMs of CPAN modules will need to
change to MetaCPAN URLs.

Please let me know if I can be any help making this happen.

Dave...

[Petr Šabata]

On Fri, May 18, 2018 at 10:55:02AM +0100, Dave Cross wrote:
>  See https://log.perl.org/2018/05/goodbye-search-dot-cpan-dot-org.html
Thanks for bringing this up.

>  This means that the URLs included in RPMs of CPAN modules will need
> to
>  change to MetaCPAN URLs. 
Well, that's sad news.

Regarding the change, it's good they will keep the old URLs
working, quoting:

    Shortly, a link will be added to all pages on
    search.cpan.org to inform users of the upcoming change.
    After about a month, all traffic will be redirected
    to the equivalent MetaCPAN page.

I vaguely remember there were some differences between
cpan.org and metacpan.org in what they considered released
vs. in development.  Some of the packages I was maintaining
were affected by that.  I suppose that's no longer an issue
given that MetaCPAN is going to be the only source.

>  Please let me know if I can be any help making this happen. 
I wonder if creating a "CPAN URL" macros for URL and Source
would make sense in the long term + to clean the SPEC files
but I wouldn't want to overengineer things here :)

P

>  
>  Dave...
>  _______________________________________________
>  perl-devel mailing list -- perl-devel(a)lists.fedoraproject.org
>  To unsubscribe send an email to perl-devel-leave(a)lists.fedoraproject.org
>  Fedora Code of Conduct: https://getfedora.org/code-of-conduct.html
>  List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines
>  List Archives:
> https://lists.fedoraproject.org/archives/list/[e-mail]...

[Dave Cross]

On Fri, 18 May 2018 at 11:29, Petr Šabata <contyk(a)redhat.com&gt; wrote:

>  On Fri, May 18, 2018 at 10:55:02AM +0100, Dave Cross wrote:
>  > See https://log.perl.org/2018/05/goodbye-search-dot-cpan-dot-org.html 
>  Thanks for bringing this up. 
>  > This means that the URLs included in RPMs of CPAN modules will
> need to
>  > change to MetaCPAN URLs. 
>  Well, that's sad news. 
I don't think so. I've used MetaCPAN exclusively for the last five years. I
think it's a better site.

>  Regarding the change, it's good they will keep the old URLs
>  working, quoting: 
>       Shortly, a link will be added to all pages on
>       search.cpan.org to inform users of the upcoming change.
>       After about a month, all traffic will be redirected
>       to the equivalent MetaCPAN page. 
Yes. I'm not suggesting that you'll need to change everything immediately.
The redirects will mean that the old URLs will continue to work
indefinitely. But you should change the web site that is listed in new
packages.

>  I vaguely remember there were some differences between
>  cpan.org and metacpan.org in what they considered released
>  vs. in development.  Some of the packages I was maintaining
>  were affected by that.  I suppose that's no longer an issue
>  given that MetaCPAN is going to be the only source. 
I think the change needs to be this. Currently, CPAN RPMs contain URLs like
this:

http://search.cpan.org/dist/Moose

That should be replaced with:

https://metacpan.org/release/Moose

>  > Please let me know if I can be any help making this happen.
>  I wonder if creating a "CPAN URL" macros for URL and
> Source
>  would make sense in the long term + to clean the SPEC files
>  but I wouldn't want to overengineer things here :) 
I assume there's a single piece of code that generates the URL from the
module details. Isn't that all that needs to change?

I'm going to create a patch for cpanspec as that's the tool I use to create
RPMs.

Cheers,

Dave...

[Emmanuel Seyman]

* Dave Cross [18/05/2018 10:55] :
>  This means that the URLs included in RPMs of CPAN modules will need to
>  change to MetaCPAN URLs. 
JFTR, I've filed an issue against anitya (the software run by
release-monitoring.org).

https://github.com/release-monitoring/anitya/issues/558

Emmanuel

[Jan Pazdziora]

On Fri, May 18, 2018 at 10:55:02AM +0100, Dave Cross wrote:
>  See
> https://log.perl.org/2018/05/goodbye-search-dot-cpan-dot-org.html
>  
>  This means that the URLs included in RPMs of CPAN modules will need to
>  change to MetaCPAN URLs.
>  
>  Please let me know if I can be any help making this happen. 
There's now update on that page:

	 Update #1 (2018-05-19):  There's some confusion around
	 whether or not existing search.cpan.org URLs will
	 continue to work.  They will!  The vast majority of of them
	 will be transparently served by MetaCPAN pages.
	 You do not need to update any links right now. 

-- 
Jan Pazdziora
Senior Principal Software Engineer, Security Engineering, Red Hat

[Petr Pisar]

On Fri, May 18, 2018 at 10:55:02AM +0100, Dave Cross wrote:
>  See
> https://log.perl.org/2018/05/goodbye-search-dot-cpan-dot-org.html
>  
>  This means that the URLs included in RPMs of CPAN modules will need to
>  change to MetaCPAN URLs.
>  
>  Please let me know if I can be any help making this happen.
>   
I can mass update spec files for all Perl packages. I submitted this Fedora 29
change request <https://fedoraproject.org/wiki/Changes/Perl_Move_to_MetaCPAN>
and this packaging guidelines request
<https://pagure.io/packaging-committee/issue/770>;.

If it is approved, I will try to do that before Perl 5.28 mass rebuild so
that the change becomes visible in Fedora 29 release.

I propose rewriting both URL and Source tags like this:

-URL:            http://search.cpan.org/dist/CPANPLUS/
+URL:            https://metacpan.org/release/CPANPLUS
-Source0:       
http://www.cpan.org/authors/id/B/BI/BINGOS/CPANPLUS-%{cpan_version}.tar.gz
+Source0:       
https://cpan.metacpan.org/authors/id/B/BI/BINGOS/CPANPLUS-%{cpan_version}...

Are you fine with it?

While the old addresses will probably work, I believe it makes sense to update
them because:

(1) The less intermediary steps to the final location, the better. (Fewer
    things can get broken.) 
(2) It's good when a user see the same address in RPM and in his web browser.

-- Petr

[Dan Book]

On Thu, May 24, 2018 at 12:34 PM, Petr Pisar <ppisar(a)redhat.com&gt; wrote:

>  On Fri, May 18, 2018 at 10:55:02AM +0100, Dave Cross wrote:
>  > See https://log.perl.org/2018/05/goodbye-search-dot-cpan-dot-org.html
>  >
>  > This means that the URLs included in RPMs of CPAN modules will need to
>  > change to MetaCPAN URLs.
>  >
>  > Please let me know if I can be any help making this happen.
>  >
>  I can mass update spec files for all Perl packages. I submitted this
>  Fedora 29
>  change request <https://fedoraproject.org/wiki/Changes/Perl_Move_to_
>  MetaCPAN>
>  and this packaging guidelines request
>  <https://pagure.io/packaging-committee/issue/770>;.
>
>  If it is approved, I will try to do that before Perl 5.28 mass rebuild so
>  that the change becomes visible in Fedora 29 release.
>
>  I propose rewriting both URL and Source tags like this:
>
>  -URL:            http://search.cpan.org/dist/CPANPLUS/
>  +URL:            https://metacpan.org/release/CPANPLUS
>  -Source0:        http://www.cpan.org/authors/id/B/BI/BINGOS/CPANPLUS-%{
>  cpan_version}.tar.gz
>  +Source0:        https://cpan.metacpan.org/authors/id/B/BI/BINGOS/
>  CPANPLUS-%{cpan_version}.tar.gz
>
>  Are you fine with it?
>
>  While the old addresses will probably work, I believe it makes sense to
>  update
>  them because:
>
>  (1) The less intermediary steps to the final location, the better. (Fewer
>      things can get broken.)
>  (2) It's good when a user see the same address in RPM and in his web
>  browser. 

The changes look good to me. However, the source URL does not really need
to be updated (it will still mirror the file); www.cpan.org is not
changing, only search.cpan.org is. If there is any source URL using the
search.cpan.org mirror that could be updated:
http://search.cpan.org/CPAN/authors/id/... ->
https://www.cpan.org/authors/id/... or
https://cpan.metacpan.org/authors/id/...

-Dan

[Petr Šabata]

On Thu, May 24, 2018 at 12:55:27PM -0400, Dan Book wrote:
>  On Thu, May 24, 2018 at 12:34 PM, Petr Pisar
> <ppisar(a)redhat.com&gt; wrote:
>  
>  > On Fri, May 18, 2018 at 10:55:02AM +0100, Dave Cross wrote:
>  > > See https://log.perl.org/2018/05/goodbye-search-dot-cpan-dot-org.html
>  > >
>  > > This means that the URLs included in RPMs of CPAN modules will need to
>  > > change to MetaCPAN URLs.
>  > >
>  > > Please let me know if I can be any help making this happen.
>  > >
>  > I can mass update spec files for all Perl packages. I submitted this
>  > Fedora 29
>  > change request <https://fedoraproject.org/wiki/Changes/Perl_Move_to_
>  > MetaCPAN>
>  > and this packaging guidelines request
>  > <https://pagure.io/packaging-committee/issue/770>;.
>  >
>  > If it is approved, I will try to do that before Perl 5.28 mass rebuild so
>  > that the change becomes visible in Fedora 29 release.
>  >
>  > I propose rewriting both URL and Source tags like this:
>  >
>  > -URL:            http://search.cpan.org/dist/CPANPLUS/
>  > +URL:            https://metacpan.org/release/CPANPLUS
>  > -Source0:        http://www.cpan.org/authors/id/B/BI/BINGOS/CPANPLUS-%{
>  > cpan_version}.tar.gz
>  > +Source0:        https://cpan.metacpan.org/authors/id/B/BI/BINGOS/
>  > CPANPLUS-%{cpan_version}.tar.gz
>  >
>  > Are you fine with it?
>  >
>  > While the old addresses will probably work, I believe it makes sense to
>  > update
>  > them because:
>  >
>  > (1) The less intermediary steps to the final location, the better. (Fewer
>  >     things can get broken.)
>  > (2) It's good when a user see the same address in RPM and in his web
>  > browser.
>  
>  
>  The changes look good to me. However, the source URL does not really need
>  to be updated (it will still mirror the file); www.cpan.org is not
>  changing, only search.cpan.org is. If there is any source URL using the
>  search.cpan.org mirror that could be updated:
>  http://search.cpan.org/CPAN/authors/id/... ->
>  https://www.cpan.org/authors/id/... or
>  https://cpan.metacpan.org/authors/id/...
>  
>  -Dan 
Do we know if files like /modules/02packages.details.txt are
still going to be provided by cpan.org?  If not, virtually all
CPAN tools will have to be updated.  cpanspec included.

P

>  _______________________________________________
>  perl-devel mailing list -- perl-devel(a)lists.fedoraproject.org
>  To unsubscribe send an email to perl-devel-leave(a)lists.fedoraproject.org
>  Fedora Code of Conduct: https://getfedora.org/code-of-conduct.html
>  List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines
>  List Archives:
> https://lists.fedoraproject.org/archives/list/[e-mail]...

[Dan Book]

On Thu, May 24, 2018 at 1:03 PM, Petr Šabata <contyk(a)redhat.com&gt; wrote:
>  Do we know if files like /modules/02packages.details.txt are
>  still going to be provided by cpan.org?  If not, virtually all
>  CPAN tools will have to be updated.  cpanspec included.
>  
Yes. That file is on all CPAN mirrors which will not be changed. These are
CPAN mirrors: https://www.cpan.org https://cpan.metacpan.org
http://search.cpan.org/CPAN/ (last one should be changed to another mirror)

-Dan

[Petr Pisar]

On Thu, May 24, 2018 at 12:55:27PM -0400, Dan Book wrote:
>  The changes look good to me. However, the source URL does not really
> need
>  to be updated (it will still mirror the file); www.cpan.org is not
>  changing, only search.cpan.org is. 
I know. But metacpan.org's Download links point to cpan.metacpan.org, not to
www.cpan.org. Updating Source makes them consistent. That's why I want to
update both the RPM tags.

It also looks like both domains are actually hosted by the same system (both
are CNAMEs to dualstack.h2.shared.global.fastly.net). Thus there shouldn't be
any difference in the availability.

-- Petr

[Dave Cross]

On Thu, 24 May 2018 at 17:34, Petr Pisar <ppisar(a)redhat.com&gt; wrote:

>  On Fri, May 18, 2018 at 10:55:02AM +0100, Dave Cross wrote:
>  > See https://log.perl.org/2018/05/goodbye-search-dot-cpan-dot-org.html
>  >
>  > This means that the URLs included in RPMs of CPAN modules will need to
>  > change to MetaCPAN URLs.
>  >
>  > Please let me know if I can be any help making this happen.
>  >
>  I can mass update spec files for all Perl packages. I submitted this 
Fedora 29
>  change request <
https://fedoraproject.org/wiki/Changes/Perl_Move_to_MetaCPAN>
>  and this packaging guidelines request
>  <https://pagure.io/packaging-committee/issue/770>;. 
>  If it is approved, I will try to do that before Perl 5.28 mass
> rebuild so
>  that the change becomes visible in Fedora 29 release. 
>  I propose rewriting both URL and Source tags like this: 
>  -URL:            http://search.cpan.org/dist/CPANPLUS/
>  +URL:            https://metacpan.org/release/CPANPLUS
>  -Source0:
http://www.cpan.org/authors/id/B/BI/BINGOS/CPANPLUS-%{cpan_version}.tar.gz
>  +Source0:
https://cpan.metacpan.org/authors/id/B/BI/BINGOS/CPANPLUS-%{cpan_version}...

>  Are you fine with it? 
Looks great to me.

>  While the old addresses will probably work, I believe it makes sense
> to 
update
>  them because: 
>  (1) The less intermediary steps to the final location, the better.
> (Fewer
>       things can get broken.)
>  (2) It's good when a user see the same address in RPM and in his web 
browser.

And, as a comment on your guidelines change notes:

(3) Moving to an https URL is good :-)

My PR to cpanspec was accepted too -
https://github.com/silug/cpanspec/pull/11

Cheers,

Dave...

[Petr Pisar]

On Thu, May 24, 2018 at 06:34:38PM +0200, Petr Pisar wrote:
>  I submitted this Fedora 29 change request
>  <https://fedoraproject.org/wiki/Changes/Perl_Move_to_MetaCPAN> and this
>  packaging guidelines request
>  <https://pagure.io/packaging-committee/issue/770>;.
>  
The Perl packaging guidelines were updated. They recommend metacpan.org in URL
tag now.

-- Petr

[Petr Pisar]

On Thu, May 24, 2018 at 06:34:38PM +0200, Petr Pisar wrote:
>  I can mass update spec files for all Perl packages. I submitted this
> Fedora 29
>  change request <https://fedoraproject.org/wiki/Changes/Perl_Move_to_MetaCPAN>
The change was approved. I will start updating the packages soon.

-- Petr

[Petr Pisar]

On Mon, Jun 04, 2018 at 01:53:07PM +0200, Petr Pisar wrote:
>  On Thu, May 24, 2018 at 06:34:38PM +0200, Petr Pisar wrote:
>  > I can mass update spec files for all Perl packages. I submitted this Fedora 29
>  > change request <https://fedoraproject.org/wiki/Changes/Perl_Move_to_MetaCPAN>
>  
>  The change was approved. I will start updating the packages soon.
>   
Finished.

The only remaining perl.spec will updated together Perl 5.28 upgrade next week
(not to impose git rebases on people uprading perl).

-- Petr

[Emmanuel Seyman]

* Emmanuel Seyman [21/05/2018 15:23] :
>  JFTR, I've filed an issue against anitya (the software run by
>  release-monitoring.org). 
This week, release-monitoring.org was updated to Anitya 0.13.1.
The cpan backend now uses metacpan.org to get a list of new perl releases.

Emmanuel