Problem uploading to lookaside cache

[Paul Howarth]

I'm trying to update perl-IO-Multiplex to 1.11 but I can't upload the 
tarball to the lookaside cache. "fedpkg new-sources" reports success but 
hasn't actually worked:

$ fedpkg new-sources IO-Multiplex-1.11.tar.gz
Uploading: 7db84e16c24579865c9044843880962a  IO-Multiplex-1.11.tar.gz
######################################################################## 
100.0%
Uploaded and added to .gitignore: IO-Multiplex-1.11.tar.gz
Source upload succeeded. Don't forget to commit the sources file

$ mv IO-Multiplex-1.11.tar.gz IO-Multiplex-1.11.tar.gz.orig

$ fedpkg sources
Downloading IO-Multiplex-1.11.tar.gz
   % Total    % Received % Xferd  Average Speed   Time    Time     Time 
  Current
                                  Dload  Upload   Total   Spent    Left 
  Speed
   0     0    0     0    0     0      0      0 --:--:-- --:--:-- 
--:--:--     0
curl: (22) The requested URL returned error: 404
Could not download sources: Command '['curl', '-H', 'Pragma:',
'-o', 
'IO-Multiplex-1.11.tar.gz', '-R', '-S', '--fail',
'--show-error', 
'http://pkgs.fedoraproject.org/repo/pkgs/perl-IO-Multiplex/IO-Multiplex-1.11.tar.gz/7db84e16c24579865c9044843880962a/IO-Multiplex-1.11.tar.gz']'

returned non-zero exit status 22

It appears that the upload CGI is reporting success despite having 
failed. Here's a manual attempt at running it with curl in verbose mode:

$ PACKAGE_NAME=perl-IO-Multiplex
$ SOURCE_FILE_NAME=IO-Multiplex-1.11.tar.gz
$ MD5_SUM_OF_SOURCE_FILE=$(cut -d" " -f1 < sources)
$ cat sources
7db84e16c24579865c9044843880962a  IO-Multiplex-1.11.tar.gz
$ curl -v -k --cert ~/.fedora.cert -F "name=${PACKAGE_NAME}" -F 
"md5sum=${MD5_SUM_OF_SOURCE_FILE}" -F "file=@${SOURCE_FILE_NAME}" 
https://pkgs.fedoraproject.org/repo/pkgs/upload.cgi
* About to connect() to pkgs.fedoraproject.org port 443 (#0)
*   Trying 209.132.181.4... connected
* Connected to pkgs.fedoraproject.org (209.132.181.4) port 443 (#0)
* Initializing NSS with certpath: /etc/pki/nssdb
* warning: ignoring unsupported value (1) of ssl.verifyhost
* Certificate is signed by an untrusted issuer: 
&#39;E=admin(a)fedoraproject.org,CN=Fedora Project CA,OU=Fedora Project 
CA,O=Fedora Project,L=Raleigh,ST=North Carolina,C=US'
* SSL certificate verify ok.
* NSS: client certificate: PEM Token #1:.fedora.cert
* 	subject: E=paul(a)city-fan.org,CN=pghmcfc,OU=Fedora User Cert,O=Fedora 
Project,ST=North Carolina,C=US
* 	start date: Feb 12 10:59:43 2011 GMT
* 	expire date: Aug 11 10:59:43 2011 GMT
* 	common name: pghmcfc
* 	issuer: E=admin(a)fedoraproject.org,CN=Fedora Project CA,OU=Fedora 
Project CA,O=Fedora Project,L=Raleigh,ST=North Carolina,C=US
* SSL connection using TLS_RSA_WITH_AES_256_CBC_SHA
* Server certificate:
* 	subject: 
E=buildsys(a)fedoraproject.org,CN=pkgs.fedoraproject.org,OU=Package 
SCM,O=Fedora Project,ST=North Carolina,C=US
* 	start date: Jul 27 16:12:45 2010 GMT
* 	expire date: Jul 24 16:12:45 2020 GMT
* 	common name: pkgs.fedoraproject.org
* 	issuer: E=admin(a)fedoraproject.org,CN=Fedora Project CA,OU=Fedora 
Project CA,O=Fedora Project,L=Raleigh,ST=North Carolina,C=US
>  POST /repo/pkgs/upload.cgi HTTP/1.1
>  User-Agent: curl/7.21.4 (x86_64-unknown-linux-gnu) libcurl/7.21.4  
NSS/3.12.9.0
zlib/1.2.5 libidn/1.19 libssh2/1.2.7
>  Host: pkgs.fedoraproject.org
>  Accept: */*
>  Content-Length: 16491
>  Expect: 100-continue
>  Content-Type: multipart/form-data; 
boundary=----------------------------b85197046580
>  
< HTTP/1.1 100 Continue
< HTTP/1.1 200 OK
< Date: Mon, 21 Feb 2011 12:16:51 GMT
< Server: Apache/2.2.15 (Red Hat)
< Content-Length: 0
< Content-Type: text/plain
<
* Connection #0 to host pkgs.fedoraproject.org left intact
* Closing connection #0

Any idea what's up?

Paul.

[Petr Pisar]

On 2011-02-21, Paul Howarth <paul(a)city-fan.org&gt; wrote:
>  I'm trying to update perl-IO-Multiplex to 1.11 but I can't
> upload the 
>  tarball to the lookaside cache. "fedpkg new-sources" reports success but 
>  hasn't actually worked:
>  
https://fedorahosted.org/rel-eng/ticket/4453

-- Petr

[Daniel P. Berrange]

On Mon, Feb 21, 2011 at 12:25:44PM +0000, Paul Howarth wrote:
>  I'm trying to update perl-IO-Multiplex to 1.11 but I can't
> upload the 
>  tarball to the lookaside cache. "fedpkg new-sources" reports success but 
>  hasn't actually worked:
>  
>  $ fedpkg new-sources IO-Multiplex-1.11.tar.gz
>  Uploading: 7db84e16c24579865c9044843880962a  IO-Multiplex-1.11.tar.gz
>  ######################################################################## 
>  100.0%
>  Uploaded and added to .gitignore: IO-Multiplex-1.11.tar.gz
>  Source upload succeeded. Don't forget to commit the sources file
>  
>  $ mv IO-Multiplex-1.11.tar.gz IO-Multiplex-1.11.tar.gz.orig
>  
>  $ fedpkg sources
>  Downloading IO-Multiplex-1.11.tar.gz
>     % Total    % Received % Xferd  Average Speed   Time    Time     Time 
>    Current
>                                    Dload  Upload   Total   Spent    Left 
>    Speed
>     0     0    0     0    0     0      0      0 --:--:-- --:--:-- 
>  --:--:--     0
>  curl: (22) The requested URL returned error: 404
>  Could not download sources: Command '['curl', '-H',
> 'Pragma:', '-o', 
>  'IO-Multiplex-1.11.tar.gz', '-R', '-S', '--fail',
> '--show-error', 
>
> 'http://pkgs.fedoraproject.org/repo/pkgs/perl-IO-Multiplex/IO-Multiplex-1.11.tar.gz/7db84e16c24579865c9044843880962a/IO-Multiplex-1.11.tar.gz']'
>
>  returned non-zero exit status 22
>  
>  It appears that the upload CGI is reporting success despite having 
>  failed. 
[snip]

>  Any idea what's up? 
I've no idea, but it isn't just you. I'm seeing exactly the same problem
trying to provide new sources for virt-viewer. Upload "succeeds" according
to fedpkg, but the file doesn't exist on the server when you try to fetch
it again

Regards,
Daniel
-- 
|: http://berrange.com      -o-    http://www.flickr.com/photos/dberrange/ :|
|: http://libvirt.org              -o-             http://virt-manager.org :|
|: http://autobuild.org       -o-         http://search.cpan.org/~danberr/ :|
|: http://entangle-photo.org       -o-       http://live.gnome.org/gtk-vnc :|

[Toshio Kuratomi]

On Mon, Feb 21, 2011 at 12:58:57PM +0000, Daniel P. Berrange wrote:
>  On Mon, Feb 21, 2011 at 12:25:44PM +0000, Paul Howarth wrote:
>  > I'm trying to update perl-IO-Multiplex to 1.11 but I can't upload the 
>  > tarball to the lookaside cache. "fedpkg new-sources" reports success but 
>  > hasn't actually worked:
>  > 
>  > $ fedpkg new-sources IO-Multiplex-1.11.tar.gz
>  > Uploading: 7db84e16c24579865c9044843880962a  IO-Multiplex-1.11.tar.gz
>  > ######################################################################## 
>  > 100.0%
>  > Uploaded and added to .gitignore: IO-Multiplex-1.11.tar.gz
>  > Source upload succeeded. Don't forget to commit the sources file
>  > 
>  > $ mv IO-Multiplex-1.11.tar.gz IO-Multiplex-1.11.tar.gz.orig
>  > 
>  > $ fedpkg sources
>  > Downloading IO-Multiplex-1.11.tar.gz
>  >    % Total    % Received % Xferd  Average Speed   Time    Time     Time 
>  >   Current
>  >                                   Dload  Upload   Total   Spent    Left 
>  >   Speed
>  >    0     0    0     0    0     0      0      0 --:--:-- --:--:-- 
>  > --:--:--     0
>  > curl: (22) The requested URL returned error: 404
>  > Could not download sources: Command '['curl', '-H',
> 'Pragma:', '-o', 
>  > 'IO-Multiplex-1.11.tar.gz', '-R', '-S', '--fail',
> '--show-error', 
>  >
> 'http://pkgs.fedoraproject.org/repo/pkgs/perl-IO-Multiplex/IO-Multiplex-1.11.tar.gz/7db84e16c24579865c9044843880962a/IO-Multiplex-1.11.tar.gz']'
>
>  > returned non-zero exit status 22
>  > 
>  > It appears that the upload CGI is reporting success despite having 
>  > failed.
>  
>  [snip]
>  
>  > Any idea what's up?
>  
>  I've no idea, but it isn't just you. I'm seeing exactly the same problem
>  trying to provide new sources for virt-viewer. Upload "succeeds" according
>  to fedpkg, but the file doesn't exist on the server when you try to fetch
>  it again
>   
Should be working now.  dgilmore found that the filesystem had gone ro this
morning and fixed it.  Not sure why fedpkg is showing success there -- the
script is failing in the server log.

-Toshio

[Paul Howarth]

On 21/02/11 16:42, Toshio Kuratomi wrote:
>  On Mon, Feb 21, 2011 at 12:58:57PM +0000, Daniel P. Berrange wrote:
> > On Mon, Feb 21, 2011 at 12:25:44PM +0000, Paul Howarth wrote:
> >> I'm trying to update perl-IO-Multiplex to 1.11 but I can't upload the
> >> tarball to the lookaside cache. "fedpkg new-sources" reports success
> but
> >> hasn't actually worked:
> >>
> >> $ fedpkg new-sources IO-Multiplex-1.11.tar.gz
> >> Uploading: 7db84e16c24579865c9044843880962a  IO-Multiplex-1.11.tar.gz
> >> ########################################################################
> >> 100.0%
> >> Uploaded and added to .gitignore: IO-Multiplex-1.11.tar.gz
> >> Source upload succeeded. Don't forget to commit the sources file
> >>
> >> $ mv IO-Multiplex-1.11.tar.gz IO-Multiplex-1.11.tar.gz.orig
> >>
> >> $ fedpkg sources
> >> Downloading IO-Multiplex-1.11.tar.gz
> >>     % Total    % Received % Xferd  Average Speed   Time    Time     Time
> >>    Current
> >>                                    Dload  Upload   Total   Spent    Left
> >>    Speed
> >>     0     0    0     0    0     0      0      0 --:--:-- --:--:--
> >> --:--:--     0
> >> curl: (22) The requested URL returned error: 404
> >> Could not download sources: Command '['curl', '-H',
> 'Pragma:', '-o',
> >> 'IO-Multiplex-1.11.tar.gz', '-R', '-S', '--fail',
> '--show-error',
> >>
> 'http://pkgs.fedoraproject.org/repo/pkgs/perl-IO-Multiplex/IO-Multiplex-1.11.tar.gz/7db84e16c24579865c9044843880962a/IO-Multiplex-1.11.tar.gz']'
> >> returned non-zero exit status 22
> >>
> >> It appears that the upload CGI is reporting success despite having
> >> failed.
> >
> > [snip]
> >
> >> Any idea what's up?
> >
> > I've no idea, but it isn't just you. I'm seeing exactly the same problem
> > trying to provide new sources for virt-viewer. Upload "succeeds" according
> > to fedpkg, but the file doesn't exist on the server when you try to fetch
> > it again
> >
>  Should be working now.  dgilmore found that the filesystem had gone ro this
>  morning and fixed it.  Not sure why fedpkg is showing success there -- the
>  script is failing in the server log. 
Probably because the script is returning a "200 OK" HTTP status.

Paul.

[Jesse Keating]

On 2/21/11 8:52 AM, Paul Howarth wrote:
> >> I've no idea, but it isn't just you. I'm seeing
> exactly the same problem
> >> >>  trying to provide new sources for virt-viewer. Upload
> "succeeds" according
> >> >>  to fedpkg, but the file doesn't exist on the server when you try to
> fetch
> >> >>  it again
> >> >>
> > >  Should be working now.  dgilmore found that the filesystem had gone ro this
> > >  morning and fixed it.  Not sure why fedpkg is showing success there -- the
> > >  script is failing in the server log.
>  Probably because the script is returning a "200 OK" HTTP status. 
Which in turn probably makes curl return 0 instead of non-zero.  Fedpkg 
is just calling out to curl at this point, rather than duplicating all 
the UI to make the upload look pretty :)

-- 
Jesse Keating
Fedora -- Freedom² is a feature!
identi.ca: http://identi.ca/jkeating