not enough disk on git.fedorahosted.org

[Miroslav Suchý]

Please delete something or buy another disk :)

We got there email hook, which probobly do not have enough disk space on 
some mount.


[msuchy(a)dri/~/rhn/spacewalk.pub/schema/spacewalk]$ git push --tags
Counting objects: 1, done.
Writing objects: 100% (1/1), 229 bytes, done.
Total 1 (delta 0), reused 0 (delta 0)
Traceback (most recent call last):
   File "/usr/bin/send-unicode-email.py", line 32, in ?
     smtp.sendmail(sender, recipients, msg.as_string())
   File "/usr/lib/python2.4/smtplib.py", line 680, in sendmail
     raise SMTPSenderRefused(code, resp, from_addr)
smtplib.SMTPSenderRefused: (452, '4.3.1 Insufficient system storage', 
'=?utf-8?q?Miroslav_Such=C3=BD?= <msuchy(a)fedoraproject.org&gt;&#39;)
To ssh://[e-mail]/git/spacewalk.git/
  * [new tag]         spacewalk-schema-0.9.4-1 -> spacewalk-schema-0.9.4-1


-- 
Miroslav Suchy
Red Hat Satellite Engineering

[Mike McGrath]

On Mon, 12 Apr 2010, Miroslav Suchý wrote:

>  Please delete something or buy another disk :)
>
>  We got there email hook, which probobly do not have enough disk space on
>  some mount.
>
>  
I suspect this error came from smtp itself but I don't see any disks that
are full on space.  The only thing I can think of is if this particular
commit was very large, lots of images or a tarball perhaps?  And you hit
our single email size limit?

How big was this commit?  It says 229 bytes is that what it was?

	-Mike


>  [msuchy(a)dri/~/rhn/spacewalk.pub/schema/spacewalk]$ git push --tags
>  Counting objects: 1, done.
>  Writing objects: 100% (1/1), 229 bytes, done.
>  Total 1 (delta 0), reused 0 (delta 0)
>  Traceback (most recent call last):
>     File "/usr/bin/send-unicode-email.py", line 32, in ?
>       smtp.sendmail(sender, recipients, msg.as_string())
>     File "/usr/lib/python2.4/smtplib.py", line 680, in sendmail
>       raise SMTPSenderRefused(code, resp, from_addr)
>  smtplib.SMTPSenderRefused: (452, '4.3.1 Insufficient system storage',
>  '=?utf-8?q?Miroslav_Such=C3=BD?= <msuchy(a)fedoraproject.org&gt;&#39;)
>  To ssh://[e-mail]/git/spacewalk.git/
>    * [new tag]         spacewalk-schema-0.9.4-1 -> spacewalk-schema-0.9.4-1
>
>
>  --
>  Miroslav Suchy
>  Red Hat Satellite Engineering
>  _______________________________________________
>  infrastructure mailing list
>  infrastructure(a)lists.fedoraproject.org
>  https://admin.fedoraproject.org/mailman/listinfo/infrastructure
>

[Mike McGrath]

On Mon, 12 Apr 2010, Mike McGrath wrote:

>  On Mon, 12 Apr 2010, Miroslav Suchý wrote:
>
>  > Please delete something or buy another disk :)
>  >
>  > We got there email hook, which probobly do not have enough disk space on
>  > some mount.
>  >
>  >
>
>  I suspect this error came from smtp itself but I don't see any disks that
>  are full on space.  The only thing I can think of is if this particular
>  commit was very large, lots of images or a tarball perhaps?  And you hit
>  our single email size limit?
>
>  How big was this commit?  It says 229 bytes is that what it was?
>  
Nope, that disk certainly filled up:

https://admin.fedoraproject.org/collectd/bin/index.cgi?hostname=hosted1&a...

	-Mike

>  	-Mike
>
>
>  > [msuchy(a)dri/~/rhn/spacewalk.pub/schema/spacewalk]$ git push --tags
>  > Counting objects: 1, done.
>  > Writing objects: 100% (1/1), 229 bytes, done.
>  > Total 1 (delta 0), reused 0 (delta 0)
>  > Traceback (most recent call last):
>  >    File "/usr/bin/send-unicode-email.py", line 32, in ?
>  >      smtp.sendmail(sender, recipients, msg.as_string())
>  >    File "/usr/lib/python2.4/smtplib.py", line 680, in sendmail
>  >      raise SMTPSenderRefused(code, resp, from_addr)
>  > smtplib.SMTPSenderRefused: (452, '4.3.1 Insufficient system storage',
>  > '=?utf-8?q?Miroslav_Such=C3=BD?= <msuchy(a)fedoraproject.org&gt;&#39;)
>  > To ssh://[e-mail]/git/spacewalk.git/
>  >   * [new tag]         spacewalk-schema-0.9.4-1 -> spacewalk-schema-0.9.4-1
>  >
>  >
>  > --
>  > Miroslav Suchy
>  > Red Hat Satellite Engineering
>  > _______________________________________________
>  > infrastructure mailing list
>  > infrastructure(a)lists.fedoraproject.org
>  > https://admin.fedoraproject.org/mailman/listinfo/infrastructure
>  >

[Stefan Schlesinger]

On 12.04.2010, at 16:10, Mike McGrath wrote:
>  Nope, that disk certainly filled up:
>
>
> https://admin.fedoraproject.org/collectd/bin/index.cgi?hostname=hosted1&a...

Hey,

just a short question - what kind of interface are we currently using  
for collectd?

~sts

[Mike McGrath]

On Mon, 12 Apr 2010, Stefan Schlesinger wrote:

>  On 12.04.2010, at 16:10, Mike McGrath wrote:
>  > Nope, that disk certainly filled up:
>  >
>  >
> https://admin.fedoraproject.org/collectd/bin/index.cgi?hostname=hosted1&a...
>
>
>  Hey,
>
>  just a short question - what kind of interface are we currently using
>  for collectd?
>  
That web interface is the one that comes with the collectd source in the
user contrib directory (I forget the exact name).  I submitted a patch to
the packager and it should be installable in Fedora soon if its not
already.

	-Mike

[Jeroen van Meeuwen]

Mike McGrath wrote:
>  On Mon, 12 Apr 2010, Mike McGrath wrote:
>  
>  > On Mon, 12 Apr 2010, Miroslav Suchý wrote:
>  >
>  > > Please delete something or buy another disk :)
>  > >
>  > > We got there email hook, which probobly do not have enough disk space on
>  > > some mount.
>  > >
>  > >
>  >
>  > I suspect this error came from smtp itself but I don't see any disks that
>  > are full on space.  The only thing I can think of is if this particular
>  > commit was very large, lots of images or a tarball perhaps?  And you hit
>  > our single email size limit?
>  >
>  > How big was this commit?  It says 229 bytes is that what it was?
>  >
>  
>  Nope, that disk certainly filled up:
>  
>  
https://admin.fedoraproject.org/collectd/bin/index.cgi?hostname=hosted1&a...
>   
FYI, is it filling up rapidly right now, again?

-- Jeroen

[Seth Vidal]

On Mon, 12 Apr 2010, Jeroen van Meeuwen wrote:

> >
>
> https://admin.fedoraproject.org/collectd/bin/index.cgi?hostname=hosted1&a...
> >
>
>  FYI, is it filling up rapidly right now, again?
>  
It's fixed, now, I think.

the fedora-web/fedorahosted build script was aborting due to a project 
with an empty base_url. I've just patched the script to handle an empty 
trac base_url gracefully and fixed the absence of pybabel on 
hosted1/hosted2.

when the script aborted it didn't clean up its tmp space - and it was 
leaving 380M per checkout
every 10 minutes

doesn't take very long for that to be an issue :)

-sv

[Mathieu Bridon]

Hi,

2010/4/12 Miroslav Suchý <msuchy(a)redhat.com&gt;:
>  Please delete something or buy another disk :) 
That will probably not get you very far, but I haven't been able to
hack on my fedorahosted.org project for some time now, and so I kinda
decided to abandon it.

If you give me until tonight (I'm at work right now), I can backup
everything so it's all not lost, and then you can remove it all, and
hopefully save a few disk space.

The project is Shomyu, I'll give you a heads up when it's ready to be removed.


----------
Mathieu Bridon

[Seth Vidal]

On Mon, 12 Apr 2010, Mathieu Bridon wrote:

>  Hi,
>
>  2010/4/12 Miroslav Suchý <msuchy(a)redhat.com&gt;:
> > Please delete something or buy another disk :)
>
>  That will probably not get you very far, but I haven't been able to
>  hack on my fedorahosted.org project for some time now, and so I kinda
>  decided to abandon it.
>
>  If you give me until tonight (I'm at work right now), I can backup
>  everything so it's all not lost, and then you can remove it all, and
>  hopefully save a few disk space.
>
>  The project is Shomyu, I'll give you a heads up when it's ready to be removed.
1. the project space was not even remotely used up - there is 28G used 
there with 347GB remaining available.

2. the error was from the processes trying to write to /var and finding it 
completely chock-a-block b/c of uncleaned up fedora-web checkouts for 
recreating the main page. This should be fixed now and I'll be following 
up on it today to be positive.

thanks,
-sv