Re: stratis-devel Digest, Vol 47, Issue 2

[aanno]

Dear John,

this is what stratis reports after deleting about 50GB of data from 
/mnt/home and about 30GB of data from /mnt/opt:

# stratis pool
Name                         Total / Used / Free    Properties 
                                   UUID   Alerts
stratis_hdd   1.43 TiB / 819.34 GiB / 645.49 GiB    Ca,~Cr, Op 
   093c8d42-21b8-46a2-a7e8-5d35f458fa58   WS001

# stratis blockdev
Pool Name     Device Node   Physical Size    Tier   UUID
stratis_hdd   /dev/dm-6          1.43 TiB    DATA 
   9a5b1c4d-8014-4155-990e-eedfd27803a6
stratis_hdd   /dev/dm-7        292.95 GiB   CACHE 
   770d0190-c17b-4349-a9f9-0968036e6b2c

# stratis fs
Pool          Filesystem   Total / Used / Free / Limit 
              Created             Device                          UUID

stratis_hdd   home         2 TiB / 708.75 GiB / 1.31 TiB / None     Apr 
28 2019 12:29   /dev/stratis/stratis_hdd/home   1715
5095-e225-4fb0-b020-ec2ffa6a5e4d
stratis_hdd   opt          1 TiB / 109.11 GiB / 914.89 GiB / None   Apr 
28 2019 12:30   /dev/stratis/stratis_hdd/opt    fb19
a29e-ab39-4b41-8d37-0dc6d222a2b9

For me, it looks like there is no change on reported numbers and/or the 
alert. Perhaps I misunderstood what to do?

Kind regards,

aanno

Am 13.12.23 um 05:05 schrieb stratis-devel-request(a)lists.fedorahosted.org:

>  Send stratis-devel mailing list submissions to
>  	stratis-devel(a)lists.fedorahosted.org
>
>  To subscribe or unsubscribe via email, send a message with subject or
>  body 'help' to
>  	stratis-devel-request(a)lists.fedorahosted.org
>
>  You can reach the person managing the list at
>  	stratis-devel-owner(a)lists.fedorahosted.org
>
>  When replying, please edit your Subject line so it is more specific
>  than "Re: Contents of stratis-devel digest..."
>
>  Today's Topics:
>
>      1. Re: stratis: fs exhausted? (John Baublitz)
>
>
>  ----------------------------------------------------------------------
>
>  Date: Tue, 12 Dec 2023 17:57:53 -0500
>  From: John Baublitz<jbaublit(a)redhat.com>
>  Subject: [stratis-devel] Re: stratis: fs exhausted?
>  To: aanno<aannoaanno(a)gmail.com>
>  Cc:[e-mail]
>  Message-ID:
>  	<CANPnS0=GeO7FUb5EJpL1_2OAKVULMNFhP=efvwfNWCms83WZAg(a)mail.gmail.com&gt;
>  Content-Type: multipart/alternative;
>  	boundary="000000000000b6b959060c57fb18"
>
>  --000000000000b6b959060c57fb18
>  Content-Type: text/plain; charset="UTF-8"
>  Content-Transfer-Encoding: quoted-printable
>
>  Hi aanno,
>  I would also like to just mention that when you say the physical space is
>  exhausted, I'm assuming you're referring to alert WS001, correct? We may
>  need to document this a little bit better because this alert just means
>  that all of the space in the pool is fully allocated. This alert
>  specifically pops up when:
>
>  1. The pool extends to take up all available physical space (this will not
>  set the warning you are seeing).
>  2. You fill up the remaining space to the point where only 15 GiB is left.
>  3. The pool attempts to extend the data device further and determines there
>  is no space left to extend (this is when the warning is set).
>
>  Now practically what this means is that when the warning is set, you have
>  15GiB left of space. If you fill up the 15GiB, the pool will not be able to
>  be extended further to help you out. What I'm mostly curious about is,
>  looking at the space you reported in stratis pool/fs it looks like the
>  physical space on the pool is not full enough to warrant the alert. Is this
>  output after deleting a significant amount of data from the pool? From what
>  I can see, you shouldn't have this alert set unless your usage spiked
>  significantly and went back down. The warning doesn't clear out unless you
>  add more space so the state you're in is not impossible or even unlikely,
>  but it does make me wonder a little bit about your usage pattern. Are you
>  still seeing this instability even with the lower usage you pasted here?
>
>  On Thu, Dec 7, 2023 at 1:37=E2=80=AFPM aanno&lt;aannoaanno(a)gmail.com&gt;  wrote:
>
> > Hello,
> >
> > I'm using stratis for many years now (for my /home and /opt mount points)=
>  .
> > It looks like this:
> >
> > $ stratis pool
> > Name                         Total / Used / Free    Properties
> >                                    UUID   Alerts
> > stratis_hdd   1.43 TiB / 819.51 GiB / 645.32 GiB    Ca,~Cr, Op
> >    093c8d42-21b8-46a2-a7e8-5d35f458fa58   WS001
> >
> > $ stratis fs
> > Pool          Filesystem   Total / Used / Free / Limit
> >               Created             Device                          UUID
> >
> > stratis_hdd   home         2 TiB / 708.92 GiB / 1.31 TiB / None     Apr 2=
>  8
> > 2019 12:29   /dev/stratis/stratis_hdd/home   1715
> > 5095-e225-4fb0-b020-ec2ffa6a5e4d
> > stratis_hdd   opt          1 TiB / 109.11 GiB / 914.89 GiB / None   Apr 2=
>  8
> > 2019 12:30   /dev/stratis/stratis_hdd/opt    fb19
> > a29e-ab39-4b41-8d37-0dc6d222a2b9
> >
> > $ stratis blockdev
> > Pool Name     Device Node   Physical Size    Tier   UUID
> >
> > stratis_hdd   /dev/dm-6        292.95 GiB   CACHE
> >    770d0190-c17b-4349-a9f9-0968036e6b2c
> > stratis_hdd   /dev/dm-7          1.43 TiB    DATA
> >    9a5b1c4d-8014-4155-990e-eedfd27803a6
> >
> > However, since a few weeks my /home has become unstable. Newly created (o=
>  r
> > altered) files are (sometimes) corrupted after a reboot of the system.
> >
> > For both mount points I'm using a SSD cache in front of a HDD. It feels a
> > bit like the caching layer is all right, but the HDD layer is on error
> > (exhausted?). For me, it looks like that would explain the observed
> > behaviour.
> >
> > I wonder if
> >
> > * I could somehow 'disable' (or remove) the SSD caching layer?
> > * I could get some debug informations?
> >
> > Kind regards,
> >
> > aanno
> >
> > --
> > _______________________________________________
> > stratis-devel mailing list --stratis-devel(a)lists.fedorahosted.org
> > To unsubscribe send an email tostratis-devel-leave(a)lists.fedorahosted.or=
>  g
> > Fedora Code of Conduct:
> > https://docs.fedoraproject.org/en-US/project/code-of-conduct/
> > List Guidelines:https://fedoraproject.org/wiki/Mailing_list_guidelines
> > List Archives:
> > https://lists.fedorahosted.org/archives/list/[e-mail]=
>  sted.org
> > Do not reply to spam, report it:
> > https://pagure.io/fedora-infrastructure/new_issue
> >
>
>  --=20
>  John
>  he/him
>  Principal Software Engineer, Stratis team
>
>  --000000000000b6b959060c57fb18
>  Content-Type: text/html; charset="UTF-8"
>  Content-Transfer-Encoding: quoted-printable
>
>  <div dir=3D"ltr"><div dir=3D"ltr"><div>Hi
> aanno,</div><div>I would also lik=
>  e to just mention that when you say the physical space is exhausted, I&#39;=
>  m assuming you&#39;re referring to alert WS001, correct? We may need to doc=
>  ument this a little bit better because this alert just means that all of th=
>  e space in the pool is fully allocated. This alert specifically pops up whe=
>  n:</div><div><br></div><div>1. The pool extends to take up
> all available ph=
>  ysical space (this will not set the warning you are seeing).</div><div>2. Y=
>  ou fill up the remaining space to the point where only 15 GiB is left.</div=
> > <div>3. The pool attempts to extend the data device further and determines=
>    there is no space left to extend (this is when the warning is set).<br></d=
>  iv><div><br></div><div>Now practically what this means is that
> when the war=
>  ning is set, you have 15GiB left of space. If you fill up the 15GiB, the po=
>  ol will not be able to be extended further to help you out. What I&#39;m mo=
>  stly curious about is, looking at the space you reported in stratis pool/fs=
>    it looks like the physical space on the pool is not full enough to warrant=
>    the alert. Is this output after deleting a significant amount of data from=
>    the pool? From what I can see, you shouldn&#39;t have this alert set unles=
>  s your usage spiked significantly and went back down. The warning doesn&#39=
>  ;t clear out unless you add more space so the state you&#39;re in is not im=
>  possible or even unlikely, but it does make me wonder a little bit about yo=
>  ur usage pattern. Are you still seeing this instability even with the lower=
>    usage you pasted here?<br></div></div><br><div
> class=3D"gmail_quote"><div =
>  dir=3D"ltr" class=3D"gmail_attr">On Thu, Dec 7, 2023 at
> 1:37=E2=80=AFPM aan=
>  no &lt;<a
> href=3D"mailto:[e-mail]">[e-mail]</a>&gt;=
>    wrote:<br></div><blockquote class=3D"gmail_quote"
> style=3D"margin:0px 0px =
>  0px 0.8ex;border-left:1px solid
> rgb(204,204,204);padding-left:1ex"><u></u>
>
>    =20
>
>      =20
>    =20
>     <div>
>       <p>Hello,</p>
>       <p>I&#39;m using stratis for many years now (for my /home and /opt moun=
>  t
>         points). It looks like this:</p>
>       <p><span style=3D"font-family:monospace"><span
> style=3D"color:rgb(0,0,0=
>  );background-color:rgb(255,255,255)">$ stratis pool
>           </span><br>
>           Name =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=
>  =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=
>  =A0=C2=A0Total / Used / Free =C2=A0=C2=A0=C2=A0Properties
>           =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=
>  =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=
>  =A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0UUID =C2=A0=
>  =C2=A0Alerts
>           <br>
>           stratis_hdd =C2=A0=C2=A01.43 TiB / 819.51 GiB / 645.32 GiB =C2=A0=
>  =C2=A0=C2=A0Ca,~Cr, Op
>           =C2=A0=C2=A0093c8d42-21b8-46a2-a7e8-5d35f458fa58 =C2=A0=C2=A0WS001 =
>  <br>
>           <br>
>         </span><span
> style=3D"font-family:monospace"></span></p>
>       <p><span style=3D"font-family:monospace"><span
> style=3D"color:rgb(0,0,0=
>  );background-color:rgb(255,255,255)">$ stratis fs
>           </span><br>
>           Pool =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0Filesyst=
>  em =C2=A0=C2=A0Total / Used / Free / Limit
>           =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=
>  =C2=A0=C2=A0Created =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=
>  =C2=A0=C2=A0=C2=A0Device
>           =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=
>  =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=
>  =A0=C2=A0UUID<br>
>           =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=
>  =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=
>  =A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0<br>
>           stratis_hdd =C2=A0=C2=A0home =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=
>  =C2=A0=C2=A02 TiB / 708.92 GiB / 1.31 TiB / None
>           =C2=A0=C2=A0=C2=A0=C2=A0Apr 28 2019 12:29 =C2=A0=C2=A0/dev/stratis/=
>  stratis_hdd/home =C2=A0=C2=A01715<br>
>           5095-e225-4fb0-b020-ec2ffa6a5e4d
>           <br>
>           stratis_hdd =C2=A0=C2=A0opt =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=
>  =A0=C2=A0=C2=A01 TiB / 109.11 GiB / 914.89 GiB /
>           None =C2=A0=C2=A0Apr 28 2019 12:30 =C2=A0=C2=A0/dev/stratis/stratis=
>  _hdd/opt =C2=A0=C2=A0=C2=A0fb19<br>
>           a29e-ab39-4b41-8d37-0dc6d222a2b9<br>
>           <br>
>         </span></p>
>       <p><span style=3D"font-family:monospace"></span><span
> style=3D"font-fam=
>  ily:monospace"><span
> style=3D"color:rgb(0,0,0);background-color:rgb(255,255=
>  ,255)">$ stratis
>             blockdev
>           </span><br>
>           Pool Name =C2=A0=C2=A0=C2=A0=C2=A0Device Node =C2=A0=C2=A0Physical =
>  Size =C2=A0=C2=A0=C2=A0Tier =C2=A0=C2=A0UUID
>           =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=
>  =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=
>  =A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0<br>
>           stratis_hdd =C2=A0=C2=A0/dev/dm-6 =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=
>  =A0=C2=A0292.95 GiB =C2=A0=C2=A0CACHE
>           =C2=A0=C2=A0770d0190-c17b-4349-a9f9-0968036e6b2c
>           <br>
>           stratis_hdd =C2=A0=C2=A0/dev/dm-7 =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=
>  =A0=C2=A0=C2=A0=C2=A01.43 TiB =C2=A0=C2=A0=C2=A0DATA
>           =C2=A0=C2=A09a5b1c4d-8014-4155-990e-eedfd27803a6<br>
>         </span><br>
>       </p>
>       <p>However, since a few weeks my /home has become unstable. Newly
>         created (or altered) files are (sometimes) corrupted after a
>         reboot of the system.</p>
>       <p>For both mount points I&#39;m using a SSD cache in front of a HDD. I=
>  t
>         feels a bit like the caching layer is all right, but the HDD layer
>         is on error (exhausted?). For me, it looks like that would explain
>         the observed behaviour.</p>
>       <p>I wonder if</p>
>       <p>* I could somehow &#39;disable&#39; (or remove) the SSD caching
> laye=
>  r?<br>
>         * I could get some debug informations?<br>
>       </p>
>       <p>Kind regards,</p>
>       <p>aanno<br>
>       </p>
>       <p><span
> style=3D"font-family:monospace"></span></p>
>     </div>
>
>  --<br>
>  _______________________________________________<br>
>  stratis-devel mailing list -- <a href=3D"mailto:[e-mail]=
> osted.org" 
> target=3D&quot;_blank&quot;&gt;stratis-devel(a)lists.fedorahosted.org&lt;/a&gt;&lt;br&gt;
>  To unsubscribe send an email to <a href=3D"mailto:stratis-devel-leave@lists=
> .fedorahosted.org" 
> target=3D&quot;_blank&quot;&gt;stratis-devel-leave(a)lists.fedorahosted=
>  .org</a><br>
>  Fedora Code of Conduct: <a href=3D"https://docs.fedoraproject.org/en-US/pro=
> ject/code-of-conduct/"  rel=3D"noreferrer"
> target=3D"_blank">https://docs.fe=
>  doraproject.org/en-US/project/code-of-conduct/</a><br>
>  List Guidelines: <a href=3D"https://fedoraproject.org/wiki/Mailing_list_gui=
> delines"  rel=3D"noreferrer"
> target=3D"_blank">https://fedoraproject.org/wik=
>  i/Mailing_list_guidelines</a><br>
>  List Archives: <a href=3D"https://lists.fedorahosted.org/archives/list/stra= 
>  tis-devel(a)lists.fedorahosted.org&quot;  rel=3D"noreferrer"
> target=3D"_blank">http=
>  s://lists.fedorahosted.org/archives/list/[e-mail].o=
>  rg</a><br>
>  Do not reply to spam, report it: <a href=3D"https://pagure.io/fedora-infras=
> tructure/new_issue"  rel=3D"noreferrer"
> target=3D"_blank">https://pagure.io/=
>  fedora-infrastructure/new_issue</a><br>
>  </blockquote></div><br clear=3D"all"><br><span
> class=3D"gmail_signature_pre=
>  fix">-- </span><br><div dir=3D"ltr"
> class=3D"gmail_signature"><div dir=3D"l=
>  tr">John<br>he/him<br>Principal Software Engineer, Stratis
> team</div></div>=
>  </div>
>
>  --000000000000b6b959060c57fb18--
>
>  ------------------------------
>
>  Subject: Digest Footer
>
>  --
>  _______________________________________________
>  stratis-devel mailing list --stratis-devel(a)lists.fedorahosted.org
>  To unsubscribe send an email tostratis-devel-leave(a)lists.fedorahosted.org
>  Fedora Code of Conduct:https://docs.fedoraproject.org/en-US/project/code-of-conduct/
>  List Guidelines:https://fedoraproject.org/wiki/Mailing_list_guidelines
>  List
> Archives:https://lists.fedorahosted.org/archives/list/stratis-devel@lists...
>  Do not reply to spam, report it:https://pagure.io/fedora-infrastructure/new_issue
>
>
>  ------------------------------
>
>  End of stratis-devel Digest, Vol 47, Issue 2
>  ********************************************

stratis-devel Digest, Vol 47, Issue 2

[John Baublitz]

Hi aanno,
You don't need to delete any data. In the first email it just looked like
you had about 645 GiB free. I was confused because you mentioned you had
exhausted the physical space but it looked like you had quite a great deal
of free space in the output you posted. I was asking whether, before you
posted the output but after exhausting the space, you had deleted a
significant amount of data. That would explain the output I was seeing.

As for why the stats don't automatically update, we have an issue out for
this: https://github.com/stratis-storage/project/discussions/555. We would
need to integrate fstrim. You can however run it manually on the
filesystems and it should cause the pool space to update.

If you want to clear the alert, unfortunately you have to add another
device to the pool. Deleting data will not clear the warning.

On Thu, Dec 14, 2023 at 1:46 PM aanno <aannoaanno(a)gmail.com&gt; wrote:

>  Dear John,
>
>  this is what stratis reports after deleting about 50GB of data from
>  /mnt/home and about 30GB of data from /mnt/opt:
>
>  # stratis pool
>  Name                         Total / Used / Free    Properties
>                                    UUID   Alerts
>  stratis_hdd   1.43 TiB / 819.34 GiB / 645.49 GiB    Ca,~Cr, Op
>    093c8d42-21b8-46a2-a7e8-5d35f458fa58   WS001
>
>  # stratis blockdev
>  Pool Name     Device Node   Physical Size    Tier   UUID
>
>  stratis_hdd   /dev/dm-6          1.43 TiB    DATA
>    9a5b1c4d-8014-4155-990e-eedfd27803a6
>  stratis_hdd   /dev/dm-7        292.95 GiB   CACHE
>    770d0190-c17b-4349-a9f9-0968036e6b2c
>
>  # stratis fs
>  Pool          Filesystem   Total / Used / Free / Limit
>               Created             Device                          UUID
>
>  stratis_hdd   home         2 TiB / 708.75 GiB / 1.31 TiB / None     Apr 28
>  2019 12:29   /dev/stratis/stratis_hdd/home   1715
>  5095-e225-4fb0-b020-ec2ffa6a5e4d
>  stratis_hdd   opt          1 TiB / 109.11 GiB / 914.89 GiB / None   Apr 28
>  2019 12:30   /dev/stratis/stratis_hdd/opt    fb19
>  a29e-ab39-4b41-8d37-0dc6d222a2b9
>
>  For me, it looks like there is no change on reported numbers and/or the
>  alert. Perhaps I misunderstood what to do?
>
>  Kind regards,
>
>  aanno
>
>  Am 13.12.23 um 05:05 schrieb stratis-devel-request(a)lists.fedorahosted.org:
>
>  Send stratis-devel mailing list submissions to
>  	stratis-devel(a)lists.fedorahosted.org
>
>  To subscribe or unsubscribe via email, send a message with subject or
>  body 'help' to
>  	stratis-devel-request(a)lists.fedorahosted.org
>
>  You can reach the person managing the list at
>  	stratis-devel-owner(a)lists.fedorahosted.org
>
>  When replying, please edit your Subject line so it is more specific
>  than "Re: Contents of stratis-devel digest..."
>
>  Today's Topics:
>
>     1. Re: stratis: fs exhausted? (John Baublitz)
>
>
>  ----------------------------------------------------------------------
>
>  Date: Tue, 12 Dec 2023 17:57:53 -0500
>  From: John Baublitz <jbaublit(a)redhat.com&gt; <jbaublit(a)redhat.com&gt;
>  Subject: [stratis-devel] Re: stratis: fs exhausted?
>  To: aanno <aannoaanno(a)gmail.com&gt; <aannoaanno(a)gmail.com&gt;
>  Cc: stratis-devel(a)lists.fedorahosted.org
>  Message-ID:
>  	<CANPnS0=GeO7FUb5EJpL1_2OAKVULMNFhP=efvwfNWCms83WZAg(a)mail.gmail.com&gt;
> <CANPnS0=GeO7FUb5EJpL1_2OAKVULMNFhP=efvwfNWCms83WZAg(a)mail.gmail.com&gt;
>  Content-Type: multipart/alternative;
>  	boundary="000000000000b6b959060c57fb18"
>
>  --000000000000b6b959060c57fb18
>  Content-Type: text/plain; charset="UTF-8"
>  Content-Transfer-Encoding: quoted-printable
>
>  Hi aanno,
>  I would also like to just mention that when you say the physical space is
>  exhausted, I'm assuming you're referring to alert WS001, correct? We may
>  need to document this a little bit better because this alert just means
>  that all of the space in the pool is fully allocated. This alert
>  specifically pops up when:
>
>  1. The pool extends to take up all available physical space (this will not
>  set the warning you are seeing).
>  2. You fill up the remaining space to the point where only 15 GiB is left.
>  3. The pool attempts to extend the data device further and determines there
>  is no space left to extend (this is when the warning is set).
>
>  Now practically what this means is that when the warning is set, you have
>  15GiB left of space. If you fill up the 15GiB, the pool will not be able to
>  be extended further to help you out. What I'm mostly curious about is,
>  looking at the space you reported in stratis pool/fs it looks like the
>  physical space on the pool is not full enough to warrant the alert. Is this
>  output after deleting a significant amount of data from the pool? From what
>  I can see, you shouldn't have this alert set unless your usage spiked
>  significantly and went back down. The warning doesn't clear out unless you
>  add more space so the state you're in is not impossible or even unlikely,
>  but it does make me wonder a little bit about your usage pattern. Are you
>  still seeing this instability even with the lower usage you pasted here?
>
>  On Thu, Dec 7, 2023 at 1:37=E2=80=AFPM aanno <aannoaanno(a)gmail.com&gt;
> <aannoaanno(a)gmail.com&gt; wrote:
>
>
>  Hello,
>
>  I'm using stratis for many years now (for my /home and /opt mount points)=
>
>  .
>
>  It looks like this:
>
>  $ stratis pool
>  Name                         Total / Used / Free    Properties
>                                    UUID   Alerts
>  stratis_hdd   1.43 TiB / 819.51 GiB / 645.32 GiB    Ca,~Cr, Op
>    093c8d42-21b8-46a2-a7e8-5d35f458fa58   WS001
>
>  $ stratis fs
>  Pool          Filesystem   Total / Used / Free / Limit
>               Created             Device                          UUID
>
>  stratis_hdd   home         2 TiB / 708.92 GiB / 1.31 TiB / None     Apr 2=
>
>  8
>
>  2019 12:29   /dev/stratis/stratis_hdd/home   1715
>  5095-e225-4fb0-b020-ec2ffa6a5e4d
>  stratis_hdd   opt          1 TiB / 109.11 GiB / 914.89 GiB / None   Apr 2=
>
>  8
>
>  2019 12:30   /dev/stratis/stratis_hdd/opt    fb19
>  a29e-ab39-4b41-8d37-0dc6d222a2b9
>
>  $ stratis blockdev
>  Pool Name     Device Node   Physical Size    Tier   UUID
>
>  stratis_hdd   /dev/dm-6        292.95 GiB   CACHE
>    770d0190-c17b-4349-a9f9-0968036e6b2c
>  stratis_hdd   /dev/dm-7          1.43 TiB    DATA
>    9a5b1c4d-8014-4155-990e-eedfd27803a6
>
>  However, since a few weeks my /home has become unstable. Newly created (o=
>
>  r
>
>  altered) files are (sometimes) corrupted after a reboot of the system.
>
>  For both mount points I'm using a SSD cache in front of a HDD. It feels a
>  bit like the caching layer is all right, but the HDD layer is on error
>  (exhausted?). For me, it looks like that would explain the observed
>  behaviour.
>
>  I wonder if
>
>  * I could somehow 'disable' (or remove) the SSD caching layer?
>  * I could get some debug informations?
>
>  Kind regards,
>
>  aanno
>
>  --
>  _______________________________________________
>  stratis-devel mailing list -- stratis-devel(a)lists.fedorahosted.org
>  To unsubscribe send an email to stratis-devel-leave(a)lists.fedorahosted.or=
>
>  g
>
>  Fedora Code of Conduct:https://docs.fedoraproject.org/en-US/project/code-of-conduct/
>  List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines
>  List Archives:https://lists.fedorahosted.org/archives/list/stratis-devel@lists...
>
>  sted.org
>
>  Do not reply to spam, report it:https://pagure.io/fedora-infrastructure/new_issue
>
>  --=20
>  John
>  he/him
>  Principal Software Engineer, Stratis team
>
>  --000000000000b6b959060c57fb18
>  Content-Type: text/html; charset="UTF-8"
>  Content-Transfer-Encoding: quoted-printable
>
>  <div dir=3D"ltr"><div dir=3D"ltr"><div>Hi
> aanno,</div><div>I would also lik=
>  e to just mention that when you say the physical space is exhausted, I&#39;=
>  m assuming you&#39;re referring to alert WS001, correct? We may need to doc=
>  ument this a little bit better because this alert just means that all of th=
>  e space in the pool is fully allocated. This alert specifically pops up whe=
>  n:</div><div><br></div><div>1. The pool extends to take up
> all available ph=
>  ysical space (this will not set the warning you are seeing).</div><div>2. Y=
>  ou fill up the remaining space to the point where only 15 GiB is left.</div=
>
>  <div>3. The pool attempts to extend the data device further and determines=
>
>   there is no space left to extend (this is when the warning is set).<br></d=
>  iv><div><br></div><div>Now practically what this means is that
> when the war=
>  ning is set, you have 15GiB left of space. If you fill up the 15GiB, the po=
>  ol will not be able to be extended further to help you out. What I&#39;m mo=
>  stly curious about is, looking at the space you reported in stratis pool/fs=
>   it looks like the physical space on the pool is not full enough to warrant=
>   the alert. Is this output after deleting a significant amount of data from=
>   the pool? From what I can see, you shouldn&#39;t have this alert set unles=
>  s your usage spiked significantly and went back down. The warning doesn&#39=
>  ;t clear out unless you add more space so the state you&#39;re in is not im=
>  possible or even unlikely, but it does make me wonder a little bit about yo=
>  ur usage pattern. Are you still seeing this instability even with the lower=
>   usage you pasted here?<br></div></div><br><div
> class=3D"gmail_quote"><div =
>  dir=3D"ltr" class=3D"gmail_attr">On Thu, Dec 7, 2023 at
> 1:37=E2=80=AFPM aan=
>  no &lt;<a href=3D"mailto:[e-mail]"
> <[e-mail]&gt;&gt;aannoaanno(a)gmail.com&lt;/a&gt;&amp;gt;=
>   wrote:<br></div><blockquote class=3D"gmail_quote"
> style=3D"margin:0px 0px =
>  0px 0.8ex;border-left:1px solid
> rgb(204,204,204);padding-left:1ex"><u></u>
>
>   =20
>
>     =20
>   =20
>    <div>
>      <p>Hello,</p>
>      <p>I&#39;m using stratis for many years now (for my /home and /opt moun=
>  t
>        points). It looks like this:</p>
>      <p><span style=3D"font-family:monospace"><span
> style=3D"color:rgb(0,0,0=
>  );background-color:rgb(255,255,255)">$ stratis pool
>          </span><br>
>          Name =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=
>  =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=
>  =A0=C2=A0Total / Used / Free =C2=A0=C2=A0=C2=A0Properties
>          =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=
>  =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=
>  =A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0UUID =C2=A0=
>  =C2=A0Alerts
>          <br>
>          stratis_hdd =C2=A0=C2=A01.43 TiB / 819.51 GiB / 645.32 GiB =C2=A0=
>  =C2=A0=C2=A0Ca,~Cr, Op
>          =C2=A0=C2=A0093c8d42-21b8-46a2-a7e8-5d35f458fa58 =C2=A0=C2=A0WS001 =
>  <br>
>          <br>
>        </span><span
> style=3D"font-family:monospace"></span></p>
>      <p><span style=3D"font-family:monospace"><span
> style=3D"color:rgb(0,0,0=
>  );background-color:rgb(255,255,255)">$ stratis fs
>          </span><br>
>          Pool =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0Filesyst=
>  em =C2=A0=C2=A0Total / Used / Free / Limit
>          =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=
>  =C2=A0=C2=A0Created =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=
>  =C2=A0=C2=A0=C2=A0Device
>          =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=
>  =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=
>  =A0=C2=A0UUID<br>
>          =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=
>  =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=
>  =A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0<br>
>          stratis_hdd =C2=A0=C2=A0home =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=
>  =C2=A0=C2=A02 TiB / 708.92 GiB / 1.31 TiB / None
>          =C2=A0=C2=A0=C2=A0=C2=A0Apr 28 2019 12:29 =C2=A0=C2=A0/dev/stratis/=
>  stratis_hdd/home =C2=A0=C2=A01715<br>
>          5095-e225-4fb0-b020-ec2ffa6a5e4d
>          <br>
>          stratis_hdd =C2=A0=C2=A0opt =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=
>  =A0=C2=A0=C2=A01 TiB / 109.11 GiB / 914.89 GiB /
>          None =C2=A0=C2=A0Apr 28 2019 12:30 =C2=A0=C2=A0/dev/stratis/stratis=
>  _hdd/opt =C2=A0=C2=A0=C2=A0fb19<br>
>          a29e-ab39-4b41-8d37-0dc6d222a2b9<br>
>          <br>
>        </span></p>
>      <p><span style=3D"font-family:monospace"></span><span
> style=3D"font-fam=
>  ily:monospace"><span
> style=3D"color:rgb(0,0,0);background-color:rgb(255,255=
>  ,255)">$ stratis
>            blockdev
>          </span><br>
>          Pool Name =C2=A0=C2=A0=C2=A0=C2=A0Device Node =C2=A0=C2=A0Physical =
>  Size =C2=A0=C2=A0=C2=A0Tier =C2=A0=C2=A0UUID
>          =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=
>  =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=
>  =A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0<br>
>          stratis_hdd =C2=A0=C2=A0/dev/dm-6 =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=
>  =A0=C2=A0292.95 GiB =C2=A0=C2=A0CACHE
>          =C2=A0=C2=A0770d0190-c17b-4349-a9f9-0968036e6b2c
>          <br>
>          stratis_hdd =C2=A0=C2=A0/dev/dm-7 =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=
>  =A0=C2=A0=C2=A0=C2=A01.43 TiB =C2=A0=C2=A0=C2=A0DATA
>          =C2=A0=C2=A09a5b1c4d-8014-4155-990e-eedfd27803a6<br>
>        </span><br>
>      </p>
>      <p>However, since a few weeks my /home has become unstable. Newly
>        created (or altered) files are (sometimes) corrupted after a
>        reboot of the system.</p>
>      <p>For both mount points I&#39;m using a SSD cache in front of a HDD. I=
>  t
>        feels a bit like the caching layer is all right, but the HDD layer
>        is on error (exhausted?). For me, it looks like that would explain
>        the observed behaviour.</p>
>      <p>I wonder if</p>
>      <p>* I could somehow &#39;disable&#39; (or remove) the SSD caching
> laye=
>  r?<br>
>        * I could get some debug informations?<br>
>      </p>
>      <p>Kind regards,</p>
>      <p>aanno<br>
>      </p>
>      <p><span
> style=3D"font-family:monospace"></span></p>
>    </div>
>
>  --<br>
>  _______________________________________________<br>
>  stratis-devel mailing list -- <a href=3D"mailto:[e-mail]=
>  osted.org" <stratis-devel(a)lists.fedorah=osted.org&gt;
> target=3D&quot;_blank&quot;&gt;stratis-devel(a)lists.fedorahosted.org&lt;/a&gt;&lt;br&gt;
>  To unsubscribe send an email to <a href=3D"mailto:stratis-devel-leave@lists=
>  .fedorahosted.org" <stratis-devel-leave(a)lists=.fedorahosted.org&gt;
> target=3D&quot;_blank&quot;&gt;stratis-devel-leave(a)lists.fedorahosted=
>  .org</a><br>
>  Fedora Code of Conduct: <a href=3D"https://docs.fedoraproject.org/en-US/pro=
>  ject/code-of-conduct/"
> <https://docs.fedoraproject.org/en-US/pro=ject/code-of-conduct/>
> rel=3D"noreferrer"
> target=3D"_blank">https://docs.fe=doraproject.org/en-US/proj...
>  List Guidelines: <a href=3D"https://fedoraproject.org/wiki/Mailing_list_gui=
>  delines" <https://fedoraproject.org/wiki/Mailing_list_gui=delines>
> rel=3D"noreferrer"
> target=3D"_blank">https://fedoraproject.org/wik=
>  i/Mailing_list_guidelines</a><br>
>  List Archives: <a href=3D"https://lists.fedorahosted.org/archives/list/stra=
>  tis-devel(a)lists.fedorahosted.org&quot;
> <https://lists.fedorahosted.org/archives/list/stra=[e-mail]...
> rel=3D"noreferrer"
> target=3D"_blank">http=s://lists.fedorahosted.org/archives/l...
>  rg</a><br>
>  Do not reply to spam, report it: <a href=3D"https://pagure.io/fedora-infras=
>  tructure/new_issue" <https://pagure.io/fedora-infras=tructure/new_issue>
> rel=3D"noreferrer" target=3D"_blank">https://pagure.io/=
>  fedora-infrastructure/new_issue</a><br>
>  </blockquote></div><br clear=3D"all"><br><span
> class=3D"gmail_signature_pre=
>  fix">-- </span><br><div dir=3D"ltr"
> class=3D"gmail_signature"><div dir=3D"l=
>  tr">John<br>he/him<br>Principal Software Engineer, Stratis
> team</div></div>=
>  </div>
>
>  --000000000000b6b959060c57fb18--
>
>  ------------------------------
>
>  Subject: Digest Footer
>
>  --
>  _______________________________________________
>  stratis-devel mailing list -- stratis-devel(a)lists.fedorahosted.org
>  To unsubscribe send an email to stratis-devel-leave(a)lists.fedorahosted.org
>  Fedora Code of Conduct: https://docs.fedoraproject.org/en-US/project/code-of-conduct/
>  List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines
>  List Archives:
> https://lists.fedorahosted.org/archives/list/[e-mail]...
>  Do not reply to spam, report it: https://pagure.io/fedora-infrastructure/new_issue
>
>
>  ------------------------------
>
>  End of stratis-devel Digest, Vol 47, Issue 2
>  ********************************************
>
>  --
>  _______________________________________________
>  stratis-devel mailing list -- stratis-devel(a)lists.fedorahosted.org
>  To unsubscribe send an email to stratis-devel-leave(a)lists.fedorahosted.org
>  Fedora Code of Conduct:
>  https://docs.fedoraproject.org/en-US/project/code-of-conduct/
>  List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines
>  List Archives:
>  https://lists.fedorahosted.org/archives/list/[e-mail]...
>  Do not reply to spam, report it:
>  https://pagure.io/fedora-infrastructure/new_issue
>  

-- 
John
he/him
Principal Software Engineer, Stratis team