Self introduction: Alexandre Moine & metrics idea

[Alexandre Moine]

Hi,

My name is Alexandre Moine and I am a french student in computer science. I am working on
fedora as a packager and an ambassador for now 4 years.

I am currently working for an event [1], and I found very difficult to find any stats
about fedora. On the CommOps wiki page, there is some link about tools (fedora-stats-tool,
gscoc-stats), but they are not very easy to use for the first, and too focused for the
second.
I was thinking about a site that will provide all fedora basic-data (based on the great
fedora apps datagrepper), like number of package added, number of user, with charts. We
can also imagine a tool that will provide more specific datas/charts (number of wiki edit
per day or number of crated iso by pungi per weeks) on demand. 

This wiki page [2] have good ideas, but it is kind of outdated.

This can help ambassadors, like me now, or even all the part of the project: to now for
example if a service is well used or not, or to see if a part of the project needs help.

There is here, I think, no huge difficulties. Datagrepper is really easy to use. It only
require "some" website devel and intergration. I'm a not a professional dev,
and I apologize in advance if my words are not wisely ;)
I am talking about a website because they are more friendly, but a great python tool will
be very nice :)

Please tell me what you think about it, and if you have any ideas.

Alexandre

[1]: https://fedoraproject.org/wiki/Rencontres_Fedora_24_%C3%A0_Universciences
[2]: https://fedoraproject.org/wiki/Statistics_2.0

[Bhagyashree Uday]

Hi Alexandre ,

Thanks for the mail and metrics suggestions.

On Wed, Aug 24, 2016 at 10:29 AM, Alexandre Moine <nobrakal(a)gmail.com&gt;
wrote:

>  Hi,
>
>  My name is Alexandre Moine and I am a french student in computer science.
>  I am working on fedora as a packager and an ambassador for now 4 years.
>
>  I am currently working for an event [1], and I found very difficult to
>  find any stats about fedora. On the CommOps wiki page, there is some link
>  about tools (fedora-stats-tool, gscoc-stats), but they are not very easy to
>  use for the first, and too focused for the second.
>  
skamath or I can help you set up the tools you need and extract the stats
needed. We usually around in #fedora-commops irc channel. My IRC nick is
bee2502.


>  I was thinking about a site that will provide all fedora basic-data
> (based
>  on the great fedora apps datagrepper), like number of package added, number
>  of user, with charts. We can also imagine a tool that will provide more
>  specific datas/charts (number of wiki edit per day or number of crated iso
>  by pungi per weeks) on demand.
>  
Infra is currently working on a tool for getting such kinds of stats. It's
called statscache[1]. You can know more about the motivation and how it is
built here [2]. To store these kinds of metrics, you need to build a
statscache plugin first. However, for contributors interested in the final
data, there are plans to have a frontend for such metrics in Fedora
Hubs[3]. However,  this is going to take some time and if you need
immediate metrics for your event, I am sure the slides for 'State of
Fedora' talk by mattdm have some great ones. These are the slides from
FOSDEM in Jan 2016[4] and here is the more recent version from flock in Aug
2016[5] . If you need any metrics apart from these, dont hesitate to mail
or ping in IRC.

Also, since we are on this topic , pingou had in past created a web-front
end for metrics like you were suggesting. You can view it at
http://thisweekinfedora.org/. Unfortunately, it's no longer active.


>  This wiki page [2] have good ideas, but it is kind of outdated.
>  
Thanks for pointing out, the page surely needs some love and updates :)


>  This can help ambassadors, like me now, or even all the part of the
>  project: to now for example if a service is well used or not, or to see if
>  a part of the project needs help.
>
>  There is here, I think, no huge difficulties. Datagrepper is really easy
>  to use. It only require "some" website devel and intergration. I'm a not a
>  professional dev, and I apologize in advance if my words are not wisely ;)
>  I am talking about a website because they are more friendly, but a great
>  python tool will be very nice :)
>
>  Please tell me what you think about it, and if you have any ideas.
>  
Hope that is helpful,
Bee


>  Alexandre
>
>  [1]: https://fedoraproject.org/wiki/Rencontres_Fedora_24_%C3%A0_U
>  niversciences
>  [2]: https://fedoraproject.org/wiki/Statistics_2.0
>  _______________________________________________
>  Fedora Community Operations (CommOps) mailing list
>  commops(a)lists.fedoraproject.org
>  https://lists.fedoraproject.org/admin/lists/[e-mail]
>  doraproject.org
>  
[1] https://github.com/fedora-infra/statscache
[2] https://github.com/fedora-infra/statscache/blob/develop/README.rst
[3] https://pagure.io/fedora-hubs
[4] https://github.com/fedora-infra/fedora-stats-tools/blob/
develop/metrics2016/StateofFedoraJan2016-v160130c-fosdem.pdf
[5] https://mattdm.org/fedora/2016flock/StateofFedoraAugust2016-v160731a.pdf

[Alexandre Moine]

Hi Bhagyashree,

2016-08-24 11:48 GMT+02:00 Bhagyashree Uday <bhagyashree.iitg(a)gmail.com&gt;:

>  Hi Alexandre ,
>
>  Thanks for the mail and metrics suggestions.
>
>  On Wed, Aug 24, 2016 at 10:29 AM, Alexandre Moine <nobrakal(a)gmail.com&gt;
>  wrote:
>
> > Hi,
> >
> > My name is Alexandre Moine and I am a french student in computer science.
> > I am working on fedora as a packager and an ambassador for now 4 years.
> >
> > I am currently working for an event [1], and I found very difficult to
> > find any stats about fedora. On the CommOps wiki page, there is some link
> > about tools (fedora-stats-tool, gscoc-stats), but they are not very easy to
> > use for the first, and too focused for the second.
> >
>
>  skamath or I can help you set up the tools you need and extract the stats
>  needed. We usually around in #fedora-commops irc channel. My IRC nick is
>  bee2502.
>  
This is very kind. I managed to get all the data I needed with some python
and datagrepper magic. I just want to avoid this for other people.


> > I was thinking about a site that will provide all fedora basic-data
> > (based on the great fedora apps datagrepper), like number of package added,
> > number of user, with charts. We can also imagine a tool that will provide
> > more specific datas/charts (number of wiki edit per day or number of crated
> > iso by pungi per weeks) on demand.
> >
>
>  Infra is currently working on a tool for getting such kinds of stats. It's
>  called statscache[1]. You can know more about the motivation and how it is
>  built here [2]. To store these kinds of metrics, you need to build a
>  statscache plugin first. However, for contributors interested in the final
>  data, there are plans to have a frontend for such metrics in Fedora
>  Hubs[3]. However,  this is going to take some time and if you need
>  immediate metrics for your event, I am sure the slides for 'State of
>  Fedora' talk by mattdm have some great ones. These are the slides from
>  FOSDEM in Jan 2016[4] and here is the more recent version from flock in Aug
>  2016[5] . If you need any metrics apart from these, dont hesitate to mail
>  or ping in IRC.
>  
Statscache look great :D And yeah, I was more thinking about an end-user
usable datas. It is important for user, contributors and even curious
people to know the real state of fedora. Great if all is on the way!
Thank you for the link with the new datas from Flock, I didn't knew it.


>  Also, since we are on this topic , pingou had in past created a web-front
>  end for metrics like you were suggesting. You can view it at
>  http://thisweekinfedora.org/. Unfortunately, it's no longer active.
>
>
> > This wiki page [2] have good ideas, but it is kind of outdated.
> >
>
>  Thanks for pointing out, the page surely needs some love and updates :)
>  
> >
> > This can help ambassadors, like me now, or even all the part of the
> > project: to now for example if a service is well used or not, or to see if
> > a part of the project needs help.
> >
> > There is here, I think, no huge difficulties. Datagrepper is really easy
> > to use. It only require "some" website devel and intergration. I'm a
> not a
> > professional dev, and I apologize in advance if my words are not wisely ;)
> > I am talking about a website because they are more friendly, but a great
> > python tool will be very nice :)
> >
> > Please tell me what you think about it, and if you have any ideas.
> >
>
>  Hope that is helpful,
>  Bee
>  
It was, thank you again for your help !

Alexandre


> > Alexandre
> >
> > [1]: https://fedoraproject.org/wiki/Rencontres_Fedora_24_%C3%A0_U
> > niversciences
> > [2]: https://fedoraproject.org/wiki/Statistics_2.0
> > _______________________________________________
> > Fedora Community Operations (CommOps) mailing list
> > commops(a)lists.fedoraproject.org
> > https://lists.fedoraproject.org/admin/lists/[e-mail]
> > doraproject.org
> >
>
>  [1] https://github.com/fedora-infra/statscache
>  [2] https://github.com/fedora-infra/statscache/blob/develop/README.rst
>  [3] https://pagure.io/fedora-hubs
>  [4] https://github.com/fedora-infra/fedora-stats-tools/blob/deve
>  lop/metrics2016/StateofFedoraJan2016-v160130c-fosdem.pdf
>  [5] https://mattdm.org/fedora/2016flock/StateofFedoraAugust2016-
>  v160731a.pdf
>
>  _______________________________________________
>  Fedora Community Operations (CommOps) mailing list
>  commops(a)lists.fedoraproject.org
>  https://lists.fedoraproject.org/admin/lists/commops@lists.
>  fedoraproject.org
>
>

[Pierre-Yves Chibon]

On Wed, Aug 24, 2016 at 08:29:49AM -0000, Alexandre Moine wrote:
>  Hi,
>  
>  My name is Alexandre Moine and I am a french student in computer science. I am working on
> fedora as a packager and an ambassador for now 4 years.
>  
>  I am currently working for an event [1], and I found very difficult to find any stats
> about fedora. On the CommOps wiki page, there is some link about tools (fedora-stats-tool,
> gscoc-stats), but they are not very easy to use for the first, and too focused for the
> second.
>  I was thinking about a site that will provide all fedora basic-data (based on the great
> fedora apps datagrepper), like number of package added, number of user, with charts. We
> can also imagine a tool that will provide more specific datas/charts (number of wiki edit
> per day or number of crated iso by pungi per weeks) on demand. 
>  
>  This wiki page [2] have good ideas, but it is kind of outdated.
>  
>  This can help ambassadors, like me now, or even all the part of the project: to now for
> example if a service is well used or not, or to see if a part of the project needs help.
>  
>  There is here, I think, no huge difficulties. Datagrepper is really easy to use. It only
> require "some" website devel and intergration. I'm a not a professional dev,
> and I apologize in advance if my words are not wisely ;)
>  I am talking about a website because they are more friendly, but a great python tool will
> be very nice :) 
In addition to the already mentioned statscache, I also would like to point out
that datagrepper itself is already capable of doing graphs that can then be
integrated into a web-page:
https://apps.fedoraproject.org/datagrepper/charts/line?user=nobrakal&...
or
https://apps.fedoraproject.org/datagrepper/charts/stackedline?delta=60480...
(tiny url: https://is.gd/JPGPC8 )


Pierre

[Alexandre Moine]

>  On Wed, Aug 24, 2016 at 08:29:49AM -0000, Alexandre Moine wrote:
>  
>  In addition to the already mentioned statscache, I also would like to point out
>  that datagrepper itself is already capable of doing graphs that can then be
>  integrated into a web-page:
>  https://apps.fedoraproject.org/datagrepper/charts/line?user=nobrakal&...
>  or
>  https://apps.fedoraproject.org/datagrepper/charts/stackedline?delta=60480...
>  (tiny url: https://is.gd/JPGPC8 )
>  
>  
>  Pierre 
That is great ! It is exactly what I was looking for. It will be great to add a notice
about it in the main menu (to here for example:
https://apps.fedoraproject.org/datagrepper/charts/). Ideally, a front-end will be really
cool, to convert human-readable time to unix time fo example !

Thank you for your reply,

Alexandre

[Pierre-Yves Chibon]

On Tue, Aug 30, 2016 at 09:38:56AM -0000, Alexandre Moine wrote:
>  > On Wed, Aug 24, 2016 at 08:29:49AM -0000, Alexandre Moine
> wrote:
>  > 
>  > In addition to the already mentioned statscache, I also would like to point out
>  > that datagrepper itself is already capable of doing graphs that can then be
>  > integrated into a web-page:
>  > https://apps.fedoraproject.org/datagrepper/charts/line?user=nobrakal&...
>  > or
>  > https://apps.fedoraproject.org/datagrepper/charts/stackedline?delta=60480...
>  > (tiny url: https://is.gd/JPGPC8 )
>  
>  That is great ! It is exactly what I was looking for. It will be great to add a notice
> about it in the main menu (to here for example:
> https://apps.fedoraproject.org/datagrepper/charts/). Ideally, a front-end will be really
> cool, to convert human-readable time to unix time fo example ! 
Well it wasn't documented on the front page in purpose, making these graphs is a
pretty heavy process, so while it is there and usable I am not sure the idea was
to advertise it too broadly.


Pierre

[Alexandre Moine]

>  On Tue, Aug 30, 2016 at 09:38:56AM -0000, Alexandre Moine wrote:
>  
>  Well it wasn't documented on the front page in purpose, making these graphs is a
>  pretty heavy process, so while it is there and usable I am not sure the idea was
>  to advertise it too broadly.
>  
>  
>  Pierre 
Well, ok I understand. Cool to now it anyway :)

Thank you

Alexandre

[Justin W. Flory]

On 08/31/2016 05:53 AM, Alexandre Moine wrote:
> > On Tue, Aug 30, 2016 at 09:38:56AM -0000, Alexandre Moine wrote:
> >
> > Well it wasn't documented on the front page in purpose, making these graphs is a
> > pretty heavy process, so while it is there and usable I am not sure the idea was
> > to advertise it too broadly.
> >
> >
> > Pierre
>  Well, ok I understand. Cool to now it anyway :)
>  
>  Thank you
>  
>  Alexandre
>   
Hey Alexandre, welcome to the CommOps list!

As an afterthought, should you have any ideas about metrics collection
or long-term projects that you think would be helpful from an Ambassador
or Packager perspective, please be sure to add some thoughts and ideas
to this wiki page! We're trying to build a queue of ideas to work
through for metrics.

    https://fedoraproject.org/wiki/CommOps/Metrics_Ideas

Feel free to edit anything in at the bottom. :)

-- 
Cheers,
Justin W. Flory
jflory7(a)gmail.com