Draft for talk about statscache in Flock 2015

Ralph Bean rbean at redhat.com
Mon Apr 27 19:38:35 UTC 2015


On Tue, Apr 28, 2015 at 12:46:14AM +0530, Ratnadeep Debnath wrote:
> Hi all,
> 
> I want to propose a talk on our ongoing project: statscache[1] in
> Flock 2015. I am sharing a draft of the proposal for your review:
> 
> Title
> ====
> Statscache, a near realtime intelligent caching layer empowering
> faster data representation
> 
> Summary
> =======
> Fedmsg and fedmsg based tools: datanommer, datagrepper, etc. have
> indeed taken communication and coordination across various components
> in the Fedora ecosystem to an all new level. Currently, we are using
> the raw datagrepper APIs to render various widgets and data
> visualization. However, due to the massive amount of data stored in
> datagrepper backend, searches tend to be slower. Also, consuming the
> raw datagrepper API leads to increased data payload over the network
> and writing complex client side logic to format the data.
> 
> Statscache is an attempt to solve the above problems and also to
> create a generic framework to empower powerful data visualization. It
> achieves this by listening to fedmsg events and storing the
> denormalized and clean data in desired format for faster retrieval. It
> also aims to become an intelligent caching layer based on "Single
> source of truth" model and publishing REST and websocket API around it
> to enable faster and realtime data visualizations. This could become
> the backbone for empowering various widgets in Fedora hub.
> 
> Topology diagram:
> https://raw.githubusercontent.com/fedora-infra/statscache/develop/docs/diagrams/topology.txt
> 
> [1]: https://github.com/fedora-infra/statscache

+1 from me :)
-------------- next part --------------
A non-text attachment was scrubbed...
Name: signature.asc
Type: application/pgp-signature
Size: 473 bytes
Desc: not available
URL: <http://lists.fedoraproject.org/pipermail/infrastructure/attachments/20150427/bceddad2/attachment.sig>


More information about the infrastructure mailing list