F22 System Wide Change: Elasticsearch

[Jaroslav Reznik]

= Proposed System Wide Change: Elasticsearch =
https://fedoraproject.org/wiki/Changes/Elasticsearch

Change owner(s): Jiri Vanek <jvanek(a)rehat.com&gt;

Goal of this change is to pack Elasticsearch into main Fedora repo. 

== Detailed Description ==
The Elasticsearch [1] is fully-featured self-standing opensource [2] indexing 
server. Many people and many tools do use it. And many people do want it in 
Fedora. Aim of this Change is to make elastic search available by simple yum 
install elasticsearch, and of course enable it as dependence. To build a 
custom indexing tool on top of elastic search is more easy than current 
upstream install and download. 

== Scope ==
* Proposal owners:
** pack Elasticsearch - nearly done - see RHBZ#902086
** make it somehow works
** verify it works
** tune list of crucial dependencies
** enable Elasticsearch as service - something what have to be decided

* Other developers: 
** '''This is crucial part of this proposal'''
** Elastic search is extremely tuned application, and like it, its 
dependencies must be strictly kept in correct versions
** Currently known troublemakers:
*** lucene
*** netty3
*** sigar
*** compress-lzf
*** guava (currently needed 18, avaiable 17)

* Release engineering: 
** Nothing I'm aware about.

* Policies and guidelines: 
** Nothing I'm aware about.
** maybe... fedora is going by way - keep as updated as possible, if it  
breaks something, that something have to be fixed. This is not best for ES. 
Maybe ES can et some helping exception?

[1] http://www.elasticsearch.com/products/elasticsearch
[2] https://github.com/elasticsearch/elasticsearch/

_______________________________________________
devel-announce mailing list
devel-announce(a)lists.fedoraproject.org
https://admin.fedoraproject.org/mailman/listinfo/devel-announce

[Josh Boyer]

On Wed, Dec 17, 2014 at 9:03 AM, Jaroslav Reznik <jreznik(a)redhat.com&gt; wrote:
>  = Proposed System Wide Change: Elasticsearch =
>  https://fedoraproject.org/wiki/Changes/Elasticsearch
>
>  Change owner(s): Jiri Vanek <jvanek(a)rehat.com&gt;
>
>  Goal of this change is to pack Elasticsearch into main Fedora repo.
>
>  == Detailed Description ==
>  The Elasticsearch [1] is fully-featured self-standing opensource [2] indexing
>  server. Many people and many tools do use it. And many people do want it in
>  Fedora. Aim of this Change is to make elastic search available by simple yum
>  install elasticsearch, and of course enable it as dependence. To build a
>  custom indexing tool on top of elastic search is more easy than current
>  upstream install and download.
>
>  == Scope ==
>  * Proposal owners:
>  ** pack Elasticsearch - nearly done - see RHBZ#902086
>  ** make it somehow works
>  ** verify it works
>  ** tune list of crucial dependencies
>  ** enable Elasticsearch as service - something what have to be decided
>
>  * Other developers:
>  ** '''This is crucial part of this proposal'''
>  ** Elastic search is extremely tuned application, and like it, its
>  dependencies must be strictly kept in correct versions
>  ** Currently known troublemakers:
>  *** lucene
>  *** netty3
>  *** sigar
>  *** compress-lzf
>  *** guava (currently needed 18, avaiable 17) 
So from what I can tell, the dependency issues are the only thing that
is preventing this from being a self-contained Change.  Is that
correct?

If so, perhaps pursuing a bundling exception would be a more
straightforward approach.

josh

[Aleksandar Kurtakov]

Not a bundling but creating a compat packages for older version where needed. Nothing
stops people from creating them now.

Alexander Kurtakov
Red Hat Eclipse team

----- Original Message -----
>  From: "Josh Boyer" <jwboyer(a)fedoraproject.org&gt;
>  To: "Development discussions related to Fedora"
> <devel(a)lists.fedoraproject.org&gt;
>  Sent: Wednesday, December 17, 2014 4:25:35 PM
>  Subject: Re: F22 System Wide Change: Elasticsearch
>  
>  On Wed, Dec 17, 2014 at 9:03 AM, Jaroslav Reznik <jreznik(a)redhat.com&gt; wrote:
>  > = Proposed System Wide Change: Elasticsearch =
>  > https://fedoraproject.org/wiki/Changes/Elasticsearch
>  >
>  > Change owner(s): Jiri Vanek <jvanek(a)rehat.com&gt;
>  >
>  > Goal of this change is to pack Elasticsearch into main Fedora repo.
>  >
>  > == Detailed Description ==
>  > The Elasticsearch [1] is fully-featured self-standing opensource [2]
>  > indexing
>  > server. Many people and many tools do use it. And many people do want it in
>  > Fedora. Aim of this Change is to make elastic search available by simple
>  > yum
>  > install elasticsearch, and of course enable it as dependence. To build a
>  > custom indexing tool on top of elastic search is more easy than current
>  > upstream install and download.
>  >
>  > == Scope ==
>  > * Proposal owners:
>  > ** pack Elasticsearch - nearly done - see RHBZ#902086
>  > ** make it somehow works
>  > ** verify it works
>  > ** tune list of crucial dependencies
>  > ** enable Elasticsearch as service - something what have to be decided
>  >
>  > * Other developers:
>  > ** '''This is crucial part of this proposal'''
>  > ** Elastic search is extremely tuned application, and like it, its
>  > dependencies must be strictly kept in correct versions
>  > ** Currently known troublemakers:
>  > *** lucene
>  > *** netty3
>  > *** sigar
>  > *** compress-lzf
>  > *** guava (currently needed 18, avaiable 17)
>  
>  So from what I can tell, the dependency issues are the only thing that
>  is preventing this from being a self-contained Change.  Is that
>  correct?
>  
>  If so, perhaps pursuing a bundling exception would be a more
>  straightforward approach.
>  
>  josh
>  --
>  devel mailing list
>  devel(a)lists.fedoraproject.org
>  https://admin.fedoraproject.org/mailman/listinfo/devel
>  Fedora Code of Conduct: http://fedoraproject.org/code-of-conduct

[Zbigniew Jędrzejewski-Szmek]

>  ----- Original Message -----
>  > From: "Josh Boyer" <jwboyer(a)fedoraproject.org&gt;
>  > To: "Development discussions related to Fedora"
> <devel(a)lists.fedoraproject.org&gt;
>  > Sent: Wednesday, December 17, 2014 4:25:35 PM
>  > Subject: Re: F22 System Wide Change: Elasticsearch
>  > 
>  > On Wed, Dec 17, 2014 at 9:03 AM, Jaroslav Reznik <jreznik(a)redhat.com&gt; wrote:
>  > > = Proposed System Wide Change: Elasticsearch =
>  > > https://fedoraproject.org/wiki/Changes/Elasticsearch
>  > >
>  > > Change owner(s): Jiri Vanek <jvanek(a)rehat.com&gt;
>  > >
>  > > Goal of this change is to pack Elasticsearch into main Fedora repo.
>  > >
>  > > == Detailed Description ==
>  > > The Elasticsearch [1] is fully-featured self-standing opensource [2]
>  > > indexing
>  > > server. Many people and many tools do use it. And many people do want it in
>  > > Fedora. Aim of this Change is to make elastic search available by simple
>  > > yum
>  > > install elasticsearch, and of course enable it as dependence. To build a
>  > > custom indexing tool on top of elastic search is more easy than current
>  > > upstream install and download.
>  > >
>  > > * Other developers:
>  > > ** '''This is crucial part of this proposal'''
>  > > ** Elastic search is extremely tuned application, and like it, its
>  > > dependencies must be strictly kept in correct versions
>  > > ** Currently known troublemakers:
>  > > *** lucene
>  > > *** netty3
>  > > *** sigar
>  > > *** compress-lzf
>  > > *** guava (currently needed 18, avaiable 17)
>  > 
>  > So from what I can tell, the dependency issues are the only thing that
>  > is preventing this from being a self-contained Change.  Is that
>  > correct? 
Actually only guava 18 and sigar java binding are missing, iiuc [1].
The first requires somebody to create the update, the second
one already has a patch so should not be a problem. Especially if anything
else requires a version bump, please file bugs on specific packages,
so it's easier to see what is going on.

[1] https://bugzilla.redhat.com/showdependencygraph.cgi?id=902086

>  > If so, perhaps pursuing a bundling exception would be a more
>  > straightforward approach. 
On Wed, Dec 17, 2014 at 09:39:50AM -0500, Aleksandar
Kurtakov top-posted:
>  Not a bundling but creating a compat packages for older version
  where needed. Nothing stops people from creating them now.

We should strive to simply update all dependencies and packages using
them to the latest version. Only when this fails we should start discussing
compat packages.

>  > > == Scope ==
>  > > * Proposal owners:
>  > > ** pack Elasticsearch - nearly done - see RHBZ#902086
>  > > ** make it somehow works
>  > > ** verify it works
>  > > ** tune list of crucial dependencies
>  > > ** enable Elasticsearch as service - something what have to be decided 
So
there really are two parts to this Change. The first is packaging
of elasticsearch and its dependencies. This part seems to be going well.

The second is enabling elasticsearch by default and making use of it in other
packages. This part of the proposal needs some fleshing-out: I don't see
why it should be enabled by default, unless it is used by other things
which are on by default, and cannot express the dependency otherwise.
What would it be used by and for? Please expand on that.

Zbyszek

[Mikolaj Izdebski]

On 12/17/2014 06:55 PM, Zbigniew Jędrzejewski-Szmek wrote:
>  On Wed, Dec 17, 2014 at 09:39:50AM -0500, Aleksandar Kurtakov
> top-posted:
> > > Not a bundling but creating a compat packages for older version
>    where needed. Nothing stops people from creating them now.
>  
>  We should strive to simply update all dependencies and packages using
>  them to the latest version. Only when this fails we should start discussing
>  compat packages. 
Bundling is the worst thing possible and in most cases it should be
avoided.  First we shoud try to use default (which usually is latest)
version avaliable in Fedora, creating patch if necessary and sending it
upstream.  If it is impractical to port to latest version then creating
compat package is acceptable as alternative solution.  Current Java
packaging state it very easy (maybe even too easy) to create such compat
packages.

-- 
Mikolaj Izdebski
Java SIG