#319: Make a script to get and use AMI IDs automatically ------------------------+----------------------- Reporter: robyduck | Owner: webmaster Type: task | Status: new Priority: major | Milestone: Component: getfedora | Keywords: Blocked By: | Blocking: ------------------------+----------------------- AMI IDs are getting more and more and we'll probably have soon other public cloud services and not only Amazon. To make this part easier to maintain we should think about a script. I have an idea, it could work like this:
* use fedimg to get the IDs of the AMIs for all regions * put the IDs into a specific file (a dedicated ami_id.py variable file?) * all html files can get the IDs from that file simply by calling the variables * we should add the execution of the script to our makefile. This way we can update all IDs on every page manually just by doing ''make amis''. At the next build the IDs would be in the html pages
The source from where the script gets the IDs can be datanommer but also other sources. Not sure which one is easier and faster.
Ideas? Comments? Other proposals?
#319: Make a script to get and use AMI IDs automatically -----------------------+------------------------ Reporter: robyduck | Owner: webmaster Type: task | Status: new Priority: major | Milestone: Component: getfedora | Resolution: Keywords: | Blocked By: Blocking: | -----------------------+------------------------
Comment (by ralph):
There's currently some code in https://apps.fedoraproject.org/releng-dash that gets some AMI ids from datagrepper, but it's currently implemented in JSON.
rtnpro and I are working on a daemon and web service to cache and serve the latest relevant information about different systems: https://github.com/fedora-infra/statscache I expect that it could cache and serve the latest relevant AMI ids some day. It'll take quite a while before we can finish, vet, and deploy it though.
If we decide to go with something quicker/near-term, consider making it available as JSON instead of in a .py file so that it is easily consumable by anything that can make HTTP requests.
#319: Make a script to get and use AMI IDs automatically -----------------------+------------------------ Reporter: robyduck | Owner: webmaster Type: task | Status: new Priority: major | Milestone: Component: getfedora | Resolution: Keywords: | Blocked By: Blocking: | -----------------------+------------------------
Comment (by mattdm):
If we can make the JSON aligned with https://launchpad.net/simplestreams, that would be kinda nice from a cross-distro coherence point of view.
#319: Make a script to get and use AMI IDs automatically -----------------------+------------------------ Reporter: robyduck | Owner: webmaster Type: task | Status: new Priority: major | Milestone: Fedora 23 Component: getfedora | Resolution: Keywords: | Blocked By: Blocking: | -----------------------+------------------------ Changes (by robyduck):
* milestone: => Fedora 23
#319: Make a script to get and use AMI IDs automatically -----------------------+------------------------ Reporter: robyduck | Owner: webmaster Type: task | Status: new Priority: blocker | Milestone: Fedora 23 Component: getfedora | Resolution: Keywords: | Blocked By: Blocking: | -----------------------+------------------------ Changes (by robyduck):
* priority: major => blocker * cc: mruckman@…, rbean@… (added)
Comment:
Ok so we have a branch for it already and will merge it soon into f23 final branch. Ralph is working on it and it should not only get AMI IDs for final but also for prerelease versions.
We want to release this feature for F23 GA. After that we'll add also the bi-weekly Atomic image, which will be probably included in the same task.
#319: Make a script to get and use AMI IDs automatically -----------------------+------------------------ Reporter: robyduck | Owner: webmaster Type: task | Status: new Priority: blocker | Milestone: Fedora 23 Component: getfedora | Resolution: Keywords: | Blocked By: Blocking: | -----------------------+------------------------
Comment (by robyduck):
We should make sure the AMI ID script gets executed '''only''' when building getfedora.org. The IDs are not needed when building spins, labs or whatever. Also, if we have a connection error (which I faced already several times) it would break all websites builds.
Let's get the execution of this script into the getfedora.org dir instead of adding it to the global makefile. Any complains about that?
#319: Make a script to get and use AMI IDs automatically -----------------------+------------------------ Reporter: robyduck | Owner: webmaster Type: task | Status: new Priority: blocker | Milestone: Fedora 23 Component: getfedora | Resolution: Keywords: | Blocked By: Blocking: 356 | -----------------------+------------------------ Changes (by robyduck):
* blocking: => 356
#319: Make a script to get and use AMI IDs automatically -----------------------+------------------------ Reporter: robyduck | Owner: webmaster Type: task | Status: new Priority: blocker | Milestone: Fedora 23 Component: getfedora | Resolution: Keywords: | Blocked By: Blocking: 356 | -----------------------+------------------------
Comment (by ralph):
Moved the datagrepper AMI stuff to the getfedora.org-only build process in https://git.fedorahosted.org/cgit/fedora- web.git/commit/?h=f23&id=2e025b452f89019f2dc32945ff1ceb2da82efb82
#319: Make a script to get and use AMI IDs automatically -----------------------+------------------------ Reporter: robyduck | Owner: webmaster Type: task | Status: new Priority: blocker | Milestone: Fedora 23 Component: getfedora | Resolution: Keywords: | Blocked By: Blocking: 356 | -----------------------+------------------------
Comment (by robyduck):
The script it much nicer now, and shorter. Build time is never under 15 sec, but it still greps the AMI IDs when building spins, labs, arm...
#319: Make a script to get and use AMI IDs automatically -----------------------+------------------------ Reporter: robyduck | Owner: webmaster Type: task | Status: new Priority: blocker | Milestone: Fedora 23 Component: getfedora | Resolution: Keywords: | Blocked By: Blocking: 356 | -----------------------+------------------------
Comment (by ralph):
robyduck said in channel that the extraneous grepping is no longer an issue (there was a dangling .pyc file to blame). I think this one is good-to-go.
#319: Make a script to get and use AMI IDs automatically -----------------------+------------------------ Reporter: robyduck | Owner: webmaster Type: task | Status: new Priority: blocker | Milestone: Fedora 23 Component: getfedora | Resolution: Keywords: | Blocked By: Blocking: 356 | -----------------------+------------------------
Comment (by robyduck):
I changed the variables and dropped the comments in the script to pull the right AMI IDs. Seems they pull the right IDs now, final F23 IDs.
#319: Make a script to get and use AMI IDs automatically -----------------------+------------------------ Reporter: robyduck | Owner: webmaster Type: task | Status: closed Priority: blocker | Milestone: Fedora 23 Component: getfedora | Resolution: fixed Keywords: | Blocked By: Blocking: 356 | -----------------------+------------------------ Changes (by robyduck):
* resolution: => fixed * status: new => closed
Comment:
Working fine, thanks.
websites@lists.fedoraproject.org
-
fedora-badges