[releng] Issue #7265: blender git repo contains large files causing git checkout to timeout during builds
hobbes1069 reported a new issue against the project: `releng` that you are following: `` ``` From checkout.log: $ git clone -n https://src.fedoraproject.org/rpms/blender.git /var/lib/mock/f28-build-11036148-838686/root/tmp/scmroot/blender Cloning into '/var/lib/mock/f28-build-11036148-838686/root/tmp/scmroot/blender'... error: RPC failed; curl 18 transfer closed with outstanding read data remaining fatal: The remote end hung up unexpectedly fatal: protocol error: bad pack header ```
``` $ git rev-list --objects --all | grep ".rpm|.gz" 6115a22040643818e89404f301faa1d4a4ce4a56 results_blender/2.77a/1.fc23/blender-2.77a-1.fc24.src.rpm 2340a78e377e89c3a3b751a997ce0a563a9714ff results_blender/2.77a/1.fc23/blender-2.77a-1.fc24.x86_64.rpm 7966c177500299784bcaa963381f14b74eddc108 results_blender/2.77a/1.fc23/blender-debuginfo-2.77a-1.fc24.x86_64.rpm 014423f48c5697e0c256cc93c789823800883d85 results_blender/2.77a/1.fc23/blender-rpm-macros-2.77a-1.fc24.noarch.rpm e2e943ce223ac62904fde4717ceac8e4f3387018 results_blender/2.77a/1.fc23/blenderplayer-2.77a-1.fc24.x86_64.rpm e3c53ce853edd37b76bc5b4d422f85b14a1a10c5 results_blender/2.77a/1.fc23/fonts-blender-2.77a-1.fc24.noarch.rpm 5b6716c806f9ef18beaeed55beb07b2c162179b6 results_blender/2.77a/1.fc26/blender-2.77a-1.fc26.src.rpm 12a5eee6eb79f3ec8c257cc4b02a16e1c0774966 results_blender/2.77a/1.fc26/blender-2.77a-1.fc26.x86_64.rpm 8a7e6d7dc970f5b1fdd66e9a9e57e814db4de9a2 results_blender/2.77a/1.fc26/blender-debuginfo-2.77a-1.fc26.x86_64.rpm ac7b7d731e06bf30deb8cfcbbf2a7002b3cef7c4 results_blender/2.77a/1.fc26/blender-rpm-macros-2.77a-1.fc26.noarch.rpm 9b783965dbe33cdc8a670a70d5212e62442094ec results_blender/2.77a/1.fc26/blenderplayer-2.77a-1.fc26.x86_64.rpm dee39b967a93774562690fc7a898013bbdd831e5 results_blender/2.77a/1.fc26/fonts-blender-2.77a-1.fc26.noarch.rpm 7bffb5068eb55df30d688d8608cd9264a77c8cf3 results_blender/2.78/1.fc26/blender-2.78-1.fc26.src.rpm c89795526e03033ff0255495f94ced42cea86271 results_blender/2.78/1.fc26/blender-2.78-1.fc26.x86_64.rpm 12907ae1397483d284498820e3fac62ad7e17c07 results_blender/2.78/1.fc26/blender-debuginfo-2.78-1.fc26.x86_64.rpm b518a731b7f38961433cbf8f6b2b9c4716fce785 results_blender/2.78/1.fc26/blender-rpm-macros-2.78-1.fc26.noarch.rpm 4cd2e44e3562eb77ddf4c3193e80f69389469090 results_blender/2.78/1.fc26/blenderplayer-2.78-1.fc26.x86_64.rpm 6459a4e4cf1ac226117b091ddd7a59bec6cfc6b5 results_blender/2.78/1.fc26/fonts-blender-2.78-1.fc26.noarch.rpm 30bb773c1b4242fdb48b33788e53374a4a900e14 blender-2.77a-1.el7.src.rpm a6c477b254d54ebe07ed11df6b2ec41e132ddded blender-2.77a-1.fc23.src.rpm a34c5c49de2fcd378e3d7f74cecfc1dcf77082af blender-2.77a-1.fc26.src.rpm e17f27a4415c31a747f76e10a68e592bf5d25b47 blender-2.78-1.el7.src.rpm 0e7cb8ad4bf7571ac1123c853e5636854e622124 blender-2.78-1.fc26.src.rpm a4a9f0f6a24e622799cfefccf1804cae48cdfcae blender-2.78.tar.gz ```
Can these files be removed? ``
To reply, visit the link below or just reply to this email https://pagure.io/releng/issue/7265
kevin added a new comment to an issue you are following: `` In order to delete anything we need to have approval from FESCo (who has not wanted to do so in the past).
I did a 'git gc' on the repo and also set postBuffer = 10485760 (10mb instead of the default of 1).
Can you see if thats enough to get it building?
``
To reply, visit the link below or just reply to this email https://pagure.io/releng/issue/7265
hobbes1069 added a new comment to an issue you are following: `` I'll give it a shot but these files really have no business being in git regardless. ``
To reply, visit the link below or just reply to this email https://pagure.io/releng/issue/7265
hobbes1069 added a new comment to an issue you are following: `` We'll see if it builds, but the git checkout succeeded. ``
To reply, visit the link below or just reply to this email https://pagure.io/releng/issue/7265
hobbes1069 added a new comment to an issue you are following: `` Forgot to come back and update the ticket but the build was successful. ``
To reply, visit the link below or just reply to this email https://pagure.io/releng/issue/7265
kellin added a new comment to an issue you are following: `` [Filed an issue with FESCO](https://pagure.io/fesco/issue/1848) to see if we can clean this up. ``
To reply, visit the link below or just reply to this email https://pagure.io/releng/issue/7265
ausil added a new comment to an issue you are following: `` We have to leave them there, we can not go and rewrite history of the git repos. ``
To reply, visit the link below or just reply to this email https://pagure.io/releng/issue/7265
zbyszek added a new comment to an issue you are following: `` FESCo discussed this issue on 2018-03-02 and gave the green light:
AGREED: Move branches with huge commits to refs/archive/ and create new sanitized branches (+6, 0, 0)
The idea is to move the bad heads to refs/archive/, so that they will remain in the repo, will not be garbage collected by git, but will not be cloned by git by default. I.e. the repo will still be large, but only on pagure, and cloning will be fast. ``
To reply, visit the link below or just reply to this email https://pagure.io/releng/issue/7265
zbyszek added a new comment to an issue you are following: `` Can we get this implemented? ``
To reply, visit the link below or just reply to this email https://pagure.io/releng/issue/7265
zbyszek added a new comment to an issue you are following: `` Still an issue :[
``
To reply, visit the link below or just reply to this email https://pagure.io/releng/issue/7265
The issue: `blender git repo contains large files causing git checkout to timeout during builds` of project: `releng` has been assigned to `mohanboddu` by syeghiay.
zbyszek added a new comment to an issue you are following: `` I got hit by this again when trying to fix a FTBFS for blender. Can we *please* get this done? ``
To reply, visit the link below or just reply to this email https://pagure.io/releng/issue/7265
churchyard added a new comment to an issue you are following: `` What needs to be done here? How can I help? Working with the blender package is tedious. ``
To reply, visit the link below or just reply to this email https://pagure.io/releng/issue/7265
rel-eng@lists.fedoraproject.org
-
Dennis Gilmore -
Kellin
-
Kevin Fenzi
-
Miro Hrončok
-
Richard Shaw
-
Suzanne Yeghiayan
-
Zbigniew Jędrzejewski-Szmek