3:38 p.m.
Is it possible to checkout an entire Fedora release now with git? I used to
have a checkout of the "devel" branch which was useful for grepping all of the
spec files.
--
Orion Poplawski
Technical Manager 303-415-9701 x222
NWRA/CoRA Division FAX: 303-415-9702
3380 Mitchell Lane orion(a)cora.nwra.com
Boulder, CO 80301 http://www.cora.nwra.com
4:01 p.m.
-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1
On 8/16/10 1:38 PM, Orion Poplawski wrote:
Is it possible to checkout an entire Fedora release now with git? I
used to
have a checkout of the "devel" branch which was useful for grepping all of the
spec files.
Not without some scripting. We no longer create the hack that made this
possible.
- --
Jesse Keating
Fedora -- Freedom² is a feature!
identi.ca: http://identi.ca/jkeating
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.4.9 (Darwin)
Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/
iEYEARECAAYFAkxppzAACgkQ4v2HLvE71NXE0wCfbePHppuUYS1Z+bDQa4Yy9Nn2
gZcAninWP86rtkZQCIuI9vVlHLD4bw3n
=BO9L
-----END PGP SIGNATURE-----
3:07 p.m.
On 08/16/2010 03:01 PM, Jesse Keating wrote:
-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1
On 8/16/10 1:38 PM, Orion Poplawski wrote:
> Is it possible to checkout an entire Fedora release now with git? I used to
> have a checkout of the "devel" branch which was useful for grepping all of
the
> spec files.
Not without some scripting. We no longer create the hack that made this
possible.
Initial attempt is here:
https://fedorahosted.org/fedora-packager/ticket/58
Proceeding with checkout now. About 3 seconds/package, 10,667 packages =
almost 9 hours. Not sure what it was with CVS. Much less connection overhead
in that case I think.
I wonder if submodules could be harnessed for this?
--
Orion Poplawski
Technical Manager 303-415-9701 x222
NWRA/CoRA Division FAX: 303-415-9702
3380 Mitchell Lane orion(a)cora.nwra.com
Boulder, CO 80301 http://www.cora.nwra.com
3:28 p.m.
-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1
On 8/17/10 1:07 PM, Orion Poplawski wrote:
On 08/16/2010 03:01 PM, Jesse Keating wrote:
> -----BEGIN PGP SIGNED MESSAGE-----
> Hash: SHA1
>
> On 8/16/10 1:38 PM, Orion Poplawski wrote:
>> Is it possible to checkout an entire Fedora release now with git? I used to
>> have a checkout of the "devel" branch which was useful for grepping all
of the
>> spec files.
>
> Not without some scripting. We no longer create the hack that made this
> possible.
Initial attempt is here:
https://fedorahosted.org/fedora-packager/ticket/58
Proceeding with checkout now. About 3 seconds/package, 10,667 packages =
almost 9 hours. Not sure what it was with CVS. Much less connection overhead
in that case I think.
I wonder if submodules could be harnessed for this?
Submodules were/are quite painful to use in git. Still very bolt on.
If you're able to create a long term ssh socket to the git server you
could re-use the connection and save a significant portion of the
connection overhead.
- --
Jesse Keating
Fedora -- Freedom² is a feature!
identi.ca: http://identi.ca/jkeating
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.4.9 (Darwin)
Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/
iEYEARECAAYFAkxq8OMACgkQ4v2HLvE71NWjwgCgpR8XH0Y7xS/Sspd0vx3xd4w+
5kAAnj26w/UYionGiggWBMSLuvo1lxlu
=W48f
-----END PGP SIGNATURE-----
4:12 p.m.
On 08/17/2010 02:28 PM, Jesse Keating wrote:
If you're able to create a long term ssh socket to the git server
you
could re-use the connection and save a significant portion of the
connection overhead.
Interesting idea, but I don't see how to do this. git clone is taking the
ssh: url and making the connection. I don't see anyway to pass it a socket.
Perhaps via dulwich, though it seems terribly under documented.
--
Orion Poplawski
Technical Manager 303-415-9701 x222
NWRA/CoRA Division FAX: 303-415-9702
3380 Mitchell Lane orion(a)cora.nwra.com
Boulder, CO 80301 http://www.cora.nwra.com
4:16 p.m.
-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1
On 8/17/10 2:12 PM, Orion Poplawski wrote:
On 08/17/2010 02:28 PM, Jesse Keating wrote:
> If you're able to create a long term ssh socket to the git server you
> could re-use the connection and save a significant portion of the
> connection overhead.
Interesting idea, but I don't see how to do this. git clone is taking the
ssh: url and making the connection. I don't see anyway to pass it a socket.
Perhaps via dulwich, though it seems terribly under documented.
Ssh has a control socket system that will create a socket the first time
you connect and keep it open so long as you are connected. Subsequent
ssh attempts will use the socket, which is completely hidden from the
caller.
- --
Jesse Keating
Fedora -- Freedom² is a feature!
identi.ca: http://identi.ca/jkeating
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.4.9 (Darwin)
Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/
iEYEARECAAYFAkxq/CoACgkQ4v2HLvE71NXpnACaAv3i5+sEckq4ITj4rdF5nFVI
0+wAnA4517WS3wd7b/MttfCMEzUirX/w
=180t
-----END PGP SIGNATURE-----
4:22 p.m.
On Tue, Aug 17, 2010 at 03:12:14PM -0600, Orion Poplawski wrote:
On 08/17/2010 02:28 PM, Jesse Keating wrote:
> If you're able to create a long term ssh socket to the git server you
> could re-use the connection and save a significant portion of the
> connection overhead.
Interesting idea, but I don't see how to do this. git clone is taking the
ssh: url and making the connection. I don't see anyway to pass it a socket.
Perhaps via dulwich, though it seems terribly under documented.
This is how I did it for CVS, I did not yet implement this for git:
http://blogs.23.nu/till/2008/12/ssh-via-cvs-with-automatic-control-socket...
Regards
Till
6:01 p.m.
On 08/17/2010 03:22 PM, Till Maas wrote:
On Tue, Aug 17, 2010 at 03:12:14PM -0600, Orion Poplawski wrote:
> On 08/17/2010 02:28 PM, Jesse Keating wrote:
>> If you're able to create a long term ssh socket to the git server you
>> could re-use the connection and save a significant portion of the
>> connection overhead.
>
> Interesting idea, but I don't see how to do this. git clone is taking the
> ssh: url and making the connection. I don't see anyway to pass it a socket.
> Perhaps via dulwich, though it seems terribly under documented.
This is how I did it for CVS, I did not yet implement this for git:
http://blogs.23.nu/till/2008/12/ssh-via-cvs-with-automatic-control-socket...
Regards
Till
Cool. The only difference appears to be that git passes user@host, so the
following:
$ export GIT_SSH=~/bin/fedora-git-ssh.sh
$ cat ~/.ssh/config
Host cvs.fedoraproject.org
ForwardX11 no
ForwardAgent no
ControlMaster auto
ControlPath ~/.ssh/controlsocket-%r@%h-%p
$ cat ~/bin/fedora-git-ssh.sh
#! /bin/bash
/usr/bin/test -e ~/.ssh/controlsocket-${1}-22 || /usr/bin/ssh -f -N ${1}
</dev/null >/dev/null 2>/dev/null
exec /usr/bin/ssh "$@"
Seems to work.
Also turning off all forwardings seems to have helped as well. ForwardX11
triggers a call to xauth on each connection otherwise. I have them turned on
by default otherwise.
I wonder if this is worth shipping with fedpkg?
--
Orion Poplawski
Technical Manager 303-415-9701 x222
NWRA/CoRA Division FAX: 303-415-9702
3380 Mitchell Lane orion(a)cora.nwra.com
Boulder, CO 80301 http://www.cora.nwra.com
7:37 p.m.
On Tue, 2010-08-17 at 23:22 +0200, Till Maas wrote:
This is how I did it for CVS, I did not yet implement this for git:
http://blogs.23.nu/till/2008/12/ssh-via-cvs-with-automatic-control-socket...
https://bugzilla.mindrot.org/show_bug.cgi?id=1330 has a much nicer
solution than the shell script wrapper.
--
David Woodhouse Open Source Technology Centre
David.Woodhouse(a)intel.com Intel Corporation
3:01 a.m.
David Woodhouse <dwmw2(a)infradead.org> writes:
On Tue, 2010-08-17 at 23:22 +0200, Till Maas wrote:
> This is how I did it for CVS, I did not yet implement this for git:
> http://blogs.23.nu/till/2008/12/ssh-via-cvs-with-automatic-control-socket...
https://bugzilla.mindrot.org/show_bug.cgi?id=1330 has a much nicer
solution than the shell script wrapper.
Add "ControlMaster auto" to .ssh/config and do
$ ssh -f -N pkgs.fedoraproject.org
Andreas.
--
Andreas Schwab, schwab(a)redhat.com
GPG Key fingerprint = D4E8 DBE3 3813 BB5D FA84 5EC7 45C6 250E 6F00 984E
"And now for something completely different."
5027
days inactive
5029
days old
9 comments
5 participants
participants (5)
-
Andreas Schwab -
David Woodhouse -
Jesse Keating -
Orion Poplawski -
Till Maas