High Performance Git (gitperf.com)
161 points by gnabgib 11 hours ago
alxgsv 3 hours ago
I never faced git performance issues when working with code. Guess my repos weren't bit. But when I tried to use git as a versioned database of changes in my pet project, I learned a lot about indexes, compacting, etc. Article covers a lot and is very helpful!
ergl 2 hours ago
Surprise, surprise, another piece of LLM-generated slop on the front page of HN.
From chapter 1:
> When Git slows down, engineers adapt in bad ways. They stop asking questions the history could answer. They batch work to avoid sync cost. They keep messy branches alive longer, postpone cleanup, and treat the repository like something slightly dangerous.
From https://gitperf.com/epilogue.html
> Once machines start producing code at machine cadence, the model from this book does not break. What changes is the pace: more branches, more commits, more automation, and more surrounding metadata. The traffic gets louder, and the features that keep Git legible under pressure move from "nice to have" to "essential."
> These stop looking like side optimizations. They are what keep machine-scale Git traffic usable.
redditor98654 an hour ago
I had the same thought. TBH there is nothing in those individual sentences that read like AI but when you read them all together I could see it too. I dunno what it is, only way I can describe it is that it does not sound like a normal human but rather a monologue from a character trying to sound impressive with each successive sentence.
ergl 40 minutes ago
The author works at OpenAI, so it's no surprise that they've stopped noticing how grating this kind of structure is to read.
hmpc 2 hours ago
Similarly, if not performance-focused, I can wholeheartedly recommend Building Git[0], which walks you through building your own git clone in Ruby (although the language is immaterial).
nananana9 4 hours ago
Git is industry standard, because for what it give you it's a remarkably robust and simple program to use. We're all vaguely aware that the internals are complex, but the UX is clean and usable enough that the complexity usually doesn't leak out.
But the day this breaks down and I have to deal with bloom filters, packfiles, maintaining the git garbage collector or rerere cleanup, is the day I switch our codebase to a centralized VCS.
This stuff is cool to learn about; but it's 5 layers removed from anything I want to be thinking about in my day to day work.
codesnik 2 hours ago
i think it is the other way around. Git is pretty simple internally, and its ui is just knobs and levers to reach into that simple reliable internal structure. This is why for some people it seems like a mess - they want button "do what I want" (and all people and their needs are different), and for other people it's clean - open the throttle, engine will rev.
embedding-shape 14 minutes ago
Agree, the insides are fairly simple and cleanly designed, you could explain exactly how almost everything works in a 1 hour presentation, and most people will grok the main ideas fairly easily.
The tooling on top is inconsistent and kind of messy though, and harder to explain than the internals. I recall hearing somewhere that the tooling we see today as the user tooling was really supposed to just be the tooling for messing with git directly, with the expectation that something would sit above and make it actually user-friendly. I don't remember where I recall this from though, so could be just a post-justification from my own brain to explain the situation :)
thfuran 3 hours ago
I'm pretty sure git is industry standard almost entirely entirely because GitHub exists. And I very much disagree that the UX is clean. The cli is more than a bit of a mess.
stingraycharles 3 hours ago
> I'm pretty sure git is industry standard almost entirely entirely because GitHub exists.
Nah, I remember that time vividly, Github became a thing about a year or two after it was already very much taking the lead.
GitHub became GitHub because git was the winner. There were alternative hubs that supported bazaar and mercurial and whatnot, but git won because for most people, Linus and the kernel team being behind it was reason enough to trust it.
(and I say this as someone who liked hg more than git)
embedding-shape 12 minutes ago
BerislavLopac 3 hours ago
Anyone who has ever used Mercurial knows very well what a good versioning tool UX looks like...
liveoneggs 7 minutes ago
windward 2 hours ago
miroljub 3 hours ago
anitil 6 hours ago
I'm only on to chapter two and already it's explained some plumbing details that I somehow have missed all these years. This is great
normie3000 7 hours ago
> LFS adds its own operational overhead.
Seemingly seconds on every remote-touching command, even on a very small repo.
Hendrikto 4 hours ago
What is worse is that for about half a year or so, I now have to authenticate my ed25519-sk key with my Yubikey thrice (!) when using LFS. On every push.
fragmede 2 hours ago
That they didn't go with git annex was such a fit of NIH of a mistake.
Hendrikto an hour ago
Both have their advantages and disadvantages. git-annex is not strictly better, LFS just chose different tradeoffs.
snthpy 9 hours ago
I've been wanting to ask this:
Why isn't
git clone --depth 1 ...
the default?I would guess that for at least 90% of the repos I clone, I just want to install something. Even for the rest, I might hack on the code but seldom look into the history. If I do then I could do a `git fetch` at that point and save the bandwidth and disk space the rest of the time.
joshka 9 hours ago
try `git clone --filter=blob:none` instead
https://github.blog/open-source/git/get-up-to-speed-with-par...
snthpy 3 hours ago
Thanks. That's great! I especially like that it then lazy loads the blobs as you need them.
I was going to ask if there's a way to set that as the default but I guess I'll just set up an alias like I have for most of the subcommands I use daily.
dwattttt 9 hours ago
A question: why is git involved at all in this? You don't want a repository.
skydhash 8 hours ago
This! The default was to have a link to download a tarball of the source. And if the user wanted to contribute (or check the devel version), you would add a link to the vcs.
kingstnap 7 hours ago
eddythompson80 8 hours ago
jurakovic 7 hours ago
What if that's only you? Git isn't made only for those who "just want to install something"
aa-jv 3 hours ago
Its not the default because that'd be counter-productive to developers who use git with larger repositories, which is how git started life in the first place - your clone depth would be entirely useless for Linux kernel developers, for example, if it were default ..
wadefletch 9 hours ago
ted nyman: #1 most knowledgable college football fan in sf
and also git
which makes more sense i guess
mitchellh 8 hours ago
Of most things, really, he was on Jeopardy for a reason! https://thejeopardyfan.com/tag/ted-nyman
aa-jv 3 hours ago
I've always wanted to see a book that describes git for the common man and gives them tons of examples for how to use it to do productive things.
Even for a small office, git can be immensely useful. Entire production line workflows can be implemented with git .. if only folks would learn to use it productively.
Its not just for development. Writers can use it productively. Accountants too.
It always kind of irks me that Git hasn't just been folded into the OS front-end UI by any of the OS vendors .. it'd be so revolutionary to give common folks an easy way to manage the timeline/history of their computer use using git.
awesan 3 hours ago
The obvious reason is that most file formats used by writers, accountants, etc. are binary files which do not very much benefit from git.
fragmede 2 hours ago
Microsoft Office files are zipped XML these days, there's a standard and everything.
aa-jv an hour ago
So? Doesn't matter. Git in that case still provides valuable historical archiving and versioning that is still more useful than the option, without it.
Plus, its chicken and egg. If the OS had a great interface to Git as part of its responsibilities in the Explorer/Finder interface, folks would be more inclined to use text-based file format standards that are coherent with the Git methodology.
ruuda 4 hours ago
The text reads like an LLM was involved in this.