Jaccard similarity is not particularly good for "celebrity" projects.

They are similar because they are popular, not because there is semantic relationship.

It's the same problem I faced with the map of reddit (https://anvaka.github.io/map-of-reddit/ ) - all popular subreddits are just "similar" to each other.

Stil works great for smaller, non-celebrity projects :D

I wonder if code embeddings might have been a better way to organize the projects, although probably infeasible given the amount of resources required to download and compute embeddings for each file.

Perhaps the same reason heat maps are often really the underlining population map https://xkcd.com/1138/

Because of react ?

Yeah, this should be the link - not the repo.

The funniest one I saw was "Lispaña"

I'm also shocked how small "nodelandia" is and that its not even its own continent. I guess we all overestimate the size of our bubbles

I can see many osdev Rust projects in "PlusPlus Nation" near other kernels, which mean that "X but in Rust" might be in "X" instead of "RustLand".

The data is a from March 2023 according to OP so a lot of the more recent rust projects just won't be included yet.

Happy to see bevy between them though! :)

Not that surprised. Rust is known for being evangelized by a very loud minority.

Also, lol at Zig being a suburb of Rust

or start with one project and find your way to another, you can imagine there are shipping lines :)

love it =)!

There's a JuliaLand to the west of the island where julialang/julia is.

The fact that julialang/julia ended up near tensorflow and opencv, and actual Julia packages ended up elsewhere, probably reflects a difference between aspirational users and real users: a lot of people who starred the Julia project itself were numeric Python users who were looking for a new Python, but then mostly stuck to Python itself, so their other stars are in the numeric Python land. Those who starred the JuliaLand packages are the actual Julia users who aptly enough ended up near Moleculandia and AstroSpace and Quantumia.

I was pleasantly surprised that it wasn’t a heavy line drawing creation. As someone who first did those in the 90’s and almost immediately learned their limits, I think this is nice because it doesn’t overclaim. It’s just a view, not a thesis.

I like diagrams where the axes mean something. Lines, shape, boxes/groups, distance, X vs Y, colour, thickness, texture, background, foreground. I also like simple. So often it’s lines to be fancy with no meaning. This one is just a pic, with some grouping, and it has personality. Yay?

(Still love lines, just not everywhere always.)

I couldn't find a universal clustering algorithm yet: Frequently there is more than one way to group data that still makes sense, and as a result whichever final clustering option we choose - it will not be perfect.

Hm... unless maybe we do some sort of quantum clustering, which could be a fun project to explore!

It's a bit hazy now, but I remember trying hdbscan algorithm (hierarchical clustering), and on the graph of the GitHub size - I just couldn't fit it in memory.

I did end up using something similar to hierarchical clustering (mix of louvain/leiden/my own), and that's what we see in the final map.

They could have done that, but they decided to do a map

haha! I love vim.

We shall not quit.

Clearly crypto should be a sinking ship with people swimming to the shores of other places in this metaphor

It would make sense that there's an overlap between crypto fans and a certain subset of AI fans.

The author answered that question in the original HN post: https://news.ycombinator.com/item?id=35933981

Basically what others are guessing, lines represent the highest similarity scores based on "stargazers", which also forms the entire map. To anyone confused, the lines only appear once you click into a specific country.

In the first line: "Dots are close to each other if they have a lot of common stargazers."

Jaccard similarity returns a value between 0 and 1 (in this case the vast majority of the values being close to 0). I suspect there's a hard-coded threshold value to determine an edge, e.g. if Jaccard similarity between A and B is > 0.2, create an edge.

Thank you for your kind words!

That link you've shared - doesn't open for some reason

Despite HTMX being backend-agnostic, I heard it pairs extremely well with Django, so that's probably why! Maybe the two are particularly well fitting pieces of the web dev puzzle.

If you develop on Linux you generally probably don't star linux/kernel. But you do star other projects developing on Linux.

Ditto if you develop Django, you star Python libraries, not Django downstream plugins.

It's similar to how SpringBootia is almost as big as Javaland, but Spring Boot itself is in Javaland and not it's "homeland"

Thank you =)

Javascript made the barrier to entry for creating a package nearly zero. In contrast, it's fairly difficult to publish something on Maven Central (the main Java repository). You need to prove you own a domain, setup a GPG key for signing, manually register with Sonatype, which is more than many people are willing to do. I think that explains it much better.

The stale old enterprise code is not in public repositories.

The star data from the first phase.

Thank you!

I tried quite a few various similarity metrics, and Jaccard was giving me the best results. This is all very subjective, of course.

haha thank you!

Fortran has been given new life

https://arxiv.org/search/?query=fortran&searchtype=all&sourc...

https://github.com/search?q=fortran+language%3AFortran+neura...

I don't think anyone has ever seriously suggested PHP is dead. People may want it to be dead, but it's probably still the most-used language on the web!

Sorry, not sorry—PHP is alive, and thriving! The language runtime is getting ever faster, the packagist ecosystem in combination with composer (PHP's package manager) are rock-solid, there are event loops and application servers by now, serverless deployments are the default operation mode, and with Laravel or Symfony, there are trusted and extremely versatile frameworks available that do stuff out of the box that require lots of manual efforts with other languages.

Add to that the support for type annotations that can go all the way from fully untyped and dynamic, to runtime-enforced primitive constraints and object types, and you'll end up with a very good choice for web applications that evolve quickly.