Race conditions

[simonbyrne]

The race conditions with precompile (JuliaLang/julia#17320) are a real pain when working with multiple processes. Other package operations (such as build) can also trigger race conditions, e.g. when working on a cluster with a shared file system.

Mutating global state is a difficult problem, so I'm not sure what the best solution is. One option is to do file locking at the depot level: this would require adding something like Pidfile.jl as a stdlib (JuliaLang/julia#7176).

[simonbyrne]

Another related issue to precompilation is JuliaLang/julia#30174

[simonbyrne]

Precompile was fixed by #36416. Pkg.build still has race conditions, but is less of an issue now that fewer packages make use of it.

[IanButterworth]

This is fixed for precompilation on master by #3519 and due to be in v1.10