Julia 1.5 libc.musl, could not load libRmath-julia.so

[juliastats]

Julia 1.5 libc.musl, could not load libRmath-julia.so

[ViralBShah]

@giordano is usually the one most familiar with this sort of thing. I am sure this is an Rmath_jll issue.

We stopped shipping libRmath a long time ago as part of Julia. So you have to look for it in .julia/artifacts, IIRC.

[ViralBShah]

Triggering a new build on Yggdrasil - since it is possible the jll was just too old and last built in Nov. The platform list is still the same, but let's see if the new build resolves the issue.

[dehann]

Hi Viral, thanks -- thought I should post since 1.5 is in beta and could maybe help avoid bigger issues later. I tried again here and see that Rmath_jll moved up from v0.2.2+0 to v0.2.2+1, however, the same error message remains unfortunately:

(@1.5) pkg> add Rmath
(@1.5) pkg> build Rmath
(@1.5) pkg> test Rmath

ERROR: LoadError: InitError: could not load library "libRmath-julia.so"
Error loading shared library libRmath-julia.so: No such file or directory
Stacktrace:
 [1] __init__() at /home/dehann/.julia/packages/Rmath/lo1Ao/src/Rmath.jl:37
 [2] _include_from_serialized at ./loading.jl:697
 [3] _require_from_serialized at ./loading.jl:749
 [4] _require at ./loading.jl:1040
 [5] require at ./loading.jl:928
 [6] require at ./loading.jl:923
 [7] include at ./client.jl:457
 [8] top-level scope at none:6
during initialization of module Rmath
in expression starting at /home/dehann/.julia/packages/Rmath/lo1Ao/test/runtests.jl:1
ERROR: Package Rmath errored during testing

I'm not directly using Rmath, but some of the dependencies higher up do which is how I happened upon the issue. I'll try and see if I can learn more and will post if I find anything useful. For example the same error is happening with Gadfly.jl:

(@1.5) pkg> add Gadfly
(@1.5) pkg> test Gadfly

...

ERROR: LoadError: LoadError: InitError: could not load library "libRmath-julia.so"
Error loading shared library libRmath-julia.so: No such file or directory
...

[giordano]

We may have problems with loading some libraries with Musl in general, I can reproduce this issue also with other libraries, but not all of them.

[giordano]

I opened in issue in Julia: JuliaLang/julia#36458 TLDR: when ccalling a function, Julia can't find the library even if it's already open.

[dehann]

Oh great, thanks!

[jpsamaroo]

This is still an issue even on Julia master, where the ccall issue was fixed. It seems like these calls are the culprit:

Rmath.jl/src/Rmath.jl

Lines 37 to 42 in aa1388f

	unsafe_store!(cglobal((:unif_rand_ptr,libRmath),Ptr{Cvoid}),
	@cfunction(rand,Float64,()))
	unsafe_store!(cglobal((:norm_rand_ptr,libRmath),Ptr{Cvoid}),
	@cfunction(randn,Float64,()))
	unsafe_store!(cglobal((:exp_rand_ptr,libRmath),Ptr{Cvoid}),
	@cfunction(Random.randexp,Float64,()))

I'll investigate to see if it can be trivially fixed.

[jpsamaroo]

Rmath_jll probably just needs a new Yggdrasil build to use the changes to JLLWrappers. @giordano or @ViralBShah would one of you be able to do this?

[jpsamaroo]

Confirmed, I can fix this and pass tests by changing all references to Rmath_jll.libRmath to Rmath_jll.libRmath_path (which is non-const).

[ViralBShah]

JuliaPackaging/Yggdrasil#2069