albirrkarim/mozilla-hubs-installation-detailed

Mozilla hubs installation, deploy on self-hosted server, system overview, how to modify, etc

Hi there 👋

My Research

A. Public

- Notes

Sharing my learning checkpoint, experience, recommendation, and approach.

📖 Mozilla Hubs Installation Detailed, Mozilla hubs installation, deploy on self-hosted server, system overview, how to modify, etc

💽 How to Maintenance Server, My personal journal about server maintenance

- NPM Package

⌨️ React Phonetic Transcription, Phonetic transcription tools with react js for input, outputting, etc

B. Sponsor Only

You want access to my research you can become my sponsors.

Send me a message via discord: @albirrkarim

🗣️ React Speech Highlight, React text-to-speech with highlighting the words and sentences that are being spoken using audio files, text-to-speech API, and web speech synthesis API.

⭐ Laravel React Starter Kit PRO, A solid and efficient project foundation for laravel and react full stack development.

React GPT Web Guide (Beta) (Pending), Interactable AI 3D Avatar that has control over your frontend website

🔗 Product Rank Tracker This simple custom program tracks your product ranking in Google, with product link and listed keywords you want to target (watch) no server is required, just with your PC.

Support me

Thanks a lot for your support.

mozilla-hubs-installation-detailed's Issues

jwk file is not creating

I installed mozilla hub on ubunutu 20.03 server
almost done...
but i tried to create the reticulum-jwk.json file , it doesn't works

I executed as follows :
cd /[reticulum root]
iex
iex>Mix.install([{:jose, "~> 1.11"}])
iex>jwk = Application.get_env(:ret, Ret.PermsToken)[:perms_key] |> JOSE.JWK.from_pem(); JOSE.JWK.to_file("reticulum-jwk.json", jwk)
** (FunctionClauseError) no function clause matching in :jose_jwk.from_pem/1

The following arguments were given to :jose_jwk.from_pem/1:

    # 1
    nil

(jose 1.11.2) src/jwk/jose_jwk.erl:443: :jose_jwk.from_pem/1
(jose 1.11.2) lib/jose/jwk.ex:186: JOSE.JWK.from_pem/1

as shown as, the error is appear and i can't create the file.

*I tried to use the "reticulum-jwk.json" file from hubs-repo/ansible/
but the file dosen't works

it is first time to use postgrest so I don't know corrently
but I guess postgrest daemon is important to create jwt token

How to install and public (not local) in ubuntu server?

"could not compile dependency :dns" error when running `mix ecto.create`

Environment

OS: Ubuntu 22.04
Erlang version: 23.3 installed via asdf (only possible thanks to this workaround asdf-vm/asdf-erlang#247 (comment))
Elixir version: 1.14.3-otp-23 installed also via asdf

Steps to reproduce

Inside the reticulum repository
mix deps.get
mix ecto.create

Expected Outcome

That it works.

Actual outcome

could not compile dependency :dns error

Things I tried to resolve this issue

• googling the issue, I didn't find anything, there are other people having this type of error but never with this specific library or project
• looking at the closed issues in this repository, there are two similar issues #24 #18, I tried their fixes, they didn't work for me (still got the same error message both times)

Any idea why this is happening?

Bad Gateway

Hi albirrkarim, thank you for your documentation! excuse me, have you found the problem about hub admin 502

System Overview Image Contribution?

Very helpful to have the system architecture visualized. https://github.com/albirrkarim/mozilla-hubs-installation-detailed/blob/main/docs_img/System_Overview.png

Would you be willing to contribute the image to the docs? https://hubs.mozilla.com/docs/system-overview.html? I will ask for a review from the Hubs engineering team if you do. Thank you!

Error while running reticulum on iMac with command iex -S mix phx.server

Hi

Thanks for giving this tutorial to set up the hub on localhost.

I have followed all steps from the tutorial up to Step 3 and all steps are working as fine

When I tried Step 4. running
Then it gives me an error

Please check it below

== Compilation error in file lib/ret/schema.ex ==
** (CompileError) lib/ret/schema.ex:39: call to local macro is_struct/1 conflicts with imported Kernel.is_struct/1, please rename the local macro or remove the conflicting import
(elixir 1.14.2) expanding macro: Kernel.and/2
lib/ret/schema.ex:39: Ret.Schema.is_schema/1
(elixir 1.14.2) expanding macro: Kernel.and/2
lib/ret/schema.ex:40: Ret.Schema.is_schema/1
(elixir 1.14.2) expanding macro: Kernel.Utils.defguard/2
lib/ret/schema.ex: Ret.Schema.is_schema/1
Please check the screenshots:

Installed the version of elixir and erlang per your suggestion
% asdf current
elixir 1.14.2 /Users/iMac/Documents/Work/Hub/reticulum/.tool-versions
erlang 25.1.2 /Users/iMac/Documents/Work/Hub/reticulum/.tool-versions

Any help would be appreciated.

I dont know what it is "scene_listings"

This is now issue, just explanation for figma file.

Hub table have two columns (scene_id and scene_listing_id). If you have scene_listing_id=null and filled scene_id, when you update project via Spoke and publish scene, hub will get alst version of them. But if you approve scene for hub via Admin panel (and scene_listing_id filled), hub will use only specified version of this scene. Thus you have the opportunity to use one project and many scene versions for different rooms (hubs).

Error: JsonWebTokenError: invalid signature

Hi

First Thanks for giving this tutorial And Its working fine.

After Setup it, I am facing error when I am trying to create room.

Please check screenshot:

I have updated the Ret.PermsToken in reticulum/config/prod.exs

config :ret, Ret.PermsToken,
  # This config value is for local development only.
  perms_key:
"-----BEGIN PRIVATE KEY-----\nMIIEvg***********************TjuAsTj\n-----END PRIVATE KEY-----"

Still facing same issue.

Thanks

extra settings are required

Hi,
I tried to install the hubs project on the self-hosted project.
Almost done, but could not see the landing page of hubs, hubs_admin, and spoke projects.
I think you probably modified /etc/hosts file regarding your new domain.
Let me know if you did that, then how?
Thanks.

could not compile dependency :ecto,

Hello, it appears when I am running iex - S mix phx.server “could not compile dependency :ecto, "mix compile" failed. Errors may have been logged above. You can recompile this dependency with "mix deps.compile ecto --force", update it with "mix deps.update ecto" or clean it with "mix deps.clean ecto"” Where is the problem with this situation？

address not available

Hi albirrkarim,
According to your process, hubs can be started normally, but hub admin and spoke cannot be started. The following error is reported

node:events:504

throw er; // Unhandled 'error' event

^

error: listen EADDRNOTAVAIL: address not available ******:8989

at Server. setupListenHandle [as _listen2] (node:net:1313:21)

at listenInCluster (node:net:1378:12)

at GetAddrInfoReqWrap. doListen [as callback] (node:net:1516:7)

at GetAddrInfoReqWrap. onlookup [as oncomplete] (node:dns:73:8)

Emitted 'error' event on Server instance at:

at emitErrorNT (node:net:1357:8)

at processTicksAndRejections (node:internal/process/task_queues:83:21) {

code: 'EADDRNOTAVAIL',

errno: -99,

syscall: 'listen',

address: '********',

port: 8989

}

I don't know about the front end. Did you encounter this problem during deployment? Please help me have a look

Don't you need to mention webpack as a dependency?

admin hubs

help me hubs admin npm run local server setting error link bad not fount

failed to start child: Phoenix.PubSub.PG2Server

https://gist.github.com/DillFrescott/80876b759d9db60a7f9a36854dc38315

room is not connectable try tcp also cannot connect

npm ci stop(emojione)

hello.

Thanks for making the mozilla hubs installation tutorial.
I ran into a problem during installation following your guide.
I've searched and searched for the cause, but I can't find a solution.
I want to get help.

1.4 Hubs
Clone and install dependencies in progress
npm ci hangs while running.
No matter how many times I try, the same emojione freezes.

I attach a screenshot below.

After npm ci failed, I tried npm install , but it still fails. in the same section.

The failure section is attached to the screenshot above.

I am using WSL2 on Windows 10 operating system.
I am using Ubuntu 20.04.4 LTS version.

Nodejs version is 10.19.0.
elixir version is 1.12.3-otp-23 .
erlang version is 23.2.1 .

Everything else was installed according to the procedure you gave.

Any help would be appreciated.
have a good day.

hubs.link proxy doesn't work

How can we fix the shortlinks in NGINX? I have already set up SSL for the shortlink and got it connecting to the same server that hosts the hubs domain. My issue is I am having problems writing the nginx rule that redirects the shortlink to fulldomain.com/link/xyz

According to what I know I tried this but its not giving the expected results.

server { server_name short.link location / { return 301 https://fulldomain.com/link/$1; } ... }

Would appreciate any help on this issue.

Thanks

Can't find HTML documents when visiting port 4000

I followed all the steps by the tutorial (with a little difference), I still got 503 returns when I visit by port 4000 and it shows like:
Missing file index.html. Please try again.

The difference is, I set up the server in a virtual Linux server which means it's not running locally, and I kept using host as "hubs.local" for the server's IP address. I visited it by Firefox on Windows, accepted the risk to continue. Can the reason be from those? Or maybe something else?

Is the admin menu working at your place?

Hi, albirrkarim.
Thanks to your documentation, some issues have been resolved and paved the way.
I am very grateful to you. by the way,...
Is the admin menu working at your place?
I can't import scenes and avatars.
The other menu says "server communication error", is this the same for you?

Thank you as always.

How to set default user

I deployed hubs in local ,but I don't know how to set email to login hubs.

Images not loaded in your repo

Please check screenshot:

Error with mix ecto.create

I get below error while running "mix ecto.create"

== Compilation error in file lib/ex_rated.ex == ** (KeyError) key :vars not found in: #Macro.Env<aliases: [], context: nil, context_modules: [ExRated], file: "/Users/test2/Documents/SampleApps/reticulum/deps/ex_rated/lib/ex_rated.ex", function: {:delete_bucket, 2}, functions: [{Kernel, [!=: 2, !==: 2, *: 2, **: 2, +: 1, +: 2, ++: 2, -: 1, -: 2, --: 2, /: 2, <: 2, <=: 2, ==: 2, ===: 2, =~: 2, >: 2, >=: 2, abs: 1, apply: 2, apply: 3, binary_part: 3, binary_slice: 2, binary_slice: 3, bit_size: 1, byte_size: 1, ceil: 1, div: 2, elem: 2, exit: 1, floor: 1, function_exported?: 3, get_and_update_in: 3, get_in: 2, hd: 1, inspect: 1, inspect: 2, is_atom: 1, is_binary: 1, is_bitstring: 1, is_boolean: 1, ...]}], lexical_tracker: #PID<0.247.0>, line: 243, macro_aliases: [], macros: [{Ex2ms, [fun: 1]}, {Kernel, [!: 1, &&: 2, ..: 0, ..: 2, ..//: 3, <>: 2, @: 1, alias!: 1, and: 2, binding: 0, binding: 1, dbg: 0, dbg: 1, dbg: 2, def: 1, def: 2, defdelegate: 2, defexception: 1, defguard: 1, defguardp: 1, defimpl: 2, defimpl: 3, defmacro: 1, defmacro: 2, defmacrop: 1, defmacrop: 2, defmodule: 2, defoverridable: 1, defp: 1, defp: 2, defprotocol: 2, defstruct: 1, destructure: 2, get_and_update_in: 2, if: 2, in: 2, ...]}], module: ExRated, requires: [Application, Ex2ms, GenServer, Kernel, Kernel.Typespec], ...> (ex2ms 1.6.0) lib/ex2ms.ex:213: Ex2ms.translate_param/2 (ex2ms 1.6.0) lib/ex2ms.ex:184: Ex2ms.translate_head/2 (ex2ms 1.6.0) lib/ex2ms.ex:116: Ex2ms.translate_clause/2 (elixir 1.14.2) lib/enum.ex:1658: Enum."-map/2-lists^map/1-0-"/2 (ex2ms 1.6.0) expanding macro: Ex2ms.fun/1 lib/ex_rated.ex:243: ExRated.delete_bucket/2 could not compile dependency :ex_rated, "mix compile" failed. Errors may have been logged above. You can recompile this dependency with "mix deps.compile ex_rated", update it with "mix deps.update ex_rated" or clean it with "mix deps.clean ex_rated"
Installed the version of elixir and erlang per your suggestion
elixir 1.12.3 /Users/test2/Documents/SampleApps/reticulum/.tool-versions
erlang 23.3 /Users/test2/Documents/SampleApps/reticulum/.tool-versions

Any help would be appreciated.

Unable to connect to this room, please try again later.

Hello,
When I visit localhost: 4000, click create room to display
Unable to connect to this room, please try again later.
You can try connecting via TCP, which may work better on some networks.

You can also create a new room.
Can you help me see why?

Issues installing erlang 23.0

It gives me this:

root@b2a42bf9535c:/# asdf install erlang 23.0
asdf_23.0 is not a kerl-managed Erlang/OTP installation
The asdf_23.0 build has been deleted
Extracting source code
Building Erlang/OTP 23.0 (asdf_23.0), please wait...
APPLICATIONS DISABLED (See: /root/.asdf/plugins/erlang/kerl-home/builds/asdf_23.0/otp_build_23.0.log)

• jinterface : No Java compiler found
• odbc : ODBC library - link check failed

APPLICATIONS INFORMATION (See: /root/.asdf/plugins/erlang/kerl-home/builds/asdf_23.0/otp_build_23.0.log)

• wx : No OpenGL headers found, wx will NOT be usable
• No GLU headers (glu.h) found, wx will NOT be usable
• wxWidgets not found, wx will NOT be usable

DOCUMENTATION INFORMATION (See: /root/.asdf/plugins/erlang/kerl-home/builds/asdf_23.0/otp_build_23.0.log)

• documentation :

•              xsltproc is missing.
  

•              fop is missing.
  

•              xmllint is missing.
  

•              The documentation cannot be built.
  

Build failed.
cc1: some warnings being treated as errors
gmake[4]: *** [x86_64-unknown-linux-gnu/Makefile:171: ../priv/obj/x86_64-unknown-linux-gnu/pkey.o] Error 1
gmake[4]: Leaving directory '/root/.asdf/plugins/erlang/kerl-home/builds/asdf_23.0/otp_src_23.0/lib/crypto/c_src'
gmake[3]: *** [/root/.asdf/plugins/erlang/kerl-home/builds/asdf_23.0/otp_src_23.0/make/run_make.mk:35: opt] Error 2
gmake[3]: Leaving directory '/root/.asdf/plugins/erlang/kerl-home/builds/asdf_23.0/otp_src_23.0/lib/crypto/c_src'
gmake[2]: *** [/root/.asdf/plugins/erlang/kerl-home/builds/asdf_23.0/otp_src_23.0/make/otp_subdir.mk:29: opt] Error 2
gmake[2]: Leaving directory '/root/.asdf/plugins/erlang/kerl-home/builds/asdf_23.0/otp_src_23.0/lib/crypto'
gmake[1]: *** [/root/.asdf/plugins/erlang/kerl-home/builds/asdf_23.0/otp_src_23.0/make/otp_subdir.mk:29: opt] Error 2
gmake[1]: Leaving directory '/root/.asdf/plugins/erlang/kerl-home/builds/asdf_23.0/otp_src_23.0/lib'
gmake: *** [Makefile:504: libs] Error 2

Please see /root/.asdf/plugins/erlang/kerl-home/builds/asdf_23.0/otp_build_23.0.log for full details.
root@b2a42bf9535c:/#

Error running mix ecto.create

root@e9983a04e5a0:/reticulum# mix ecto.create

20:00:07.329 [error] GenServer #PID<0.455.0> terminating
** (RuntimeError) connect raised UndefinedFunctionError exception. The exception details are hidden, as they may contain sensitive data such as database credentials. You may set :show_sensitive_data_on_connection_error to true when starting your connection if you wish to see all of the details
(crypto 5.0.5) :crypto.hmac/3
(postgrex 0.15.3) lib/postgrex/scram.ex:52: Postgrex.SCRAM.hash_password/6
(postgrex 0.15.3) lib/postgrex/scram.ex:26: Postgrex.SCRAM.verify/2
(postgrex 0.15.3) lib/postgrex/protocol.ex:734: Postgrex.Protocol.auth_cont/4
(postgrex 0.15.3) lib/postgrex/protocol.ex:579: Postgrex.Protocol.handshake/2
(db_connection 2.2.1) lib/db_connection/connection.ex:69: DBConnection.Connection.connect/2
(connection 1.0.4) lib/connection.ex:622: Connection.enter_connect/5
(stdlib 3.17) proc_lib.erl:226: :proc_lib.init_p_do_apply/3
Last message: nil
State: Postgrex.Protocol
** (Mix) The database for Ret.Repo couldn't be created: killed
root@e9983a04e5a0:/reticulum#

I checked to make sure the database is up and listening and checked the dev.exs file and everything is correct.

Run dialog Failed..

4.2 Run dialog is in progress.

When I type 'npm run start', the error message of the screenshot is displayed and it stops. May I know the cause or solution?

Please help.
have a good day.

Missing translation for key: "JWSError JWSInvalidSignature"

Hi

Thanks for giving this tutorial first and it is best for beginner developer.

I've almost got it setup on a self hosted server with ubuntu 20.04.

After setup this, I am facing only one error when I am trying to access admin menu in backend

spoke, hub frontend and everything else is working fine

Please check screenshot:

That is Missing translation for key: "JWSError JWSInvalidSignature".

I have followed you tutorial all steps.

I am trying to fix this from last 3 days and still I can't solve it as I am a beginner developer.

Can someone help me to tell what is missing in the setup of mozilla hub.

Thanks

TLS server: In state connection received CLIENT ALERT: Fatal - Bad Certificate

Hello,

Firstly, I want to say this repo is very good. Thank u very much.

And I met one problem as below:

When I follow below instructions, there will be one error:
"
run command mix phx.gen.cert it will generate key selfsigned_key.pem and certificate selfsigned.pem
rename selfsigned_key.pem to key.pem
rename selfsigned.pem to cert.pem
in reticulum directory move that two file into priv/ folder
"
All other steps I have executed normally,
But when I run "iex -S mix phx.server", there will be error in the console:

iex(1)> [info] TLS server: In state connection received CLIENT ALERT: Fatal - Bad Certificate

Then, when I changed key.pem and cert.pem back to the original dev-ssl.key and dev-ssl.cert, there will not appear the error, and the Reticulum server will run normally.

Do you have the problem? And could you pls help to figure out how to solve the problem?

Thanks.

Failed to load resource: the server responded with a status of 503 ()

Hi albirrkarim, We have set up hubs, dialog, spoke and reticulum locally successfully but when access https://localhost:4000/ then facing missing file schema.toml file on browser console

and before this 503 error we are getting this one

Please Look into this and Thank you.

Missing file admin.html Error

hello.

Thanks to your tutorial, Dialog, Reticulum, Hubs(+admin), and Spoke were successfully running.
However, when I tried to test by connecting to localhost, the following message appeared.

And Reticulum keeps getting this error message, I don't know the cause. The error message is as below. Red text appears repeatedly.

I'd like to get help with a solution.

First of all, I am using Windows 10+WSL2+Ubuntu20.04 based.

And version information.
elixir : 1.12.3-otp-23
erlang : 23.2.1
nodejs : 16.16.0
npm : 8.14.0

thank you have a good day!
I am always grateful to you for making tutorials.

Can not install Erlang 23.0

How are you?
I tried to install erlang 23.0
But I am getting this error when I run asdf install erlang 23.0

The asdf_23.0 build has been deleted
Extracting source code
Building Erlang/OTP 23.0 (asdf_23.0), please wait...
WARNING: It appears that a required development package 'libncurses5-dev' is not installed.
Build failed.
./configure: 353: kill: No such process

Makefile:1229: warning: overriding recipe for target 'dialyzer'
Makefile:516: warning: ignoring old recipe for target 'dialyzer'
Makefile:474: /home/ploi/.asdf/plugins/erlang/kerl-home/builds/asdf_23.0/otp_src_23.0/make/x86_64-unknown-linux-gnu/otp.mk: No such file or directory
make: *** No rule to make target '/home/ploi/.asdf/plugins/erlang/kerl-home/builds/asdf_23.0/otp_src_23.0/make/x86_64-unknown-linux-gnu/otp.mk'.  Stop.
Makefile:1229: warning: overriding recipe for target 'dialyzer'
Makefile:516: warning: ignoring old recipe for target 'dialyzer'
Makefile:474: /home/ploi/.asdf/plugins/erlang/kerl-home/builds/asdf_23.0/otp_src_23.0/make/x86_64-unknown-linux-gnu/otp.mk: No such file or directory
make: *** No rule to make target '/home/ploi/.asdf/plugins/erlang/kerl-home/builds/asdf_23.0/otp_src_23.0/make/x86_64-unknown-linux-gnu/otp.mk'.  Stop.

Please see /home/ploi/.asdf/plugins/erlang/kerl-home/builds/asdf_23.0/otp_build_23.0.log for full details.

How can I solve this?
Thank you.

Unable to create a room, WebSocket connection failed

Hi albirrkarim,When someone clicks "Create Room", after few seconds an error appears saying "Unable to create a room, please try again later".

Do you have this problem?