GHE - Hubble implementation, not able to view dashboard

[gunjvm]

GHE - Hubble implementation, not able to view dashboard

[mzzmjd]

Did you follow step 5 with the correct URL:

Open docs/_config.yml in your editor and set the dataURL that you noted earlier. Commit and push the change to your Hubble repository:
git add docs/_config.yml
git commit -m "Adjusting dataURL to our own instance"
git push

So that your Hubble Dashboard points to your Hubble data pages site?

[mzzmjd]

If you go to https://fusiongithub.devfg.rbc.com/stafftools/repositories/cm/hubble-data/pages does it show recent page builds and whether they are successful?

Can you also check https://fusiongithub.devfg.rbc.com/stafftools/repositories/cm/hubble/pages ?

[gunjvm]

Hi team, as soon as i clicked on rebuild, it took a lot of time to load and now my dev instance went down :(
Its giving the angry unicorn icon!
I rebooted the vm too, it took half hour to restart, however still same unicorn.
In backend we see error no memory left to allocate

[pluehne]

@gunjvm: Sounds like your GitHub Enterprise development instance doesn’t have enough resources allocated to it. You may need to assign more resources to it in order to have GitHub running along with all the services (such as GitHub Pages). In case this doesn’t help, I would contact GitHub Enterprise support to find out what’s going on. GitHub Pages is a standard GitHub service that should run without problems regardless of whether or not Hubble is installed.

[gunjvm]

Thanks a lot everyone, my issue is resolved.
We upgraded the github dev instance to v2.17 and it required more memory as compared to 2.15 and hence it crashed.
After the memory uplift and hubble re-initiation it works fine now.

[pluehne]

Did you publish the hubble-data repository through GitHub Pages as explained in step 2 of the Getting Started section? If not, please do so. If hubble-data is correctly published, could you go to the Hubble dashboard with the web developer console open (Firefox or Chromium-based browsers)? In the network tab, you should see requests being made for .tsv files. Could you check what kind of error your browser reports for these .tsv files? See the following screenshot in case it’s not clear what I mean:

[gunjvm]

Appreciate the quick reply.
Yes i did publish the page from master branch as mentioned in 2nd step.

however the published page shows blank data

from the network tab it gives 404 page not found :(

[gunjvm]

from logs -

journalctl -fu hubble-enterprise.service
-- Logs begin at Mon 2018-07-09 17:19:52 UTC. --
May 29 03:52:28 fusiongithub-devfg-rbc-com python3[13078]: Started update of git-versions-new.tsv
May 29 03:52:28 fusiongithub-devfg-rbc-com python3[13078]: gzip: /var/log/haproxy.log.1*.gz: No such file or directory
May 29 03:52:28 fusiongithub-devfg-rbc-com python3[13078]: Finished update of git-versions-new.tsv (runtime: 0.018 s)
May 29 03:52:28 fusiongithub-devfg-rbc-com python3[13078]: Started update of organization-activity.tsv
May 29 03:52:28 fusiongithub-devfg-rbc-com sudo[13487]: admin : TTY=unknown ; PWD=/opt/autodesk/hubble-enterprise ; USER=git ; COMMAND=/usr/local/bin/ghe-dbconsole -y
May 29 03:52:28 fusiongithub-devfg-rbc-com python3[13078]: mysql: [Warning] Using a password on the command line interface can be insecure.
May 29 03:52:28 fusiongithub-devfg-rbc-com python3[13078]: mysql: [Warning] Using a password on the command line interface can be insecure.
May 29 03:52:28 fusiongithub-devfg-rbc-com python3[13078]: Finished update of organization-activity.tsv (runtime: 0.825 s)
May 29 03:52:28 fusiongithub-devfg-rbc-com python3[13078]: Started update of org-collaboration.tsv
May 29 03:52:28 fusiongithub-devfg-rbc-com sudo[13525]: admin : TTY=unknown ; PWD=/opt/autodesk/hubble-enterprise ; USER=git ; COMMAND=/usr/local/bin/ghe-dbconsole -y
May 29 03:52:29 fusiongithub-devfg-rbc-com python3[13078]: mysql: [Warning] Using a password on the command line interface can be insecure.
May 29 03:52:29 fusiongithub-devfg-rbc-com sudo[13665]: admin : TTY=unknown ; PWD=/opt/autodesk/hubble-enterprise ; USER=git ; COMMAND=/usr/local/bin/ghe-dbconsole -y
May 29 03:52:30 fusiongithub-devfg-rbc-com python3[13078]: mysql: [Warning] Using a password on the command line interface can be insecure.
May 29 03:52:30 fusiongithub-devfg-rbc-com sudo[13765]: admin : TTY=unknown ; PWD=/opt/autodesk/hubble-enterprise ; USER=git ; COMMAND=/usr/local/bin/ghe-dbconsole -y
May 29 03:52:31 fusiongithub-devfg-rbc-com python3[13078]: mysql: [Warning] Using a password on the command line interface can be insecure.
May 29 03:52:31 fusiongithub-devfg-rbc-com python3[13078]: mysql: [Warning] Using a password on the command line interface can be insecure.
May 29 03:52:31 fusiongithub-devfg-rbc-com python3[13078]: Finished update of org-collaboration.tsv (runtime: 2.681 s)
May 29 03:52:31 fusiongithub-devfg-rbc-com python3[13078]: Started update of org-owners.tsv
May 29 03:52:31 fusiongithub-devfg-rbc-com sudo[13861]: admin : TTY=unknown ; PWD=/opt/autodesk/hubble-enterprise ; USER=git ; COMMAND=/bin/bash -c cd /data/github/current && . .app-config/production.sh && bin/runner -e production '
puts "organization owner(s)
"
User.where(:type => "Organization")
.where(" login NOT LIKE "github-enterprise" ")
.order("login")
.each do |org|
owners = org.admins.where(:disabled => false, :suspended_at => nil, :gh_role => nil)
.where("")
.order("login")
.join(",")
puts "#{org.login} #{owners}

[gunjvm]

yes step 5 is also done as mentioned

[gunjvm]

how does it show recent page builds, not very much sure :(
please find screenshote below -

[gunjvm]

Is it possible to schedule a screenshare wherein i can show my configuration if possible...

[mzzmjd]

Every time that a commit is made to the pages site repository (in particular hubble-data) it should trigger a build of the pages site.

Now obviously it has not built since 03 April 2019 (presumably when it was set up), so the data files are not shown on the hubble-data pages so hubble cannot pick up the data.

As a short term fix, can you click on the Rebuild button in both the pages at
https://fusiongithub.devfg.rbc.com/stafftools/repositories/cm/hubble-data/pages
https://fusiongithub.devfg.rbc.com/stafftools/repositories/cm/hubble/pages

Be interesting to see if you get an error message.
https://help.github.com/en/enterprise/2.17/user/articles/troubleshooting-github-pages-builds

[larsxschneider]

@pluehne your assumption was correct. A hardware upgrade fixed the issue.