filecoin-shipyard / 2019-filecoin-network-stats Goto Github PK
View Code? Open in Web Editor NEW(Deprecated) Dashboard by Kyokan for tracking network state of go-filecoin devnets in 2019.
License: Other
(Deprecated) Dashboard by Kyokan for tracking network state of go-filecoin devnets in 2019.
License: Other
This is a placeholder issue for necessary updates due to changes to block datastructure in filecoin-project/venus#3185.
I am not sure if it is wrong with my configuration.
I did it according to the READM.md
go-filecoin config heartbeat.nickname '"Pizzanode"'
go-filecoin config heartbeat.beatTarget "/dns4/<your-backend-domain-name>/tcp/8080/ipfs/<your-peer-id>"
i replace the <your-backend-domain-name>
to 127.0.0.1
and replace the <your-peer-id>
to the Peer ID of the FULL_NODE
.
Well, i got an error in go-filecoin deamon
after configured the heartbeat.beatTarget
11:24:07.005 DEBUG metrics: Heartbeat service failed to connect for 16m49.995175956s: protocol not supported heartbeat.go:148
11:24:17.004 DEBUG metrics: Heartbeat service attempting to connect, targetAddress: /dns4/127.0.0.1/tcp/8080/ipfs/QmbUAMCS9bknw5tG4BTpDRsGxFSnvbCqgA6uo8Hvx1wcHc heartbeat.go:213
11:24:17.005 DEBUG metrics: failed to open stream, peerID: <peer.ID Qm*x1wcHc>, targetAddr: /dns4/127.0.0.1/tcp/8080 protocol not supported heartbeat.
here is my .env
export DB_URL=postgresql://test:test111@localhost:5432
export FULL_NODE_URL=http://127.0.0.1:3453
export IS_MASTER=true
export PEER_INFO_FILE=./peerId.json
export HEARTBEAT_PORT=8080
export API_PORT=8081
export LOG_LEVEL=silly
Just an FYI - from a fresh checkout I was getting the compile error below because there are 2 conflicting declarations of declare var process
, one from node_modules/@types/node
and one from frontend/types/index.d.ts
.
Commented out the one in node_modules/@types/node/globals.d.ts
and the error goes away. Compiles fine now.
Failed to compile.
[at-loader] ./node_modules/@types/node/globals.d.ts:162:13
TS2403: Subsequent variable declarations must have the same type. Variable 'process' must be of type '{ env: { BACKEND_URL: string; SENTRY_DSN?: string; GA_TRACKING_ID?: string; }; }', but here has type 'Process'.
> npm ls @types/node
filecoin-network-stats/frontend
└─┬ [email protected]
└─┬ [email protected]
└─┬ @types/[email protected]
└── @types/[email protected]
well, i ran the command
source .env && node ./dist/src/main.js
and i get the error:
{"err":{"message":"Invalid protocol: 127.0.0.1:","stack":"Error: Invalid protocol: 127.0.0.1:\n at Request.init (/home/yangjian/workspace/ipfs/filecoin/filecoin-network-stats/backend/node_modules/request/request.js:458:31)\n
My .env
file is
export DB_URL=postgresql://filecoin:123456@localhost:5432
export FULL_NODE_URL=http://127.0.0.1:3453
export IS_MASTER=true
export PEER_INFO_FILE=./peerId.json
export HEARTBEAT_PORT=8090
export API_PORT=8081
export LOG_LEVEL=info
uBlock Origin uses the easylist.to block lists which now contains an entry for browser.sentry-cdn.com
. This results in a failure to load the sentry bundle and the page immediately fails with TypeError: window.Sentry is undefined
.
A simple check should resolve the issue.
https://stats.kittyhawk.wtf/ show like this:
ping stats.kittyhawk.wtf return:
https://docs.filecoin.io/go-filecoin-tutorial/Block-Explorer show like this:
Currently the dashboard counts any node that connects to it, regardless of network or version. The result is an misleading count of participating nodes.
Let’s check genesisCID in heartbeat messages (will have to be added via filecoin-project/venus#2982). Then the stats dashboard could reject connections from nodes that are no longer on the correct network.
My node IP address is in Shanghai, China, but it is displayed in Japan, and other node locations seem to be wrong.
/ip4/122.144.208.16/tcp/6000/ipfs/QmSZ4CQdCWwLFD8ngq4QE8N2bvEsA5inv7u211rr52axFt
/ip4/122.144.208.36/tcp/6000/ipfs/QmWQK4Xww2xjumWCjEtXuXEaEVaCQe9P1LiqpL1aQbYY7t
/ip4/122.144.208.36/tcp/6003/ipfs/QmR1fL9Hpg8oAAZFkjN7YcPJ4W1ptRigpN32mfEZ9epNM3
Doesn't have to include the entire Best Tipset component.
Just the Block Height number - because it's the most important number for miners - everyone is constantly looking at it to see if they're synced.
Hi, it appears that the network stats dashboard is somehow filtering logs sent by old binaries. Is that the case? If so, great, just wanted to confirm. We have gone out of our way to ensure that filecoin binaries attempting to connect to the test and user devnets will disconnect if they were built at a different commit than the nodes to which they are connecting. We do this as a temporary measure until we have a model for change that enables nodes built at different commits to interoperate and because of a huge volume of issues reported that were a function of trying to run old code against a new devnet, or vice versa.
Any binaries built before that code went into go-filecoin dont have this disconnect behavior and still connect to the user and test devnets, unfortunately. We're working on something that will prevent this, eg by changing peerids with each release. Even so, we were curious whether there was any mechanism for filtering at the network stats dashboard, looks like the answer is yes but hard to tell.
Can you fill us in? Thanks!
[To ask go-filecoin team]
There was a request to add a link to a doc of Known Issues with the current network to the Dashboard. Should KNOWN_ISSUES.md be that doc?
(Also FYI - current Devnet version is being loaded from go-filecoin-badge/user-devnet.json if Network.STABLE. These links can be moved later when there are other implementations.)
$ DATABASE_URL=postgres://postgres:xxx@1@localhost:5432/filecoin-network-stats db-migrate up
received data: CREATE INDEX block_height_idx ON blocks USING btree(height);
[INFO] Processed migration 20190606073105-add-block-height-index
[ERROR] AssertionError [ERR_ASSERTION]: ifError got unwanted exception: ENOENT: no such file or directory, open '/home/filecoin/codes/filecoin-network-stats/backend/migrations/sqls/20190608002923-update-trigger-param-type-up.sql'
at /home/filecoin/codes/filecoin-network-stats/backend/node_modules/db-migrate/lib/commands/on-complete.js:15:14
at tryCatcher (/home/filecoin/codes/filecoin-network-stats/backend/node_modules/bluebird/js/release/util.js:16:23)
at Promise.successAdapter (/home/filecoin/codes/filecoin-network-stats/backend/node_modules/bluebird/js/release/nodeify.js:22:30)
at Promise._settlePromise (/home/filecoin/codes/filecoin-network-stats/backend/node_modules/bluebird/js/release/promise.js:566:21)
at Promise._settlePromiseCtx (/home/filecoin/codes/filecoin-network-stats/backend/node_modules/bluebird/js/release/promise.js:606:10)
at _drainQueueStep (/home/filecoin/codes/filecoin-network-stats/backend/node_modules/bluebird/js/release/async.js:142:12)
at _drainQueue (/home/filecoin/codes/filecoin-network-stats/backend/node_modules/bluebird/js/release/async.js:131:9)
at Async._drainQueues (/home/filecoin/codes/filecoin-network-stats/backend/node_modules/bluebird/js/release/async.js:147:5)
at Immediate.Async.drainQueues [as _onImmediate] (/home/filecoin/codes/filecoin-network-stats/backend/node_modules/bluebird/js/release/async.js:17:14)
at runCallback (timers.js:705:18)
at tryOnImmediate (timers.js:676:5)
at processImmediate (timers.js:658:5)
Installing and building for local development needs improvement. There should be some instructions on running postgres and making it clear that it is required to build from the common directory for the backend to build.
There should be a single command that builds everything and another that starts everything other than the data base and the filecoin node.
npm WARN optional Skipping failed optional dependency /chokidar/fsevents:
npm WARN notsup Not compatible with your operating system or architecture: [email protected]
npm WARN [email protected] No description
npm WARN [email protected] No repository field.
[0] multi (webpack)-dev-server/client?http://localhost:8081 (webpack)/hot/dev-server.js ./src/index.tsx 52 bytes {main} [built]
[./node_modules/c3/c3.css] 1020 bytes {main} [built]
[./node_modules/loglevel/lib/loglevel.js] 7.68 KiB {main} [built]
[./node_modules/normalize.css/normalize.css] 1.02 KiB {main} [built]
[./node_modules/react-dom/index.js] 1.33 KiB {main} [built]
[./node_modules/react-redux/es/index.js] 270 bytes {main} [built]
[./node_modules/react-router-dom/es/index.js] 1010 bytes {main} [built]
[./node_modules/react/index.js] 190 bytes {main} [built]
[./node_modules/strip-ansi/index.js] 161 bytes {main} [built]
[./node_modules/url/url.js] 22.8 KiB {main} [built]
[./node_modules/webpack-dev-server/client/index.js?http://localhost:8081] (webpack)-dev-server/client?http://localhost:8081 7.78 KiB {main} [built]
[./node_modules/webpack-dev-server/client/overlay.js] (webpack)-dev-server/client/overlay.js 3.58 KiB {main} [built]
[./node_modules/webpack-dev-server/client/socket.js] (webpack)-dev-server/client/socket.js 1.05 KiB {main} [built]
[./node_modules/webpack/hot/dev-server.js] (webpack)/hot/dev-server.js 1.61 KiB {main} [built]
[./src/index.tsx] 1020 bytes {main} [built]
+ 505 hidden modules
WARNING in EnvironmentPlugin - GA_TRACKING_ID environment variable is undefined.
You can pass an object with default values to suppress this warning.
See https://webpack.js.org/plugins/environment-plugin for example.
WARNING in EnvironmentPlugin - SENTRY_DSN environment variable is undefined.
You can pass an object with default values to suppress this warning.
See https://webpack.js.org/plugins/environment-plugin for example.
ERROR in ./src/ducks/overrides.ts
Module not found: Error: Can't resolve 'filecoin-network-stats-common/lib/domain/CategoryDatapoint' in '/file/data/wwwroot/filecoin/frontend/src/ducks'
@ ./src/ducks/overrides.ts 50:26-95
@ ./src/ducks/store.ts
@ ./src/index.tsx
@ multi (webpack)-dev-server/client?http://localhost:8081 (webpack)/hot/dev-server.js ./src/index.tsx
ERROR in ./src/components/DateSwitchingChart.tsx
Module not found: Error: Can't resolve 'filecoin-network-stats-common/lib/domain/ChartDuration' in '/file/data/wwwroot/filecoin/frontend/src/components'
@ ./src/components/DateSwitchingChart.tsx 53:22-87
@ ./src/components/storage/HistoricalUtilizationChart.tsx
@ ./src/components/storage/StorageCostCapacity.tsx
@ ./src/components/Main.tsx
@ ./src/index.tsx
@ multi (webpack)-dev-server/client?http://localhost:8081 (webpack)/hot/dev-server.js ./src/index.tsx
ERROR in ./src/ducks/stats.ts
Module not found: Error: Can't resolve 'filecoin-network-stats-common/lib/domain/Stats' in '/file/data/wwwroot/filecoin/frontend/src/ducks'
@ ./src/ducks/stats.ts 50:14-71
@ ./src/ducks/store.ts
@ ./src/index.tsx
@ multi (webpack)-dev-server/client?http://localhost:8081 (webpack)/hot/dev-server.js ./src/index.tsx
ERROR in ./src/ducks/overrides.ts
Module not found: Error: Can't resolve 'filecoin-network-stats-common/lib/domain/TimeseriesDatapoint' in '/file/data/wwwroot/filecoin/frontend/src/ducks'
@ ./src/ducks/overrides.ts 49:28-99
@ ./src/ducks/store.ts
@ ./src/index.tsx
@ multi (webpack)-dev-server/client?http://localhost:8081 (webpack)/hot/dev-server.js ./src/index.tsx
ERROR in [at-loader] ./src/ducks/stats.ts:4:47
TS2307: Cannot find module 'filecoin-network-stats-common/lib/domain/Stats'.
ERROR in [at-loader] ./src/ducks/overrides.ts:2:89
TS2307: Cannot find module 'filecoin-network-stats-common/lib/domain/TimeseriesDatapoint'.
ERROR in [at-loader] ./src/ducks/overrides.ts:3:83
TS2307: Cannot find module 'filecoin-network-stats-common/lib/domain/CategoryDatapoint'.
ERROR in [at-loader] ./src/ducks/overrides.ts:4:29
TS2307: Cannot find module 'filecoin-network-stats-common/lib/domain/ChartDuration'.
ERROR in [at-loader] ./src/components/MiningSummary.tsx:8:27
TS2307: Cannot find module 'filecoin-network-stats-common/lib/domain/Stats'.
ERROR in [at-loader] ./src/components/NodeMap.tsx:7:20
TS2307: Cannot find module 'filecoin-network-stats-common/lib/domain/Node'.
ERROR in [at-loader] ./src/components/TimelineDateChart.tsx:6:35
TS2307: Cannot find module 'filecoin-network-stats-common/lib/domain/TimeseriesDatapoint'.
ERROR in [at-loader] ./src/utils/averages.ts:2:36
TS2307: Cannot find module 'filecoin-network-stats-common/lib/domain/HistogramDatapoint'.
ERROR in [at-loader] ./src/utils/averages.ts:3:37
TS2307: Cannot find module 'filecoin-network-stats-common/lib/domain/TimeseriesDatapoint'.
ERROR in [at-loader] ./src/utils/timeseriesUnits.ts:1:35
TS2307: Cannot find module 'filecoin-network-stats-common/lib/domain/TimeseriesDatapoint'.
ERROR in [at-loader] ./src/components/storage/AverageStorageCostChart.tsx:3:35
TS2307: Cannot find module 'filecoin-network-stats-common/lib/domain/TimeseriesDatapoint'.
ERROR in [at-loader] ./src/components/GainLossTimelineChart.tsx:6:35
TS2307: Cannot find module 'filecoin-network-stats-common/lib/domain/TimeseriesDatapoint'.
ERROR in [at-loader] ./src/components/DateSwitchingChart.tsx:3:29
TS2307: Cannot find module 'filecoin-network-stats-common/lib/domain/ChartDuration'.
ERROR in [at-loader] ./src/components/SwitchableDateSwitchingChart.tsx:6:29
TS2307: Cannot find module 'filecoin-network-stats-common/lib/domain/ChartDuration'.
ERROR in [at-loader] ./src/components/Home.tsx:9:41
TS2307: Cannot find module 'filecoin-network-stats-common/lib/domain/Stats'.
ERROR in [at-loader] ./src/components/Home.tsx:25:29
TS2307: Cannot find module 'filecoin-network-stats-common/lib/domain/ChartDuration'.
ERROR in [at-loader] ./src/components/Retrieval.tsx:8:35
TS2307: Cannot find module 'filecoin-network-stats-common/lib/domain/TimeseriesDatapoint'.
ERROR in [at-loader] ./src/components/HistogramChart.tsx:2:34
TS2307: Cannot find module 'filecoin-network-stats-common/lib/domain/HistogramDatapoint'.
ERROR in [at-loader] ./src/components/HistogramChart.tsx:48:17
TS2339: Property 'count' does not exist on type 'AugmentedHistogramDatapoint'.
ERROR in [at-loader] ./src/components/HistogramChart.tsx:49:21
TS2339: Property 'count' does not exist on type 'AugmentedHistogramDatapoint'.
ERROR in [at-loader] ./src/components/HistogramChart.tsx:54:17
TS2339: Property 'count' does not exist on type 'AugmentedHistogramDatapoint'.
ERROR in [at-loader] ./src/components/token/TokenHoldingsDistribution.tsx:2:34
TS2307: Cannot find module 'filecoin-network-stats-common/lib/domain/HistogramDatapoint'.
ERROR in [at-loader] ./src/components/token/HistoricalCollateralChart.tsx:2:35
TS2307: Cannot find module 'filecoin-network-stats-common/lib/domain/TimeseriesDatapoint'.
ERROR in [at-loader] ./src/components/token/HistoricalCollateralChart.tsx:3:29
TS2307: Cannot find module 'filecoin-network-stats-common/lib/domain/ChartDuration'.
ERROR in [at-loader] ./src/components/token/HistoricalBlockRewards.tsx:2:35
TS2307: Cannot find module 'filecoin-network-stats-common/lib/domain/TimeseriesDatapoint'.
ERROR in [at-loader] ./src/components/token/HistoricalBlockRewards.tsx:3:29
TS2307: Cannot find module 'filecoin-network-stats-common/lib/domain/ChartDuration'.
ERROR in [at-loader] ./src/components/StackedColumnChart.tsx:2:33
TS2307: Cannot find module 'filecoin-network-stats-common/lib/domain/CategoryDatapoint'.
ERROR in [at-loader] ./src/components/token/CoinsInCirculation.tsx:2:33
TS2307: Cannot find module 'filecoin-network-stats-common/lib/domain/CategoryDatapoint'.
ERROR in [at-loader] ./src/components/token/CoinsInCirculation.tsx:3:29
TS2307: Cannot find module 'filecoin-network-stats-common/lib/domain/ChartDuration'.
ERROR in [at-loader] ./src/components/token/BlockRewardLifecycle.tsx:2:35
TS2307: Cannot find module 'filecoin-network-stats-common/lib/domain/TimeseriesDatapoint'.
ERROR in [at-loader] ./src/components/storage/MinerCountChart.tsx:2:35
TS2307: Cannot find module 'filecoin-network-stats-common/lib/domain/TimeseriesDatapoint'.
ERROR in [at-loader] ./src/components/storage/MinerCountChart.tsx:3:29
TS2307: Cannot find module 'filecoin-network-stats-common/lib/domain/ChartDuration'.
ERROR in [at-loader] ./src/components/storage/StorageMinersTable.tsx:5:25
TS2307: Cannot find module 'filecoin-network-stats-common/lib/domain/MinerStat'.
ERROR in [at-loader] ./src/components/PercentageLineChart.tsx:2:33
TS2307: Cannot find module 'filecoin-network-stats-common/lib/domain/CategoryDatapoint'.
ERROR in [at-loader] ./src/components/storage/MiningEvolutionChart.tsx:5:33
TS2307: Cannot find module 'filecoin-network-stats-common/lib/domain/CategoryDatapoint'.
ERROR in [at-loader] ./src/utils/randomData.ts:2:35
TS2307: Cannot find module 'filecoin-network-stats-common/lib/domain/TimeseriesDatapoint'.
ERROR in [at-loader] ./src/utils/randomData.ts:3:33
TS2307: Cannot find module 'filecoin-network-stats-common/lib/domain/CategoryDatapoint'.
ERROR in [at-loader] ./src/components/storage/StorageDeals.tsx:7:34
TS2307: Cannot find module 'filecoin-network-stats-common/lib/domain/HistogramDatapoint'.
ERROR in [at-loader] ./src/components/storage/StorageCapacityHistogram.tsx:2:34
TS2307: Cannot find module 'filecoin-network-stats-common/lib/domain/HistogramDatapoint'.
ERROR in [at-loader] ./src/components/storage/HistoricalCollateralPerGBChart.tsx:2:35
TS2307: Cannot find module 'filecoin-network-stats-common/lib/domain/TimeseriesDatapoint'.
ERROR in [at-loader] ./src/components/storage/HistoricalCollateralPerGBChart.tsx:3:29
TS2307: Cannot find module 'filecoin-network-stats-common/lib/domain/ChartDuration'.
ERROR in [at-loader] ./src/components/storage/StorageCostCapacityBySizeBreakdown.tsx:2:40
TS2307: Cannot find module 'filecoin-network-stats-common/lib/domain/CostCapacityForMinerStat'.
ERROR in [at-loader] ./src/components/storage/HistoricalStoragePriceChart.tsx:2:35
TS2307: Cannot find module 'filecoin-network-stats-common/lib/domain/TimeseriesDatapoint'.
ERROR in [at-loader] ./src/components/storage/HistoricalStoragePriceChart.tsx:3:29
TS2307: Cannot find module 'filecoin-network-stats-common/lib/domain/ChartDuration'.
ERROR in [at-loader] ./src/components/storage/HistoricalUtilizationChart.tsx:2:35
TS2307: Cannot find module 'filecoin-network-stats-common/lib/domain/TimeseriesDatapoint'.
ERROR in [at-loader] ./src/components/storage/HistoricalUtilizationChart.tsx:3:29
TS2307: Cannot find module 'filecoin-network-stats-common/lib/domain/ChartDuration'.
Child html-webpack-plugin for "index.html":
1 asset
Entrypoint undefined = index.html
[./node_modules/html-webpack-plugin/lib/loader.js!./src/index.html] 2.7 KiB {0} [built]
[./node_modules/lodash/lodash.js] 527 KiB {0} [built]
[./node_modules/webpack/buildin/global.js] (webpack)/buildin/global.js 472 bytes {0} [built]
[./node_modules/webpack/buildin/module.js] (webpack)/buildin/module.js 497 bytes {0} [built]
ℹ 「wdm」: Failed to compile.
@zhengboowen commented on Wed May 29 2019
The mining data on Filecoin devnet seems to have a problem. These data are displayed two days ago. Did the network not update the blockchain data in time? Or is there a problem with the blockchain data ?
In a forum discussion a user noticed "the network map shows my instances in the US while the server is physically located in Greece." Other nodes have incorrect locations as well in the network dashboard's map.
The network stats dashboard is using the free IP2Location Lite D5 database which has limited accuracy. We could look into purchasing a commercial license for a more accurate database to improve IP location accuracy for this dashboard in the future.
Due to the value of storage being such a small number, when large values are set for asks the listed average far exceeds the more realistic value for the storage price.
I think we need to find a better way to calculate this value.
t2qqsnhceuzq7rtcjeafy7amwfbuae5nokgfaf4ja 000 10000000 589
t2qqsnhceuzq7rtcjeafy7amwfbuae5nokgfaf4ja 001 100 590
t2qqsnhceuzq7rtcjeafy7amwfbuae5nokgfaf4ja 002 10 592
Also, it appears that these values probably shouldn't be included in the calculation either. Though I think this is a bug on the go-filecoin side, as expired entries probably should be filtered out by default.
A declarative, efficient, and flexible JavaScript library for building user interfaces.
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
An Open Source Machine Learning Framework for Everyone
The Web framework for perfectionists with deadlines.
A PHP framework for web artisans
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
Some thing interesting about web. New door for the world.
A server is a program made to process requests and deliver data to clients.
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Some thing interesting about visualization, use data art
Some thing interesting about game, make everyone happy.
We are working to build community through open source technology. NB: members must have two-factor auth.
Open source projects and samples from Microsoft.
Google ❤️ Open Source for everyone.
Alibaba Open Source for everyone
Data-Driven Documents codes.
China tencent open source team.