Giter Site home page Giter Site logo

testnet's People

Contributors

asmodat avatar

Stargazers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

Watchers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

testnet's Issues

A lot of validators missing blocks

My node ran for more that 10hours without missing any blocks. Now it seems to have bit streaks missing signing blocks.

2021-04-04T11:31:15.576875220Z  ^[[90m11:31AM^[[0m ^[[32mINF^[[0m enterPrecommit(24200/0). Current: 24200/0/RoundStepPropose ^[[36mheight=^[[0m24200 ^[[36mmodule=^[[0mconsensus ^>

2021-04-04T11:31:15.577053027Z  ^[[90m11:31AM^[[0m ^[[32mINF^[[0m enterPrecommit: No +2/3 prevotes during enterPrecommit. Precommitting nil. ^[[36mheight=^[[0m24200 ^[[36mmodule=>

2021-04-04T11:31:15.580595436Z  ^[[90m11:31AM^[[0m ^[[32mINF^[[0m Signed and pushed vote ^[[36merr=^[[0mnull ^[[36mheight=^[[0m24200 ^[[36mmodule=^[[0mconsensus ^[[36mround=^[[0m>

2021-04-04T11:31:15.580612488Z  ^[[90m11:31AM^[[0m ^[[32mINF^[[0m enterCommit(24200/0). Current: 24200/0/RoundStepPrecommit ^[[36mcommitRound=^[[0m0 ^[[36mheight=^[[0m24200 ^[[36>

2021-04-04T11:31:15.580615724Z  ^[[90m11:31AM^[[0m ^[[32mINF^[[0m Commit is for a block we don't know about. Set ProposalBlock=nil ^[[36mcommit=^[[0m81D802FDA4A86C2D87275DB687D45>

2021-04-04T11:31:15.580625122Z  ^[[90m11:31AM^[[0m ^[[32mINF^[[0m Attempt to finalize failed. We don't have the commit block. ^[[36mcommit-block=^[[0m81D802FDA4A86C

At some point it looks like the cpu intensive manager lacks behind or the consensus with a lot of validators having kind alike problems have isues.

Too many lost blocks

When the node is running, there are a lot of missed blocks. Reinstalling the node does not solve this problem

Validator status inactive

After upgrading to v0.2.1 and sending active command , I find that my validator status converted to inactive without few minutes.

In order to solve this problem, I have tried to add seed node into list which worked for part of problem and my node is active for now.

But the new challenge is that my rank is wiped to 0 for some problem, I believe that I'm missing block all the time which is so weird.
BTW, I sincerely recommend that the team should build a discord room for validators.

Stats site

We developed an stattistical web site to be used during testnet phase and extended to mainnet.
Please, see the report.

Regards.

Sentry Restart Loop (testnet-2)

After updating Public peers and restart sentry, it goes in endless restart loop, only way to fix it is run partial re init

I want to be a validator

I have not been able to become a validator. I have sent several unjuil requests, but it still doesn’t work. I don’t know why, it’s always
“block...
Waiting for '' to be included in the

my Val.ADDR:
kira17h059f66q0mthdp5xhcfjea5fttmluejgkaxe7

testnet-2 stick: Evidence already pending

Log from sentry:

2021-04-19T15:56:31.454767634Z �[90m3:56PM�[0m �[32mINF�[0m Served RPC HTTP response �[36mduration=�[0m0 �[36mmethod=�[0mGET �[36mmodule=�[0mrpc-server �[36mremoteAddr=�[0m10.3.0.3:41004 �[36mstatus=�[0m500 �[36murl=�[0m{"ForceQuery":false,"Fragment":"","Host":"","Opaque":"","Path":"/block","RawFragment":"","RawPath":"","RawQuery":"height=204504","Scheme":"","User":null} 2021-04-19T15:56:31.555635108Z �[90m3:56PM�[0m �[32mINF�[0m Served RPC HTTP response �[36mduration=�[0m0 �[36mmethod=�[0mGET �[36mmodule=�[0mrpc-server �[36mremoteAddr=�[0m10.3.0.3:41004 �[36mstatus=�[0m200 �[36murl=�[0m{"ForceQuery":true,"Fragment":"","Host":"","Opaque":"","Path":"/status","RawFragment":"","RawPath":"","RawQuery":"","Scheme":"","User":null} 2021-04-19T15:56:31.567535511Z �[90m3:56PM�[0m �[32mINF�[0m Served RPC HTTP response �[36mduration=�[0m0 �[36mmethod=�[0mGET �[36mmodule=�[0mrpc-server �[36mremoteAddr=�[0m10.3.0.3:41004 �[36mstatus=�[0m200 �[36murl=�[0m{"ForceQuery":true,"Fragment":"","Host":"","Opaque":"","Path":"/status","RawFragment":"","RawPath":"","RawQuery":"","Scheme":"","User":null} 2021-04-19T15:56:34.331007056Z �[90m3:56PM�[0m �[32mINF�[0m Served RPC HTTP response �[36mduration=�[0m1 �[36mmethod=�[0mGET �[36mmodule=�[0mrpc-server �[36mremoteAddr=�[0m10.3.0.3:41004 �[36mstatus=�[0m200 �[36murl=�[0m{"ForceQuery":false,"Fragment":"","Host":"","Opaque":"","Path":"/block","RawFragment":"","RawPath":"","RawQuery":"","Scheme":"","User":null} 2021-04-19T15:56:34.440011136Z �[90m3:56PM�[0m �[32mINF�[0m Served RPC HTTP response �[36mduration=�[0m0 �[36mmethod=�[0mGET �[36mmodule=�[0mrpc-server �[36mremoteAddr=�[0m10.2.0.1:42748 �[36mstatus=�[0m200 �[36murl=�[0m{"ForceQuery":false,"Fragment":"","Host":"","Opaque":"","Path":"/status","RawFragment":"","RawPath":"","RawQuery":"","Scheme":"","User":null} 2021-04-19T15:56:37.361496414Z �[90m3:56PM�[0m �[32mINF�[0m Served RPC HTTP response �[36mduration=�[0m0 �[36mmethod=�[0mGET �[36mmodule=�[0mrpc-server �[36mremoteAddr=�[0m10.2.0.1:42786 �[36mstatus=�[0m200 �[36murl=�[0m{"ForceQuery":false,"Fragment":"","Host":"","Opaque":"","Path":"/status","RawFragment":"","RawPath":"","RawQuery":"","Scheme":"","User":null} 2021-04-19T15:56:37.480243582Z �[90m3:56PM�[0m �[32mINF�[0m Evidence already pending, ignoring this one �[36mev=�[0m{"Timestamp":"2021-04-19T06:35:35.153998512Z","TotalVotingPower":133,"ValidatorPower":1,"vote_a":{"block_id":{"hash":"","parts":{"hash":"","total":0}},"height":202750,"round":0,"signature":"PyF/6wNQLuvRiDMj/tJM/Yu+cxxPUvEVWYRF7UmoX/970U8Z/CPCX7CFh48QByma2x1Q8yfO/5vp6p3vfDvvAA==","timestamp":"2021-04-19T06:35:40.997618902Z","type":1,"validator_address":"EDE57AD238BA4A7644AFBC6F043340D09C096C56","validator_index":121},"vote_b":{"block_id":{"hash":"1C12699D9E057090953A846475E68EA5D8A43561E44E11C7CCEFEEE4073DC29E","parts":{"hash":"FE2054D563B25C16A5E49C7A3E037339474D2181269064EC42C3691F054B9623","total":1}},"height":202750,"round":0,"signature":"hB9u2kpGTy7QpzwOtUd862BGkNMsYg69v5OAAbLqD+W/ZvyV+PA4cURHnJWeATaMQ/wv0D4emjHy1kjRtsLhCw==","timestamp":"2021-04-19T06:35:41.160062686Z","type":1,"validator_address":"EDE57AD238BA4A7644AFBC6F043340D09C096C56","validator_index":121}} �[36mmodule=�[0mevidence 2021-04-19T15:56:37.520334023Z �[90m3:56PM�[0m �[32mINF�[0m Evidence already pending, ignoring this one �[36mev=�[0m{"Timestamp":"2021-04-19T06:35:35.153998512Z","TotalVotingPower":133,"ValidatorPower":1,"vote_a":{"block_id":{"hash":"","parts":{"hash":"","total":0}},"height":202750,"round":0,"signature":"PyF/6wNQLuvRiDMj/tJM/Yu+cxxPUvEVWYRF7UmoX/970U8Z/CPCX7CFh48QByma2x1Q8yfO/5vp6p3vfDvvAA==","timestamp":"2021-04-19T06:35:40.997618902Z","type":1,"validator_address":"EDE57AD238BA4A7644AFBC6F043340D09C096C56","validator_index":121},"vote_b":{"block_id":{"hash":"1C12699D9E057090953A846475E68EA5D8A43561E44E11C7CCEFEEE4073DC29E","parts":{"hash":"FE2054D563B25C16A5E49C7A3E037339474D2181269064EC42C3691F054B9623","total":1}},"height":202750,"round":0,"signature":"hB9u2kpGTy7QpzwOtUd862BGkNMsYg69v5OAAbLqD+W/ZvyV+PA4cURHnJWeATaMQ/wv0D4emjHy1kjRtsLhCw==","timestamp":"2021-04-19T06:35:41.160062686Z","type":1,"validator_address":"EDE57AD238BA4A7644AFBC6F043340D09C096C56","validator_index":121}} �[36mmodule=�[0mevidence 2021-04-19T15:56:37.528708913Z �[90m3:56PM�[0m �[32mINF�[0m Evidence already pending, ignoring this one �[36mev=�[0m{"Timestamp":"2021-04-19T06:35:35.153998512Z","TotalVotingPower":133,"ValidatorPower":1,"vote_a":{"block_id":{"hash":"","parts":{"hash":"","total":0}},"height":202750,"round":0,"signature":"PyF/6wNQLuvRiDMj/tJM/Yu+cxxPUvEVWYRF7UmoX/970U8Z/CPCX7CFh48QByma2x1Q8yfO/5vp6p3vfDvvAA==","timestamp":"2021-04-19T06:35:40.997618902Z","type":1,"validator_address":"EDE57AD238BA4A7644AFBC6F043340D09C096C56","validator_index":121},"vote_b":{"block_id":{"hash":"1C12699D9E057090953A846475E68EA5D8A43561E44E11C7CCEFEEE4073DC29E","parts":{"hash":"FE2054D563B25C16A5E49C7A3E037339474D2181269064EC42C3691F054B9623","total":1}},"height":202750,"round":0,"signature":"hB9u2kpGTy7QpzwOtUd862BGkNMsYg69v5OAAbLqD+W/ZvyV+PA4cURHnJWeATaMQ/wv0D4emjHy1kjRtsLhCw==","timestamp":"2021-04-19T06:35:41.160062686Z","type":1,"validator_address":"EDE57AD238BA4A7644AFBC6F043340D09C096C56","validator_index":121}} �[36mmodule=�[0mevidence 2021-04-19T15:56:37.540390523Z �[90m3:56PM�[0m �[32mINF�[0m Served RPC HTTP response �[36mduration=�[0m0 �[36mmethod=�[0mGET �[36mmodule=�[0mrpc-server �[36mremoteAddr=�[0m10.3.0.3:41098 �[36mstatus=�[0m200 �[36murl=�[0m{"ForceQuery":true,"Fragment":"","Host":"","Opaque":"","Path":"/status","RawFragment":"","RawPath":"","RawQuery":"","Scheme":"","User":null} 2021-04-19T15:56:37.554827481Z �[90m3:56PM�[0m �[32mINF�[0m Served RPC HTTP response �[36mduration=�[0m0 �[36mmethod=�[0mGET �[36mmodule=�[0mrpc-server �[36mremoteAddr=�[0m10.3.0.3:41098 �[36mstatus=�[0m200 �[36murl=�[0m{"ForceQuery":true,"Fragment":"","Host":"","Opaque":"","Path":"/status","RawFragment":"","RawPath":"","RawQuery":"","Scheme":"","User":null} 2021-04-19T15:56:37.563072785Z �[90m3:56PM�[0m �[32mINF�[0m Evidence already pending, ignoring this one �[36mev=�[0m{"Timestamp":"2021-04-19T06:35:35.153998512Z","TotalVotingPower":133,"ValidatorPower":1,"vote_a":{"block_id":{"hash":"","parts":{"hash":"","total":0}},"height":202750,"round":0,"signature":"PyF/6wNQLuvRiDMj/tJM/Yu+cxxPUvEVWYRF7UmoX/970U8Z/CPCX7CFh48QByma2x1Q8yfO/5vp6p3vfDvvAA==","timestamp":"2021-04-19T06:35:40.997618902Z","type":1,"validator_address":"EDE57AD238BA4A7644AFBC6F043340D09C096C56","validator_index":121},"vote_b":{"block_id":{"hash":"1C12699D9E057090953A846475E68EA5D8A43561E44E11C7CCEFEEE4073DC29E","parts":{"hash":"FE2054D563B25C16A5E49C7A3E037339474D2181269064EC42C3691F054B9623","total":1}},"height":202750,"round":0,"signature":"hB9u2kpGTy7QpzwOtUd862BGkNMsYg69v5OAAbLqD+W/ZvyV+PA4cURHnJWeATaMQ/wv0D4emjHy1kjRtsLhCw==","timestamp":"2021-04-19T06:35:41.160062686Z","type":1,"validator_address":"EDE57AD238BA4A7644AFBC6F043340D09C096C56","validator_index":121}} �[36mmodule=�[0mevidence 2021-04-19T15:56:37.573468414Z �[90m3:56PM�[0m �[32mINF�[0m Evidence already pending, ignoring this one �[36mev=�[0m{"Timestamp":"2021-04-19T06:35:35.153998512Z","TotalVotingPower":133,"ValidatorPower":1,"vote_a":{"block_id":{"hash":"","parts":{"hash":"","total":0}},"height":202750,"round":0,"signature":"PyF/6wNQLuvRiDMj/tJM/Yu+cxxPUvEVWYRF7UmoX/970U8Z/CPCX7CFh48QByma2x1Q8yfO/5vp6p3vfDvvAA==","timestamp":"2021-04-19T06:35:40.997618902Z","type":1,"validator_address":"EDE57AD238BA4A7644AFBC6F043340D09C096C56","validator_index":121},"vote_b":{"block_id":{"hash":"1C12699D9E057090953A846475E68EA5D8A43561E44E11C7CCEFEEE4073DC29E","parts":{"hash":"FE2054D563B25C16A5E49C7A3E037339474D2181269064EC42C3691F054B9623","total":1}},"height":202750,"round":0,"signature":"hB9u2kpGTy7QpzwOtUd862BGkNMsYg69v5OAAbLqD+W/ZvyV+PA4cURHnJWeATaMQ/wv0D4emjHy1kjRtsLhCw==","timestamp":"2021-04-19T06:35:41.160062686Z","type":1,"validator_address":"EDE57AD238BA4A7644AFBC6F043340D09C096C56","validator_index":121}} �[36mmodule=�[0mevidence

No discovering of peers on public sentry

I've been running testnet-1 without missing any blocks, pretty long streak, but now on testnet-2 I kept missing blocks.

I investigated and saw that the sentry only had two peers:

image

After setting some seeds and peers using the kira network manager and restarting the container it suddenly increased to +/- 100

image

The max incoming/outgoing peers in the config.tom of the public sentry was set okay by kira. (think it was 1024 peers)

Something prevented to discover more peers. I did change the whitelist on the firewall but I would guess that wouldn't matter.

If someone notices the same please comment below

Waiting snapshot

I waited 6 hours. It is not completed

  • '[' '!' -d /home/hh/snap/testnet-2-204503-1618966514 ']'
  • i=142
  • cat /docker/shared/common/sentry/logs/start.log
  • tail -n 10
    2:05AM INF Served RPC HTTP response duration=0 method=GET module=rpc-server remoteAddr=10.2.0.1:33082 status=200 url={"ForceQuery":false,"Fragment":"","Host":"","Opaque":"","Path":"/status","RawFragment":"","RawPath":"","RawQuery":"","Scheme":"","User":null}
    2:05AM INF Served RPC HTTP response duration=0 method=GET module=rpc-server remoteAddr=10.2.0.1:33092 status=200 url={"ForceQuery":false,"Fragment":"","Host":"","Opaque":"","Path":"/status","RawFragment":"","RawPath":"","RawQuery":"","Scheme":"","User":null}
    2:05AM INF Served RPC HTTP response duration=0 method=GET module=rpc-server remoteAddr=10.2.0.1:33102 status=200 url={"ForceQuery":false,"Fragment":"","Host":"","Opaque":"","Path":"/status","RawFragment":"","RawPath":"","RawQuery":"","Scheme":"","User":null}
    2:05AM INF Served RPC HTTP response duration=0 method=GET module=rpc-server remoteAddr=10.2.0.1:33112 status=200 url={"ForceQuery":false,"Fragment":"","Host":"","Opaque":"","Path":"/status","RawFragment":"","RawPath":"","RawQuery":"","Scheme":"","User":null}
    2:05AM INF Served RPC HTTP response duration=0 method=GET module=rpc-server remoteAddr=10.2.0.1:33122 status=200 url={"ForceQuery":false,"Fragment":"","Host":"","Opaque":"","Path":"/status","RawFragment":"","RawPath":"","RawQuery":"","Scheme":"","User":null}
    2:05AM INF Served RPC HTTP response duration=0 method=GET module=rpc-server remoteAddr=10.2.0.1:33132 status=200 url={"ForceQuery":false,"Fragment":"","Host":"","Opaque":"","Path":"/status","RawFragment":"","RawPath":"","RawQuery":"","Scheme":"","User":null}
    2:05AM INF Served RPC HTTP response duration=0 method=GET module=rpc-server remoteAddr=10.2.0.1:33142 status=200 url={"ForceQuery":false,"Fragment":"","Host":"","Opaque":"","Path":"/status","RawFragment":"","RawPath":"","RawQuery":"","Scheme":"","User":null}
    2:05AM INF HTTPJSONRPC args=[{}] method=status module=rpc-server returns=[{},{}]
    2:05AM INF Served RPC HTTP response duration=0 method=POST module=rpc-server remoteAddr=127.0.0.1:54696 status=200 url={"ForceQuery":false,"Fragment":"","Host":"","Opaque":"","Path":"/","RawFragment":"","RawPath":"","RawQuery":"","Scheme":"","User":null}
    2:05AM INF Served RPC HTTP response duration=0 method=GET module=rpc-server remoteAddr=10.2.0.1:33154 status=200 url={"ForceQuery":false,"Fragment":"","Host":"","Opaque":"","Path":"/status","RawFragment":"","RawPath":"","RawQuery":"","Scheme":"","User":null}
  • echoInfo 'INFO: Waiting for snapshot '''testnet-2-204503-1618966514''' to be created...'
  • echo -e '\e[0m\e[36;1mINFO: Waiting for snapshot '''testnet-2-204503-1618966514''' to be created...\e[0m'
    INFO: Waiting for snapshot 'testnet-2-204503-1618966514' to be created...
  • sleep 30

Unhealthy infrastructure

Infrastructure is unhealthy for several hours. Restart of testnet might be necessary. All containers except snapshot are unhealthy. Same issues reported also by other users.

Node failed or status could not be fetched 3/3

Error when installing a node in which it can not pick up the height of the blocks and synchronize it. The solution to the problem is a complete reinstall using a different ip address. It helps to iterate over ip addresses (since this problem occurs when connecting to multiple addresses)

This is Follow up on issue 4 - validator log

This is my log from validator when the issue occurred:
**"error changing validator set: duplicate entry Validator {EBAA8A1AA4EC636AE3345436C291B51977B06D5B" should be the start of it

2021-04-02T09:52:46.274509222Z �[90m9:52AM�[0m �[1m�[31mERR�[0m�[0m **Error on ApplyBlock �[36merr=�[0m"commit failed for application: error changing validator set: duplicate entry Validator**{EBAA8A1AA4EC636AE3345436C291B51977B06D5B PubKeyEd25519{6DDCB539FEC02B209DC7FAB0F2670CF3FEA7564BE58181A495013D5BB6B7427B} VP:1 A:0} in [Validator{27CD156FF3493A5AF88A9C626EADE6C1B34082CF PubKeyEd25519{10BBF3CAE594EE09C0C5DC14F9C812557BBBEBFAA42446CF9EFBD6DABC0AE3B1} VP:1 A:0} Validator{31140F76FC42E1A7A1711ACE5D268FE2A73DDE81 PubKeyEd25519{F7147BF2372E764A27642D698C81CBE7B6D364A1FE704BB3A63BF08FFC175D7D} VP:1 A:0} Validator{492FFC1E95C6ECD94FA45C4936934D286445056A PubKeyEd25519{539715FAD6BBD4FADE49AC70DFA424E251EAD06CBC85FC07C79C4423823AB2C7} VP:1 A:0} Validator{5729EFBB585174D35B2651423053F71396A8AAD5 PubKeyEd25519{A549CB832960BEABFC42A8DD5A6660CB3B4C4BF5D96E330B2F5D8CD886695DD3} VP:1 A:0} Validator{69471AA0DBC1B27405F112E26A2AE9E34A2951B2 PubKeyEd25519{B7A316A33B885438DD828A82CB53CF3AB52DCFC5F4F78AF77EEE79B7A2B7DBF8} VP:1 A:0} Validator{7AEF92A8D5BEB560F541B386CF659504D5386EB1 PubKeyEd25519{B7AFB13FC0E6A0D9FCC0B15141FDF5C0D66BBE1E3C30D5FA659B4631F266825F} VP:1 A:0} Validator{8482AB39BDA9AF0CB2AADD8DDD382BDDE1800F17 PubKeyEd25519{85A78754C5E9DEC4CE8DD65B79205D0757BF7C885508F03AFE16A04514E7DB65} VP:1 A:0} Validator{D4EC26408087B77E8D307DAE9EE45F080A6152D5 PubKeyEd25519{D0AC6AE1081AD29C64E90F347AE783FCD14857FCE25083860CF8E29ED4649250} VP:1 A:0} Validator{EBAA8A1AA4EC636AE3345436C291B51977B06D5B PubKeyEd25519{6DDCB539FEC02B209DC7FAB0F2670CF3FEA7564BE58181A495013D5BB6B7427B} VP:0 A:0} Validator{EBAA8A1AA4EC636AE3345436C291B51977B06D5B PubKeyEd25519{6DDCB539FEC02B209DC7FAB0F2670CF3FEA7564BE58181A495013D5BB6B7427B} VP:1 A:0} Validator{EE60368B7AE1EC97D27AF22D4F4E03D2F4B77726 PubKeyEd25519{680CEEE5567D9DF73245A3D547AB622D835767FA8C301C0F26580901C512740D} VP:1 A:0} Validator{F7D045ED1B03FC63B3C3E665B93E926BC98507AF PubKeyEd25519{60CA6836A2F01CD79EF469A8ED9618DFA1E70E11B477D88107C2820C5C0C6899} VP:1 A:0}]" �[36mmodule=�[0mconsensus 2021-04-02T09:52:46.287181907Z �[90m9:52AM�[0m �[32mINF�[0m Added to precommit �[36mmodule=�[0mconsensus �[36mprecommits=�[0m"VoteSet{H:49999 R:0 T:SIGNED_MSG_TYPE_PRECOMMIT +2/3:B7A18ABEFE638D58591FD5C3DF2091D937DD4BD067A58E9212EBB40412A5444D:1:D6AB9BCA62E6(0.6956521739130435) BA{69:xxx_x_xx_x__xx_xxxxx_xxxxxxxxxx__x_xxx__x_x_xxxxxxxx_xxxxxx__xx____xx} map[]}" �[36mvote=�[0m{"block_id":{"hash":"B7A18ABEFE638D58591FD5C3DF2091D937DD4BD067A58E9212EBB40412A5444D","parts":{"hash":"D6AB9BCA62E65863F9B9D09B3B2778C3264C8BF4F743EABA9D40DBEF3E7D4BA2","total":1}},"height":49999,"round":0,"signature":"Tqqu76r0AfjMu7t7cSVNwcpXc1NR+G0mFbxPh6QWvpkcSIIJ3c0jJJB1ttxp03hFgu7nskYZ5OiW5g5p7K8FBg==","timestamp":"2021-04-02T09:52:45.158440737Z","type":2,"validator_address":"D59ECC0F8349A5C23DF6DBCCFFDC3E726359EECE","validator_index":57}

Originally posted by @reb0rn21 in #4 (comment)

Interx Errors in latest testnet

There are multiple errors for nearly every block in the interx log:

ERROR: 2021/04/19 13:08:14 [rpc-call] Block not found: 204119
ERROR: 2021/04/19 13:08:19 [AddNewBlock] block just after a halt: 204118, timestamp: 62.070832, average: 13.457605
ERROR: 2021/04/19 13:08:54 [AddNewBlock] not a new block: 204120
...

CONSENSUS HALTED REPORT

Here are my logs.

Healthchek
WARNING: Blocks are not beeing produced or synced, current height: 204503, previous height
container logs

1:47AM INF Served RPC HTTP response duration=1 method=POST module=rpc-server remoteAddr=127.0.0.1:38848 status=200 url={"ForceQuery":false,"Fragment":"","Host":"","Opaque":"","Path":"/","RawFragment":"","RawPath":"","RawQuery":"","Scheme":"","User":null}
1:47AM INF HTTPJSONRPC args=[{},{},{},{},{}] method=abci_query module=rpc-server returns=[{},{}]
1:47AM INF ABCIQuery data=0A146B38936A3DA4E0F4EECAFC5257EFAB8742CD2244 module=rpc path=/kira.staking.Query/ValidatorByAddress result={"code":0,"codespace":"","height":"204503","index":"0","info":"","key":null,"log":"","proofOps":null,"value":"CrkBCg1ub3JtYW5fbGlub2RlEhtodHRwczovL2dpdGh1Yi5jb20vbm9ybWFuYmIaHzxTb2NpYWwtTWVkaWEtVVJMLWUuZy4tVHdpdHRlcj4iBm5vcm1hbioBMDIUaziTaj2k4PTuyvxSV++rh0LNIkQ6QwodL2Nvc21vcy5jcnlwdG8uZWQyNTUxOS5QdWJLZXkSIgogJce4kalnqdziJyEn9EiyFnM7Ca0Tz7/qkMMjjP0i8hFAAUh3UGY="}
1:47AM INF Served RPC HTTP response duration=0 method=GET module=rpc-server remoteAddr=10.2.0.1:57764 status=200 url={"ForceQuery":false,"Fragment":"","Host":"","Opaque":"","Path":"/status","RawFragment":"","RawPath":"","RawQuery":"","Scheme":"","User":null}
1:47AM INF Served RPC HTTP response duration=0 method=GET module=rpc-server remoteAddr=10.2.0.1:57714 status=200 url={"ForceQuery":false,"Fragment":"","Host":"","Opaque":"","Path":"/status","RawFragment":"","RawPath":"","RawQuery":"","Scheme":"","User":null}
1:46AM INF Served RPC HTTP response duration=0 method=GET module=rpc-server remoteAddr=10.2.0.1:57666 status=200 url={"ForceQuery":false,"Fragment":"","Host":"","Opaque":"","Path":"/status","RawFragment":"","RawPath":"","RawQuery":"","Scheme":"","User":null}
1:46AM INF Served RPC HTTP response duration=0 method=GET module=rpc-server remoteAddr=10.2.0.1:57640 status=200 url={"ForceQuery":false,"Fragment":"","Host":"","Opaque":"","Path":"/status","RawFragment":"","RawPath":"","RawQuery":"","Scheme":"","User":null}
1:46AM INF Served RPC HTTP response duration=0 method=POST module=rpc-server remoteAddr=127.0.0.1:38670 status=200 url={"ForceQuery":false,"Fragment":"","Host":"","Opaque":"","Path":"/","RawFragment":"","RawPath":"","RawQuery":"","Scheme":"","User":null}
1:46AM INF HTTPJSONRPC args=[{},{},{},{},{}] method=abci_query module=rpc-server returns=[{},{}]
1:46AM INF ABCIQuery data=0A146B38936A3DA4E0F4EECAFC5257EFAB8742CD2244 module=rpc path=/kira.staking.Query/ValidatorByAddress result={"code":0,"codespace":"","height":"204503","index":"0","info":"","key":null,"log":"","proofOps":null,"value":"CrkBCg1ub3JtYW5fbGlub2RlEhtodHRwczovL2dpdGh1Yi5jb20vbm9ybWFuYmIaHzxTb2NpYWwtTWVkaWEtVVJMLWUuZy4tVHdpdHRlcj4iBm5vcm1hbioBMDIUaziTaj2k4PTuyvxSV++rh0LNIkQ6QwodL2Nvc21vcy5jcnlwdG8uZWQyNTUxOS5QdWJLZXkSIgogJce4kalnqdziJyEn9EiyFnM7Ca0Tz7/qkMMjjP0i8hFAAUh3UGY="}
1:46AM INF Served RPC HTTP response duration=0 method=GET module=rpc-server remoteAddr=10.2.0.1:57584 status=200 url={"ForceQuery":false,"Fragment":"","Host":"","Opaque":"","Path":"/status","RawFragment":"","RawPath":"","RawQuery":"","Scheme":"","User":null}
1:46AM INF Served RPC HTTP response duration=0 method=POST module=rpc-server remoteAddr=127.0.0.1:38654 status=200 url={"ForceQuery":false,"Fragment":"","Host":"","Opaque":"","Path":"/","RawFragment":"","RawPath":"","RawQuery":"","Scheme":"","User":null}
1:46AM INF HTTPJSONRPC args=[{}] method=status module=rpc-server returns=[{},{}]
1:46AM INF Served RPC HTTP response duration=0 method=GET module=rpc-server remoteAddr=10.2.0.1:57538 status=200 url={"ForceQuery":false,"Fragment":"","Host":"","Opaque":"","Path":"/status","RawFragment":"","RawPath":"","RawQuery":"","Scheme":"","User":null}
1:46AM INF Served RPC HTTP response duration=0 method=GET module=rpc-server remoteAddr=10.2.0.1:57496 status=200 url={"ForceQuery":false,"Fragment":"","Host":"","Opaque":"","Path":"/status","RawFragment":"","RawPath":"","RawQuery":"","Scheme":"","User":null}
1:46AM INF Served RPC HTTP response duration=0 method=GET module=rpc-server remoteAddr=10.2.0.1:57466 status=200 url={"ForceQuery":false,"Fragment":"","Host":"","Opaque":"","Path":"/status","RawFragment":"","RawPath":"","RawQuery":"","Scheme":"","User":null}
1:46AM INF Served RPC HTTP response duration=0 method=POST module=rpc-server remoteAddr=127.0.0.1:38522 status=200 url={"ForceQuery":false,"Fragment":"","Host":"","Opaque":"","Path":"/","RawFragment":"","RawPath":"","RawQuery":"","Scheme":"","User":null}
1:46AM INF HTTPJSONRPC args=[{},{},{},{},{}] method=abci_query module=rpc-server returns=[{},{}]
1:46AM INF ABCIQuery data=0A146B38936A3DA4E0F4EECAFC5257EFAB8742CD2244 module=rpc path=/kira.staking.Query/ValidatorByAddress result={"code":0,"codespace":"","height":"204503","index":"0","info":"","key":null,"log":"","proofOps":null,"value":"CrkBCg1ub3JtYW5fbGlub2RlEhtodHRwczovL2dpdGh1Yi5jb20vbm9ybWFuYmIaHzxTb2NpYWwtTWVkaWEtVVJMLWUuZy4tVHdpdHRlcj4iBm5vcm1hbioBMDIUaziTaj2k4PTuyvxSV++rh0LNIkQ6QwodL2Nvc21vcy5jcnlwdG8uZWQyNTUxOS5QdWJLZXkSIgogJce4kalnqdziJyEn9EiyFnM7Ca0Tz7/qkMMjjP0i8hFAAUh3UGY="}

I have stopped my machine and wait for testnet-3.

Follow up on issue 4 - claimseat bug network halt

Hey all,

I am the operator of StakesStone and as already mentioned by Creamers158 in issue 4, for me it was possible to claim more than one seat as a validator in the network with the same public key. This also led to several errors in the logs of other validators. For me, the first time I issued the command "sekaid tx customstaking claim-validator-seat" I got an RPC error. Afterwards, I re-submitted the command and the tx got successfully through. I again submitted the tx, and it again got through. I thought that there would be an error handling or a check to cross-check if the before submitted public key is already in the validator list, however, as seen now in issue 4 my validator was submitted twice in the validator list.

After submitting the claim-validator-seat, my validator ran fine and I also made blocks. I checked one day after claiming the seat and my validator ended up missing blocks. If this is related to the network halt, currently I am not yet sure. But I think there should be a cross-check if a validator is already in the set, or not.

New Deploymnet of Infra creates new ValAddrr

Running a new Infrastructure is generating a new ValAddr even if the old mnemonics.env were imported prior to deployment, so lets say i can keep the new ValAddr, there is no new mnemonic since the old ones are stored on the machine.

Would be IMPORTANT to generated the ValAddr based on the imported mnenomics w/o redeploying the whole Infra

Validator Container M mode error

When trying to put the validator in M mode: \nsignature verification failed; please verify account number (0) and chain-id (): unauthorized"

Failed Initilization

Following steps for install:

  • run script
  • branch: testnet-2
  • set [A] autodiscover, i get the latest snap, which is dwld
  • rest of setups runs ok, no errors
  • multiple fresh instal, always end up in the error attached

Screenshot 2021-04-18 214822

Unexpected error during node installation

Unexpected error during node installation. The system is prompted to restart the computer and starts the installation again-however, this error appears again. The error may be caused by a block synchronization failure

autodiscovering snapshots

The autodiscovery works and it will search for a peer with a snapshot.
Except, it finds a peer with a very very old snapshot and proceeds without question.

Feature request / suggestion , ability to skip a found snapshot if it's too old or not recent enough.

image

testnet-2 stuck at block 204503

Looks like issue started with DuplicateVoteEvidence

2021-04-19T15:01:07.096603339Z �[90m3:01PM�[0m �[1m�[31mERR�[0m�[0m enterPrevote: ProposalBlock is invalid �[36merr=�[0m"Invalid evidence: evidence has a different time to the block it is associated with (2021-04-10 13:40:03.732603356 +0000 UTC != 2021-04-10 13:40:03.639863378 +0000 UTC). Evidence: DuplicateVoteEvidence{VoteA: Vote{103:8AE9FEC1C8F4 125617/00/SIGNED_MSG_TYPE_PREVOTE(Prevote) 000000000000 11FC1FC33DF9 @ 2021-04-10T13:40:10.266239662Z}, VoteB: Vote{103:8AE9FEC1C8F4 125617/00/SIGNED_MSG_TYPE_PREVOTE(Prevote) 2D2993EF7BA7 F39416F98445 @ 2021-04-10T13:40:10.23977032Z}}" �[36mheight=�[0m204495 �[36mmodule=�[0mconsensus �[36mround=�[0m1 2021-04-19T15:01:07.096893960Z �[90m3:01PM�[0m �[32mINF�[0m Added to prevote �[36mmodule=�[0mconsensus �[36mprevotes=�[0m"VoteSet{H:204495 R:1 T:SIGNED_MSG_TYPE_PREVOTE +2/3:<nil>(0.0072992700729927005) BA{137:________________________________________________________________________________________________________________x________________________} map[]}" �[36mvote=�[0m{"block_id":{"hash":"","parts":{"hash":"","total":0}},"height":204495,"round":1,"signature":"4r3QI11znFmDq02y7VDLw6UsAfOMOwLM/mkjWq4QxB0QOqQaV+sWCwLoGZEvVm14MWngXPjlaQ3ZiWg+zKEmDg==","timestamp":"2021-04-19T15:01:06.557643838Z","type":1,"validator_address":"D6867F83C7720A930DD7AE8652BB32AF5BC274B3","validator_index":112}

catching up: false

  • set +x
    INFO: Minimum height: 85223, current height: 83497, catching up: false
    INFO: Do NOT close your terminal, waiting for priv_sentry to finish catching up...
  • sleep 30

Testnet-3 occured panic error, when manully node

I tried to synchronize nodes and an error occurred.

5:29AM INF Dialing peer address={"id":"0d29dc6c0da53d4d5d450bd28b5e10008ada1049","ip":"121.78.241.72","port":26656} module=p2p
5:29AM INF Stopping gossipDataRoutine for peer module=consensus peer={"Data":{},"Logger":{}}
5:29AM INF Stopping gossipVotesRoutine for peer module=consensus peer={"Data":{},"Logger":{}}
panic: Failed to process committed block (1:F0977946C6B64030ECA9FDDD364691EF9B5B5F9EF377E74B2F73678FBF9BE00A): block time 2021-05-02 17:55:17.335672856 +0000 UTC is not equal to genesis time 2021-05-02 15:48:35.606923479 +0000 UTC

goroutine 98 [running]:
github.com/tendermint/tendermint/blockchain/v0.(*BlockchainReactor).poolRoutine(0xc000d1d500, 0x0)
        /home/ret/go/pkg/mod/github.com/tendermint/[email protected]/blockchain/v0/reactor.go:401 +0x1605
created by github.com/tendermint/tendermint/blockchain/v0.(*BlockchainReactor).OnStart
        /home/ret/go/pkg/mod/github.com/tendermint/[email protected]/blockchain/v0/reactor.go:110 +0x8c

I checked genesis.json checksum, again.

$ sha256sum genesis.json
e800493110fb1e0b8cc3360643387eb05d0d3b08a22212dbacaccf9c1308ea8e  genesis.json

It was installed from the source and runned from no block data.
as I know, if genesis file is different, it should not be connected, not occured panic error.

Priv_sentry container synchronization failed.

The priv_sentry container synchronization failed and I had re-initialized Infrastructure several times which didn't work.

Some log shown as follow

2:34AM ERR Failed to reconnect to peer. Beginning exponential backoff addr={"id":"5115fbac6cdd98d387513cb5b32d34120fcd443a","ip":"10.2.0.2","port":26656} elapsed=132446.727309 module=p2p
2:34AM INF Served RPC HTTP response duration=1 method=GET module=rpc-server remoteAddr=10.2.0.1:45100 status=200 url={"ForceQuery":false,"Fragment":"","Host":"","Opaque":"","Path":"/status","RawFragment":"","RawPath":"","RawQuery":"","Scheme":"","User":null}
2:34AM INF Dialing peer address={"id":"5115fbac6cdd98d387513cb5b32d34120fcd443a","ip":"10.2.0.2","port":26656} module=p2p
2:34AM INF Error reconnecting to peer. Trying again addr={"id":"5115fbac6cdd98d387513cb5b32d34120fcd443a","ip":"10.2.0.2","port":26656} err="auth failure: secret conn failed: read tcp 10.2.0.4:53834->10.2.0.2:26656: read: connection reset by peer" module=p2p tries=0
2:34AM INF Dialing peer address={"id":"5115fbac6cdd98d387513cb5b32d34120fcd443a","ip":"10.2.0.2","port":26656} module=p2p
2:34AM INF Error reconnecting to peer. Trying again addr={"id":"5115fbac6cdd98d387513cb5b32d34120fcd443a","ip":"10.2.0.2","port":26656} err="auth failure: secret conn failed: EOF" module=p2p tries=1
2:34AM INF Served RPC HTTP response duration=0 method=GET module=rpc-server remoteAddr=10.2.0.1:46316 status=200 url={"ForceQuery":false,"Fragment":"","Host":"","Opaque":"","Path":"/status","RawFragment":"","RawPath":"","RawQuery":"","Scheme":"","User":null}
2:34AM INF Ensure peers module=pex numDialing=0 numInPeers=0 numOutPeers=0 numToDial=128
2:34AM INF No addresses to dial. Falling back to seeds module=pex
2:34AM INF Dialing peer address={"id":"5115fbac6cdd98d387513cb5b32d34120fcd443a","ip":"10.2.0.2","port":26656} module=p2p
2:34AM INF Error reconnecting to peer. Trying again addr={"id":"5115fbac6cdd98d387513cb5b32d34120fcd443a","ip":"10.2.0.2","port":26656} err="auth failure: secret conn failed: EOF" module=p2p tries=2
2:34AM INF Served RPC HTTP response duration=0 method=GET module=rpc-server remoteAddr=10.2.0.1:47668 status=200 url={"ForceQuery":false,"Fragment":"","Host":"","Opaque":"","Path":"/status","RawFragment":"","RawPath":"","RawQuery":"","Scheme":"","User":null}
2:34AM INF Served RPC HTTP response duration=0 method=GET module=rpc-server remoteAddr=10.2.0.1:48858 status=200 url={"ForceQuery":false,"Fragment":"","Host":"","Opaque":"","Path":"/status","RawFragment":"","RawPath":"","RawQuery":"","Scheme":"","User":null}
2:34AM INF Served RPC HTTP response duration=0 method=GET module=rpc-server remoteAddr=10.2.0.1:50194 status=200 url={"ForceQuery":false,"Fragment":"","Host":"","Opaque":"","Path":"/status","RawFragment":"","RawPath":"","RawQuery":"","Scheme":"","User":null}
2:34AM INF HTTPJSONRPC args=[{}] method=status module=rpc-server returns=[{},{}]
2:34AM INF Served RPC HTTP response duration=0 method=POST module=rpc-server remoteAddr=127.0.0.1:56570 status=200 url={"ForceQuery":false,"Fragment":"","Host":"","Opaque":"","Path":"/","RawFragment":"","RawPath":"","RawQuery":"","Scheme":"","User":null}
2:34AM INF Stopping Node service impl={"Logger":{}}
2:34AM INF Stopping Node
2:34AM INF Stopping EventBus service impl={"Logger":{}} module=events
2:34AM INF Stopping PubSub service impl={"Logger":{}} module=pubsub
2:34AM INF Stopping IndexerService service impl={"Logger":{}} module=txindex
2:34AM INF Stopping P2P Switch service impl={"Logger":{}} module=p2p
2:34AM INF Stopping Evidence service impl={"Logger":{},"Switch":{"Logger":{}}} module=evidence
2:34AM INF Stopping StateSync service impl={"Logger":{},"Switch":{"Logger":{}}} module=statesync
2:34AM INF Stopping PEX service impl={"Logger":{},"Switch":{"Logger":{}}} module=pex
2:34AM INF Stopping AddrBook service book=/root/.simapp/config/addrbook.json impl={"Logger":{}} module=p2p
2:34AM INF Stopping Mempool service impl={"Logger":{},"Switch":{"Logger":{}}} module=mempool
2:34AM INF Stopping BlockchainReactor service impl={"Logger":{},"Switch":{"Logger":{}}}
 module=blockchain
2:34AM INF Stopping BlockPool service impl={"Logger":{}} module=blockchain
2:34AM INF Stopping Consensus service impl={"Logger":{},"Metrics":{"BlockIntervalSeconds":{},"BlockParts":{},"BlockSizeBytes":{},"ByzantineValidators":{},"ByzantineValidatorsPower":{},"CommittedHeight":{},"FastSyncing":{},"Height":{},"MissingValidators":{},"MissingValidatorsPower":{},"NumTxs":{},"Rounds":{},"StateSyncing":{},"TotalTxs":{},"ValidatorLastSignedHeight":{},"ValidatorMissedBlocks":{},"ValidatorPower":{},"Validators":{},"ValidatorsPower":{}},"Switch":{"Logger":{}}} module=consensus
2:34AM INF Saving AddrBook to file book=/root/.simapp/config/addrbook.json module=p2p size=0
2:34AM ERR Not stopping State service -- has not been started yet impl={"Logger":{},"commit_round":-1,"commit_time":"0001-01-01T00:00:00Z","height":196998,"last_commit":{"peer_maj_23s":{},"votes":["Vote{0:0000A011642C 196997/01/SIGNED_MSG_TYPE_PRECOMMIT(Precommit) 8A7E08CEB99B A5152A657CDF @ 2021-04-18T12:14:59.895219408Z}","nil-Vote","nil-Vote","Vote{3:10CFEF00EA19 196997/01/SIGNED_MSG_TYPE_PRECOMMIT(Precommit) 8A7E08CEB99B 172ACC3A8205 @ 2021-04-18T12:14:59.647182466Z}","Vote{4:117BBC9257C1 196997/01/SIGNED_MSG_TYPE_PRECOMMIT(Precommit) 8A7E08CEB99B 90B14398F500 @ 2021-04-18T12:14:59.937426481Z}","Vote{5:12DC67AE69E0 196997/01/SIGNED_MSG_TYPE_PRECOMMIT(Precommit) 8A7E08CEB99B F316A36961B6 @ 2021-04-18T12:14:59.947378424Z}","Vote{6:183E1186B992 196997/01/SIGNED_MSG_TYPE_PRECOMMIT(Precommit) 8A7E08CEB99B DD231235FD8C @ 2021-04-18T12:14:59.932722003Z}","Vote{7:18D6D411CDB0 196997/01/SIGNED_MSG_TYPE_PRECOMMIT(Precommit) 8A7E08CEB99B 863BA0546E6A @ 2021-04-18T12:14:59.915722517Z}","Vote{8:19BC91C1E2F6 196997/01/SIGNED_MSG_TYPE_PRECOMMIT(Precommit) 8A7E08CEB99B 8F97A371550A @ 2021-04-18T12:14:59.822441762Z}","Vote{9:1A7F64933F54 196997/01/SIGNED_MSG_TYPE_PRECOMMIT(Precommit) 8A7E08CEB99B 042E659A8775 @ 2021-04-18T12:14:59.684074361Z}","nil-Vote","Vote{11:1C008EA4394E 196997/01/SIGNED_MSG_TYPE_PRECOMMIT(Precommit) 8A7E08CEB99B B99C8CE8653A @ 2021-04-18T12:14:59.737461251Z}","nil-Vote","Vote{13:1ECE2EB9DDD2 196997/01/SIGNED_MSG_TYPE_PRECOMMIT(Precommit) 8A7E08CEB99B 594A72C3A5C1 @ 2021-04-18T12:14:59.855496511Z}","nil-Vote","Vote{15:21F52A13EEAE 196997/01/SIGNED_MSG_TYPE_PRECOMMIT(Precommit) 8A7E08CEB99B 9ADB981FBEC8 @ 2021-04-18T12:14:59.890389595Z}","Vote{16:245820609BC5 196997/01/SIGNED_MSG_TYPE_PRECOMMIT(Precommit) 8A7E08CEB99B 5D1A8B25A8AF @ 2021-04-18T12:14:59.74414038Z}","nil-Vote","Vote{18:28D49B389889 196997/01/SIGNED_MSG_TYPE_PRECOMMIT(Precommit) 8A7E08CEB99B 880ACFF01A07 @ 2021-04-18T12:14:59.726740273Z}","nil-Vote","Vote{20:31663C1DAFA3 196997/01/SIGNED_MSG_TYPE_PRECOMMIT(Precommit) 8A7E08CEB99B 295CAB3C979D @ 2021-04-18T12:14:59.914383176Z}","Vote{21:38CC9B96398A 196997/01/SIGNED_MSG_TYPE_PRECOMMIT(Precommit) 8A7E08CEB99B 45A08E0AEC80 @ 2021-04-18T12:14:59.762856393Z}","Vote{22:391404612738 196997/01/SIGNED_MSG_TYPE_PRECOMMIT(Precommit) 8A7E08CEB99B 213D433E9482 @ 2021-04-18T12:14:59.889859925Z}","Vote{23:3A528EE6C2C4 196997/01/SIGNED_MSG_TYPE_PRECOMMIT(Precommit) 8A7E08CEB99B E6A6C8E9E799 @ 2021-04-18T12:14:59.917459744Z}","Vote{24:3D8F7A7BA215 196997/01/SIGNED_MSG_TYPE_PRECOMMIT(Precommit) 8A7E08CEB99B 5E9AD8DBCADD @ 2021-04-18T12:14:59.854951626Z}","Vote{25:3DB24A4BFEAB 196997/01/SIGNED_MSG_TYPE_PRECOMMIT(Precommit) 8A7E08CEB99B BA81F9ED749A @ 2021-04-18T12:14:59.651848247Z}","nil-Vote","Vote{27:448315121F78 196997/01/SIGNED_MSG_TYPE_PRECOMMIT(Precommit) 8A7E08CEB99B 8B4753EDF79E @ 2021-04-18T12:14:59.911562362Z}","Vote{28:45415A7E8573 196997/01/SIGNED_MSG_TYPE_PRECOMMIT(Precommit) 8A7E08CEB99B B915BE87AD15 @ 2021-04-18T12:14:59.869026697Z}","Vote{29:4573BADB2523 196997/01/SIGNED_MSG_TYPE_PRECOMMIT(Precommit) 8A7E08CEB99B D0A152874DC7 @ 2021-04-18T12:14:59.876605082Z}","nil-Vote","Vote{31:4B2A7B3ACF94 196997/01/SIGNED_MSG_TYPE_PRECOMMIT(Precommit) 8A7E08CEB99B B438AAFBB65B @ 2021-04-18T12:14:59.698781279Z}","Vote{32:4D6A71797A5B 196997/01/SIGNED_MSG_TYPE_PRECOMMIT(Precommit) 8A7E08CEB99B AB3FB652D037 @ 2021-04-18T12:14:59.830662591Z}","nil-Vote","nil-Vote","Vote{35:519ED95F4D0A 196997/01/SIGNED_MSG_TYPE_PRECOMMIT(Precommit) 8A7E08CEB99B F54D79B665F4 @ 2021-04-18T12:14:59.79837055Z}","nil-Vote","Vote{37:52AF81CEFD1F 196997/01/SIGNED_MSG_TYPE_PRECOMMIT(Precommit) 8A7E08CEB99B 0D8EBCFAAC56 @ 2021-04-18T12:14:59.756251407Z}","Vote{38:52FC477F1623 196997/01/SIGNED_MSG_TYPE_PRECOMMIT(Precommit) 8A7E08CEB99B CE5E775113F3 @ 2021-04-18T12:14:59.597724074Z}","Vote{39:544B398778B8 196997/01/SIGNED_MSG_TYPE_PRECOMMIT(Precommit) 8A7E08CEB99B 737F69EC5F1E @ 2021-04-18T12:14:59.791501198Z}","Vote{40:54543FB81750 196997/01/SIGNED_MSG_TYPE_PRECOMMIT(Precommit) 8A7E08CEB99B BE6B860FB46A @ 2021-04-18T12:14:59.831175161Z}","nil-Vote","Vote{42:590AE27A804D 196997/01/SIGNED_MSG_TYPE_PRECOMMIT(Precommit) 8A7E08CEB99B 3A0F908A9B37 @ 2021-04-18T12:14:59.828089755Z}","nil-Vote","Vote{44:5C207BEA3338 196997/01/SIGNED_MSG_TYPE_PRECOMMIT(Precommit) 8A7E08CEB99B A610E6D0F383 @ 2021-04-18T12:14:59.744462841Z}","Vote{45:5FE6CBE370C8 196997/01/SIGNED_MSG_TYPE_PRECOMMIT(Precommit) 8A7E08CEB99B 6F75E6FFFFD6 @ 2021-04-18T12:14:59.87215486Z}","Vote{46:61DAE6DB77FB 196997/01/SIGNED_MSG_TYPE_PRECOMMIT(Precommit) 8A7E08CEB99B CEFB66B3399B @ 2021-04-18T12:15:00.024091802Z}","Vote{47:64111299F214 196997/01/SIGNED_MSG_TYPE_PRECOMMIT(Precommit) 8A7E08CEB99B B62B671DAC70 @ 2021-04-18T12:14:59.682351621Z}","Vote{48:65B9B19C858B 196997/01/SIGNED_MSG_TYPE_PRECOMMIT(Precommit) 8A7E08CEB99B 61D674036A02 @ 2021-04-18T12:14:59.602980897Z}","Vote{49:6898966C8A85 196997/01/SIGNED_MSG_TYPE_PRECOMMIT(Precommit) 8A7E08CEB99B 67AD174B2204 @ 2021-04-18T12:14:59.79407695Z}","Vote{50:69471AA0DBC1 196997/01/SIGNED_MSG_TYPE_PRECOMMIT(Precommit) 8A7E08CEB99B 1D2E264DF462 @ 2021-04-18T12:14:59.954985358Z}","nil-Vote","nil-Vote","nil-Vote","nil-Vote","Vote{55:71A85203AB61 196997/01/SIGNED_MSG_TYPE_PRECOMMIT(Precommit) 8A7E08CEB99B 143F6D230167 @ 2021-04-18T12:14:59.549744955Z}","nil-Vote","Vote{57:752E55A0D6CA 196997/01/SIGNED_MSG_TYPE_PRECOMMIT(Precommit) 8A7E08CEB99B F26ADB919410 @ 2021-04-18T12:14:59.646618037Z}","Vote{58:770AB3B34106 196997/01/SIGNED_MSG_TYPE_PRECOMMIT(Precommit) 8A7E08CEB99B C8FAD24F9F91 @ 2021-04-18T12:14:59.743889916Z}","nil-Vote","Vote{60:7A9F1B3F0B0E 196997/01/SIGNED_MSG_TYPE_PRECOMMIT(Precommit) 8A7E08CEB99B 36B0484CC74B @ 2021-04-18T12:14:59.702264446Z}","Vote{61:81DBFC76EC1D 196997/01/SIGNED_MSG_TYPE_PRECOMMIT(Precommit) 8A7E08CEB99B 3254B2BE1D7B @ 2021-04-18T12:14:59.765984178Z}","nil-Vote","Vote{63:8482AB39BDA9 196997/01/SIGNED_MSG_TYPE_PRECOMMIT(Precommit) 8A7E08CEB99B 33E024D35747 @ 2021-04-18T12:14:59.935787332Z}","Vote{64:86B418CD2D82 196997/01/SIGNED_MSG_TYPE_PRECOMMIT(Precommit) 8A7E08CEB99B 7958C9ABBC2E @ 2021-04-18T12:15:00.01677737Z}","nil-Vote","Vote{66:89712F54D908 196997/01/SIGNED_MSG_TYPE_PRECOMMIT(Precommit) 8A7E08CEB99B 6040B68497F0 @ 2021-04-18T12:14:59.849589783Z}","Vote{67:89CFD21C1BB2 196997/01/SIGNED_MSG_TYPE_PRECOMMIT(Precommit) 8A7E08CEB99B 560D16F91AC8 @ 2021-04-18T12:14:59.831276293Z}","Vote{68:8AA2A9374BEE 196997/01/SIGNED_MSG_TYPE_PRECOMMIT(Precommit) 8A7E08CEB99B AE08D78F4EF7 @ 2021-04-18T12:15:00.625919881Z}","nil-Vote","nil-Vote","Vote{71:99A4C7C53874 196997/01/SIGNED_MSG_TYPE_PRECOMMIT(Precommit) 8A7E08CEB99B F1A398F33FF4 @ 2021-04-18T12:14:59.789260096Z}","Vote{72:9A5491DB5E5D 196997/01/SIGNED_MSG_TYPE_PRECOMMIT(Precommit) 8A7E08CEB99B E30E5A38C7E1 @ 2021-04-18T12:14:59.92369464Z}","nil-Vote","Vote{74:9D66BE37915A 196997/01/SIGNED_MSG_TYPE_PRECOMMIT(Precommit) 8A7E08CEB99B 8571B1023FFA @ 2021-04-18T12:14:59.728899218Z}","Vote{75:9DA521AAB981 196997/01/SIGNED_MSG_TYPE_PRECOMMIT(Precommit) 8A7E08CEB99B 47CE6A6C5A3D @ 2021-04-18T12:14:59.893931938Z}","Vote{76:9F8893F14B30 196997/01/SIGNED_MSG_TYPE_PRECOMMIT(Precommit) 8A7E08CEB99B E4777D8D8534 @ 2021-04-18T12:14:59.675334731Z}","Vote{77:A06F1475247A 196997/01/SIGNED_MSG_TYPE_PRECOMMIT(Precommit) 8A7E08CEB99B D82AA11D7201 @ 2021-04-18T12:14:59.67416913Z}","Vote{78:A17A1E06D0A4 196997/01/SIGNED_MSG_TYPE_PRECOMMIT(Precommit) 8A7E08CEB99B 4728A230652C @ 2021-04-18T12:14:59.945498219Z}","Vote{79:A525FAAB8E89 196997/01/SIGNED_MSG_TYPE_PRECOMMIT(Precommit) 8A7E08CEB99B 01581D1ABC20 @ 2021-04-18T12:14:59.840927296Z}","nil-Vote","Vote{81:A6B57710AD89 196997/01/SIGNED_MSG_TYPE_PRECOMMIT(Precommit) 8A7E08CEB99B CF953E0395AD @ 2021-04-18T12:14:59.664186596Z}","nil-Vote","Vote{83:AAB6F2164396 196997/01/SIGNED_MSG_TYPE_PRECOMMIT(Precommit) 8A7E08CEB99B 9864E2C9B1E7 @ 2021-04-18T12:14:59.816318268Z}","Vote{84:AB3E625FDB7E 196997/01/SIGNED_MSG_TYPE_PRECOMMIT(Precommit) 8A7E08CEB99B B0613C92E23A @ 2021-04-18T12:14:59.759662682Z}","Vote{85:B6AF34335B74 196997/01/SIGNED_MSG_TYPE_PRECOMMIT(Precommit) 8A7E08CEB99B 242C05BE8CA4 @ 2021-04-18T12:14:59.932931036Z}","nil-Vote","Vote{87:B7E7C707A661 196997/01/SIGNED_MSG_TYPE_PRECOMMIT(Precommit) 8A7E08CEB99B 822276C83896 @ 2021-04-18T12:14:59.884577032Z}","nil-Vote","nil-Vote","nil-Vote","nil-Vote","nil-Vote","Vote{93:C7A7ADAA6ECC 196997/01/SIGNED_MSG_TYPE_PRECOMMIT(Precommit) 8A7E08CEB99B F70433A1E5F5 @ 2021-04-18T12:14:59.724179768Z}","nil-Vote","Vote{95:CB84A4916DAF 196997/01/SIGNED_MSG_TYPE_PRECOMMIT(Precommit) 8A7E08CEB99B C8942F103EF5 @ 2021-04-18T12:14:59.747431187Z}","Vote{96:CBD9F43E0F30 196997/01/SIGNED_MSG_TYPE_PRECOMMIT(Precommit) 8A7E08CEB99B D75549DB4726 @ 2021-04-18T12:14:59.883595201Z}","Vote{97:D34CCB0A8AEF 196997/01/SIGNED_MSG_TYPE_PRECOMMIT(Precommit) 8A7E08CEB99B 198445DF89A2 @ 2021-04-18T12:14:59.721143877Z}","Vote{98:D4EC26408087 196997/01/SIGNED_MSG_TYPE_PRECOMMIT(Precommit) 8A7E08CEB99B E21C76940930 @ 2021-04-18T12:14:59.742367872Z}","Vote{99:D59ECC0F8349 196997/01/SIGNED_MSG_TYPE_PRECOMMIT(Precommit) 8A7E08CEB99B 959362E5F1FE @ 2021-04-18T12:14:59.801494893Z}","Vote{100:D5D0560FCDF8 196997/01/SIGNED_MSG_TYPE_PRECOMMIT(Precommit) 8A7E08CEB99B 2B48EC49A5F7 @ 2021-04-18T12:14:59.64881478Z}","nil-Vote","Vote{102:D686CAB9B2C2 196997/01/SIGNED_MSG_TYPE_PRECOMMIT(Precommit) 8A7E08CEB99B 9C6BB33BD378 @ 2021-04-18T12:14:59.746157999Z}","Vote{103:D88AD92A4603 196997/01/SIGNED_MSG_TYPE_PRECOMMIT(Precommit) 8A7E08CEB99B 4A54A627F458 @ 2021-04-18T12:14:59.77419817Z}","Vote{104:DCED6624898B 196997/01/SIGNED_MSG_TYPE_PRECOMMIT(Precommit) 8A7E08CEB99B 6F393249270C @ 2021-04-18T12:14:59.707873773Z}","Vote{105:DE0CF951421C 196997/01/SIGNED_MSG_TYPE_PRECOMMIT(Precommit) 8A7E08CEB99B EF2E94968F78 @ 2021-04-18T12:14:59.814286048Z}","nil-Vote","Vote{107:E995A46B9B6D 196997/01/SIGNED_MSG_TYPE_PRECOMMIT(Precommit) 8A7E08CEB99B 167CBDD77349 @ 2021-04-18T12:14:59.848373426Z}","Vote{108:EAF01ECF1E9A 196997/01/SIGNED_MSG_TYPE_PRECOMMIT(Precommit) 8A7E08CEB99B 9A0322F2EBD1 @ 2021-04-18T12:14:59.677775369Z}","Vote{109:EAF96A684CE2 196997/01/SIGNED_MSG_TYPE_PRECOMMIT(Precommit) 8A7E08CEB99B BA0CF4CAEE33 @ 2021-04-18T12:14:59.775103618Z}","nil-Vote","Vote{111:EE1B34267A8C 196997/01/SIGNED_MSG_TYPE_PRECOMMIT(Precommit) 8A7E08CEB99B DFF4C4C09F64 @ 2021-04-18T12:14:59.754154671Z}","nil-Vote","Vote{113:F3B7F8F9E5EC 196997/01/SIGNED_MSG_TYPE_PRECOMMIT(Precommit) 8A7E08CEB99B 427CA831CA67 @ 2021-04-18T12:14:59.911333786Z}","Vote{114:F5A1C9D89ADE 196997/01/SIGNED_MSG_TYPE_PRECOMMIT(Precommit) 8A7E08CEB99B 0EE3064F6731 @ 2021-04-18T12:14:59.828897466Z}","Vote{115:F6F7F4FA090D 196997/01/SIGNED_MSG_TYPE_PRECOMMIT(Precommit) 8A7E08CEB99B B1BFC0B9238A @ 2021-04-18T12:14:59.780180895Z}","Vote{116:FB64033AABB3 196997/01/SIGNED_MSG_TYPE_PRECOMMIT(Precommit) 8A7E08CEB99B 4A8467A26890 @ 2021-04-18T12:14:59.837762589Z}","Vote{117:FF70808AC851 196997/01/SIGNED_MSG_TYPE_PRECOMMIT(Precommit) 8A7E08CEB99B B8A58193CE97 @ 2021-04-18T12:14:59.74759987Z}","Vote{118:FFE6EB4663E5 196997/01/SIGNED_MSG_TYPE_PRECOMMIT(Precommit) 8A7E08CEB99B 8FF72029B5D2 @ 2021-04-18T12:14:59.567920562Z}"],"votes_bit_array":"BA{119:x__xxxxxxx_x_x_xx_x_xxxxxx_xxx_xx__x_xxxx_x_xxxxxxx____x_xx_xx_xx_xxx__xx_xxxxxx_x_xxx_x_____x_xxxxxx_xxxx_xxx_x_xxxxxx} 81/119 = 0.68"},"last_validators":{"proposer":{"address":"874B00974ECC89940FA2BD2154991ACD05A596D7","proposer_priority":-54,"pub_key":"xIzHIAdR3aZcy/4NOFs82nHfebfnw3VAXPJZOnYZ4s8=","voting_power":1},"validators":[{"address":"0000A011642C7257A55B8CF0C483906DDE84C662","proposer_priority":-13,"pub_key":"+iweXQmRKCu1slxW2LsWPnyZZi5bRS/VlCV5df3Zm2s=","voting_power":1},{"address":"00BC1537CFE28E1491138D8D62C460CC8C12C6A7","proposer_priority":5,"pub_key":"wzKlKpQSEp1YSL+gYNU1x2aW+9SsH/+kgoH6QrFjKwU=","voting_power":1},{"address":"0F35498E5036E45CDC8C8B8BC1534CABEC918A29","proposer_priority":24,"pub_key":"zIBYhIhCssePUQbhAH+hE2eHw1SBm3ctkCIeEioioJ0=","voting_power":1},{"address":"10CFEF00EA194500F27EB0952B4C0E7C4C299636","proposer_priority":-51,"pub_key":"DjM/blDmS0Vez2X3q9/ZB9TOetdIAU9OdhjvAaH5shI=","voting_power":1},{"address":"117BBC9257C1C9BBE260BF385AB923E4660D2E9C","proposer_priority":-18,"pub_key":"GsNpxoQ5d7ubNRWiwB6JHWxg9zOhCMg50s1yZI4ES60=","voting_power":1},{"address":"12DC67AE69E0B17F09F90B1123BBD51D8CEBE7A5","proposer_priority":3,"pub_key":"azR2SYywpNMbHPs5BpfxWikHP6xkcA2wD5dOK7uyHUc=","voting_power":1},{"address":"183E1186B992E48EFE0717E0F6B57E1E0D9F6E95","proposer_priority":25,"pub_key":"Prv40f2Kcxad+d2JYkKgz2Qyzux15JQqYHGh7gUnv/c=","voting_power":1},{"address":"18D6D411CDB015CD46E531AEA5C4CDAF7607B8F5","proposer_priority":13,"pub_key":"iKK6U3622dDfblRwu+LwkKSG3mXU/jcCrZlEa4hc4O8=","voting_power":1},{"address":"19BC91C1E2F6A232D2AAC8E58D9CA69AA5592D6F","proposer_priority":15,"pub_key":"tE83b5X9qZqhxjktsSGJh/4CcCBx1maZqHwDOMJGXPg=","voting_power":1},{"address":"1A7F64933F54C3F25374512873B0190B9C0B0D93","proposer_priority":-30,"pub_key":"5R22RI0XWxpFH7hz395Dbt6vYv2uIIFqhESpp4AYDDI=","voting_power":1},{"address":"1BD74AE80BB7281FCA1095A27A4250654174BF44","proposer_priority":25,"pub_key":"lVBHCBIBDRC9mdps56ob94tEzjmyTiflxOmOEqX5Cjs=","voting_power":1},{"address":"1C008EA4394E5FA035ABCC4FF86FCF6F6C9AA327","proposer_priority":23,"pub_key":"Q2iI8RHP3XXaWdikjsmvKFLnTyJ2DYnEU9cknochUw8=","voting_power":1},{"address":"1EAA61788EC9F89C8419893F7269BDE8F6DEBE62","proposer_priority":-33,"pub_key":"4LNEHpBn9ZQES4Hd43c+utX0Htm3zCjsxxCH43GQNQk=","voting_power":1},{"address":"1ECE2EB9DDD293F3312821305F5405BBDA081238","proposer_priority":-2,"pub_key":"u8RpNoej23gbgiyunuWQO2g58VCbaY+QHg5xmBSR1Ys=","voting_power":1},{"address":"21CDA6B3132B6D782B45A56A48208A22C0B36D4E","proposer_priority":60,"pub_key":"RgVi37MhoukGO0nfRsk4aVWf+rD1/yxFSgxAad6vXK0=","voting_power":1},{"address":"21F52A13EEAECB6FDA8F2E50EA8099B951650285","proposer_priority":13,"pub_key":"e2WaT5qnE9v6lNBQUJYUqSLMfUnmN9HsoPuvhBLSJcs=","voting_power":1},{"address":"245820609BC563B2F55153EE021B1102B00B3AE2","proposer_priority":20,"pub_key":"HXmGXRqYXk8ukLkfcOTHEpQrTzSa41zzO2Y2W0NaLSY=","voting_power":1},{"address":"27CD156FF3493A5AF88A9C626EADE6C1B34082CF","proposer_priority":-2,"pub_key":"ELvzyuWU7gnAxdwU+cgSVXu76/qkJEbPnvvW2rwK47E=","voting_power":1},{"address":"28D49B389889BC966FC00F0858CE908C70B862F7","proposer_priority":-52,"pub_key":"Yxhgaz3uCXG/+nBBFXUzE028d58DfHgVm/Db+hVdiwU=","voting_power":1},{"address":"307FAE9A13CEE1F87908CED4A39D673C56A9AA0B","proposer_priority":-32,"pub_key":"VjfyN+lvTIvoFDVX4BpnT9sssezFDPK3wxOJuopCYL0=","voting_power":1},{"address":"31663C1DAFA38B2B753B8727D63FB9D03116D2AF","proposer_priority":-18,"pub_key":"96MokODjiYdKbRwC7i9ImLGqsaQBrKOLuQFKNnW1VrI=","voting_power":1},{"address":"38CC9B96398A1313E2F3F9AA8E08669C47A53020","proposer_priority":23,"pub_key":"zq7AwDHs+mlrI0kA+N1ezmRzrsDdwRRb1EO3VUIkAI0=","voting_power":1},{"address":"391404612738BB79F4117E9BE4CABED159683697","proposer_priority":26,"pub_key":"sNR8M4s3G5wOaQ2+2l6XcOmn7t7wullZJopgp272v64=","voting_power":1},{"address":"3A528EE6C2C422596E5909BC540969B8FEA05104","proposer_priority":-45,"pub_key":"QiIMktdviny9lV66pGBTkJgK1ioluOvkLh5GfIkjN/c=","voting_power":1},{"address":"3D8F7A7BA21557DB4BC23BBF2404D3654400EE43","proposer_priority":-9,"pub_key":"hjCrm/B0Ka+Tig33Sj2KoWznimE+3lbRprQjCWxn3HQ=","voting_power":1},{"address":"3DB24A4BFEAB5B38FF4B09537ED590B340776E03","proposer_priority":-22,"pub_key":"Pba4TVYuegfyUs4uGBgTrlK5Gxs84sPD11vfMP+7lO8=","voting_power":1},{"address":"3EA59AD07BC990B4AA76F203F93630CA40D6A82D","proposer_priority":11,"pub_key":"ZF/1JIGAKMkBEGtMp9H5Ec0c2x+oNkJNKhjv8Udc7gc=","voting_power":1},{"address":"448315121F7808D55ED01666EE01DF1543F15A22","proposer_priority":-18,"pub_key":"FdamrhsbyKUKyGPD2bw6M2hQhGl73PRmdKOxLUaX7uw=","voting_power":1},{"address":"45415A7E8573E006F7F536B14C754D5C079D7818","proposer_priority":58,"pub_key":"5JpN26mFff95rt328DBPGENTB1Lgt1CVzcSA8kWpMAY=","voting_power":1},{"address":"4573BADB25238B6634BF979E2A4CEE500435EB71","proposer_priority":-18,"pub_key":"LqUT69kMQZpIVlTZ0avM/YCa50AFQpAbN0zWQCYWy5I=","voting_power":1},{"address":"4B1B99D6FA14E4F935BB0C7E522BB0A10C62BD85","proposer_priority":-18,"pub_key":"3f0IhATVVO/e46irYZGVAPERvjO3CngfpLbhrb1fJ8Y=","voting_power":1},{"address":"4B2A7B3ACF94353E287F20175766CBE1084E3661","proposer_priority":27,"pub_key":"r2avkIHneKQFV77pLFStAcIFsh8UYYIPypWt02wQ4LI=","voting_power":1},{"address":"4D6A71797A5B807B04146060712367E879227ECB","proposer_priority":45,"pub_key":"Om2NIPurode+ejwm1pbkdv8YEM82UgmyFJGgJAt1Sy0=","voting_power":1},{"address":"4E0C9B1F4087B3AA8A8D6D03050A410AC3C5614E","proposer_priority":-18,"pub_key":"hnH9ADY8Uko1yj166Lkidwzn+U/oBPPeiXgG4dGrxfE=","voting_power":1},{"address":"4EC329FDBFA72E34B1873882FE497DFBB70645A0","proposer_priority":26,"pub_key":"rjUW/8UvEM8sU8tdaF1xTF0pXyNKsTzaSvbHJjTdDeI=","voting_power":1},{"address":"519ED95F4D0AE992627A5F120421530E6DE578F1","proposer_priority":26,"pub_key":"NjXwcjNdczAJCIk68nWd2jEDQaGXkqjY3iO6Nbqv2lU=","voting_power":1},{"address":"524245039F68533758D081071D0F556E530B8A83","proposer_priority":-32,"pub_key":"re96yuIrjJrV8kyjfTS6YlVfgQ2zh5E+HWbwmxBS5Rs=","voting_power":1},{"address":"52AF81CEFD1F78B344EED342F10B9FBAC7C234EE","proposer_priority":-13,"pub_key":"/m37xvGOce38LMe8Vj3yQG+OLDULfqiOhYx7MUw5ZbU=","voting_power":1},{"address":"52FC477F1623653DFD9E98A1A7D0F367928E0063","proposer_priority":-18,"pub_key":"pMgXytDTEV6xeseLgU3zFCrryhEyy4sqmqdTQCszHx4=","voting_power":1},{"address":"544B398778B85AD1C891BE62B447B5B91E5FE9B7","proposer_priority":4,"pub_key":"ZFm2YJRyAlgWGLPMum7rspaTTrrvunQUCpqXmBlZ8Xs=","voting_power":1},{"address":"54543FB8175029C5801A8878AF2098A585E29606","proposer_priority":13,"pub_key":"V02KnQ/Q9woI0ElaJ7fVmuFNHiFNNdQRrdWRw85jhzE=","voting_power":1},{"address":"56C49B70A917CCF07A420D98DAD6BA204FF5B3A1","proposer_priority":57,"pub_key":"QveqUTEyZ+2smzRQeeQ3+ChqpxuFKtijjiUOLcXQTAk=","voting_power":1},{"address":"590AE27A804DE7457EB2EA258951AA4FDB2A9746","proposer_priority":-10,"pub_key":"dHZ8oS8a9S7mgH0EoCYpsDgFV3SuTeAXPx8juVPQ2Aw=","voting_power":1},{"address":"5B7379EA8008A8996D5AD34FCB6C26156F7AF888","proposer_priority":-32,"pub_key":"u9wdfR+qPVOcHvQOhxDUPaSeBMN5j3GpEFEKjDrO9kk=","voting_power":1},{"address":"5C207BEA3338E820D5359EEBE96186C337B8F165","proposer_priority":-14,"pub_key":"h3l9bWeZ0p1h7x3p3w/pIYWfEtpvIVslSiA/eXED/AQ=","voting_power":1},{"address":"5FE6CBE370C8503595BADB187EDD60115787DCE3","proposer_priority":-51,"pub_key":"Yd44PpD2Z7GAvFgx+8VC9g4f/sg6jDV/0hKA67RmOvE=","voting_power":1},{"address":"61DAE6DB77FBD877EB2CFCDA61DF0085D60FEAEC","proposer_priority":-17,"pub_key":"vgtz4GLKwn/cxoiUmE4xjI2hTSqJoO7grOv5cvEmdbE=","voting_power":1},{"address":"64111299F214CBF71A6537BDDE6B4A6A9BB32CCE","proposer_priority":27,"pub_key":"MIlVMvQ+CIBxPurjek6LjKHuanazgBLujac5lHe79gY=","voting_power":1},{"address":"65B9B19C858B32161B8EDA89B918D23596E12989","proposer_priority":-3,"pub_key":"Xh1+PEY/8SsBNmfBLU8CWVtQHDVVlryqXdEVyEGxsx4=","voting_power":1},{"address":"6898966C8A85143EEEDB1DBD3EAB6C684F529A75","proposer_priority":-12,"pub_key":"eMQHdfEeHCnpcCQ5TaSiBtM7jB7r2tzv0iWpI0mOTSQ=","voting_power":1},{"address":"69471AA0DBC1B27405F112E26A2AE9E34A2951B2","proposer_priority":15,"pub_key":"t6MWozuIVDjdgoqCy1PPOrUtz8X094r3fu55t6K32/g=","voting_power":1},{"address":"6B9DFC20229B8122D4711294B52A6BC7CB2F3FCB","proposer_priority":-33,"pub_key":"IU/A97RbraOAeA4Ffbwtz/QhxYsEn2CaYMGLFwdDmEI=","voting_power":1},{"address":"6C4BB447EF7B6293E8B4E396937732570CD1245D","proposer_priority":1,"pub_key":"oEmFMGkVXPK5AN4mf9c0ou20Fwc+4P9HDhHHH54N0yA=","voting_power":1},{"address":"6D0124B1B839C0E8688CC3E11E2EB7F4643A3283","proposer_priority":-35,"pub_key":"z9GM2L83LJEcHVtnimV8pTKipCfFIYtw7OOyliUHHYw=","voting_power":1},{"address":"71424E5025F1C17BA80AA867124165B3DE723267","proposer_priority":-18,"pub_key":"+uLhQy+HHnR6Pjf9VplAsZg094XqovUWxsSMVs2smSU=","voting_power":1},{"address":"71A85203AB61D2B18E65F9E0F85E27E8A8A3F23E","proposer_priority":26,"pub_key":"E3hdhvQAEYMHRy30F2Rnpem8ftW3zN6kabJ3Zb/t30k=","voting_power":1},{"address":"73E9C52B552826D3D074503407B2A514054FD73E","proposer_priority":64,"pub_key":"aXL+/Fg1FCMDsjDcKWOnaYyUjvax+vzvRf9Y29ITAPM=","voting_power":1},{"address":"752E55A0D6CAA2E293CA0464B5967815A6701068","proposer_priority":-18,"pub_key":"rhK2BZPgmTYg+kp0cBhsYE0KxfqZRlAFzPRXDtOrIpA=","voting_power":1},{"address":"770AB3B34106CA541E1EC8081550462562129370","proposer_priority":-18,"pub_key":"rXmo7L/AkMFjGcbEzl6+9gk3e3GBTSmnnrsBnlVbImw=","voting_power":1},{"address":"77725F66823E66C0707498C7F7B9441F66EED11A","proposer_priority":-32,"pub_key":"WkK3hfvO5yDy8muYJNMRFldQbMNcX4l2RKkjpt77Mms=","voting_power":1},{"address":"7A9F1B3F0B0EB7FD1A959C715F37BCA6DF39BF62","proposer_priority":-53,"pub_key":"OTyPF69htOCv6m/NF3B3Xk5oWOuzzz9YAL8jDc1UMhM=","voting_power":1},{"address":"81DBFC76EC1D2AAB2727D71DF406ECBFE797C39A","proposer_priority":3,"pub_key":"+bE1gukRUw7PITCbLbYNzlOFLhBP/IpZKzcNwvJRoXk=","voting_power":1},{"address":"82B18AE2C4DA4AB43F14222C09DA341EBE1D4569","proposer_priority":23,"pub_key":"qWAPlbdrCe4iEMgT4Og/rse6iu60IR4j14KA1wKmU3c=","voting_power":1},{"address":"8482AB39BDA9AF0CB2AADD8DDD382BDDE1800F17","proposer_priority":-31,"pub_key":"haeHVMXp3sTOjdZbeSBdB1e/fIhVCPA6/hagRRTn22U=","voting_power":1},{"address":"86B418CD2D8217BE747B4F92F9D99B55D1274393","proposer_priority":-11,"pub_key":"Dgm1OzZeU065AReI9pYHZsPpawu3qUGMF4pG6Rh4SJQ=","voting_power":1},{"address":"874B00974ECC89940FA2BD2154991ACD05A596D7","proposer_priority":-54,"pub_key":"xIzHIAdR3aZcy/4NOFs82nHfebfnw3VAXPJZOnYZ4s8=","voting_power":1},{"address":"89712F54D908B64F5090356C9412E73E60332B2E","proposer_priority":-36,"pub_key":"48QmMJWUEPqAb0b8DKuUYBc4NT8tWgnqbLfn3zI7al4=","voting_power":1},{"address":"89CFD21C1BB2C999B7CDF1983224ADE8C78E0D1E","proposer_priority":52,"pub_key":"KYXKr8EYUQTnN3wHeZ+WB0RqjKJ3v2kNz6cjDjId/Yw=","voting_power":1},{"address":"8AA2A9374BEE99CCF880D9542D0973F53A7F985C","proposer_priority":64,"pub_key":"s61pscZctI8B/vo+HEQp03849i1B0pOE86mBpKHdGi0=","voting_power":1},{"address":"8C0BBA3F9979EB304AF5D04435C12A6BCD659B14","proposer_priority":12,"pub_key":"HN5zytXy7/tafyF+zXLlUJM8JC6XYNnOmuOOfT2zsKM=","voting_power":1},{"address":"8C8CF9A7320345030F9B93D1151A8BE9C3CA0A61","proposer_priority":-18,"pub_key":"eoZxX/NcW9ptJpVoIzSWIcCudgxR9x+nL/Y6l++uq3c=","voting_power":1},{"address":"99A4C7C538746C17E6B73BA608534C514985E65B","proposer_priority":-15,"pub_key":"uQQwwasmU7idaG57+E+lgEyCap45ujDT5RgzoiDOZGk=","voting_power":1},{"address":"9A5491DB5E5D1FC0A996E604B6A28F9CBAD32DA3","proposer_priority":-39,"pub_key":"/mIYN/h8E9HllVBy1atAIHX5ivzVjjabXbKXr1vzAdg=","voting_power":1},{"address":"9AAEB33E7F234C6D4FF68A2E8582E1D5B5E5F126","proposer_priority":3,"pub_key":"uPFA0rUIcH8Qfq53Ll5MyUVfv8d4TDlKQxY+7ss8P6E=","voting_power":1},{"address":"9D66BE37915A229FC7F8DFB24F7C47E5D86C6A5F","proposer_priority":-51,"pub_key":"RE6V5f1XpqjskeZvf2q5i3RO4dYED75nh6pflZIv3FA=","voting_power":1},{"address":"9DA521AAB98169E75125C0C3F42ED7A5E048038E","proposer_priority":-43,"pub_key":"+5hgxLez8NuPFvSdlr0dGHDCvr3bIQwuOYlWCHWBL+k=","voting_power":1},{"address":"9F8893F14B30FC45F5BE438A0230431E0DA8B3A0","proposer_priority":25,"pub_key":"4HR7xm5b+Q6KhWp0Zsp18GI1o2Y/G9zsgYxu6lX7X0U=","voting_power":1},{"address":"A06F1475247A4E40CC6CB7A85FE1FECB26B16637","proposer_priority":17,"pub_key":"+HPt2R3e3CVkqO9KD/SBfcct33wfoBZ/F06bQbSIDJI=","voting_power":1},{"address":"A17A1E06D0A462E3C81F18D794DB24CE27A17BE6","proposer_priority":46,"pub_key":"q57VwuRuLKcRzTwSG5yXpl+1sE33c6ADkuiRf05ZQTw=","voting_power":1},{"address":"A525FAAB8E893AD942383A678C02591C492CFBEA","proposer_priority":-14,"pub_key":"hnMElc3vXDjEwmhPEZKAKIH4pkedFi7H08G+PL8dkhg=","voting_power":1},{"address":"A58F1719959DC32561788DFE58428BCB64895267","proposer_priority":46,"pub_key":"hZcMwzN/VkkIf93OADB/YJ1WfniP6pBA4dNi+zaLJxs=","voting_power":1},{"address":"A6B57710AD89044898344DA3078AD5C9BEACEB3B","proposer_priority":40,"pub_key":"S/8y3DrCKlJcsAnUfaWY8OVWl/ox8PRABCwh3WK3Hk4=","voting_power":1},{"address":"A6BC429BEF68A8C4E9E4EE669E99016661A9B5DF","proposer_priority":-18,"pub_key":"mYNAczro4JFQOVPx0pe5BR94cWzts1mnBFpscdgzWZg=","voting_power":1},{"address":"AAB6F2164396D8C066CD93629A55A044D9B70F82","proposer_priority":23,"pub_key":"zorOml4RGVbYY4TxUmdNt5PVX3L7LxFogBOyL+FRUnM=","voting_power":1},{"address":"AB3E625FDB7EA4566C4061CAEB3F6AE92435E569","proposer_priority":-18,"pub_key":"ojPOetm6WTy9PM6NiDXVpAmMSOncRgznt0QVxfEy098=","voting_power":1},{"address":"B6AF34335B7489D002A96D8AA21FC70D63EF2BBA","proposer_priority":-32,"pub_key":"U4FDog1EBLIc28CMKD35Uf4mAjvmh5vwvsMpRDp9UmI=","voting_power":1},{"address":"B75BCD6DDC16EEE9F08E09A2EE194346F96C043D","proposer_priority":37,"pub_key":"i9sWEFW7cWT9riIlskUQ6bfWmf4tud352ReH4Ey40C0=","voting_power":1},{"address":"B7E7C707A6612DC16977EE3EE3B8C1C9569FFEDA","proposer_priority":6,"pub_key":"RTlT3rcTfmAbsiNhkV9p9Fx3SrwLX5cosLS6lC1YplQ=","voting_power":1},{"address":"B8EF323DAE5224C8ABC98FDF2EF01BB3FE105101","proposer_priority":17,"pub_key":"qnGqtRjNW6t3soXqSWlVHhaG9ySOuoPSrS+Wm4JRzfY=","voting_power":1},{"address":"BB9784D7AAFE236BD87329E576425EBC6833EC99","proposer_priority":26,"pub_key":"oYvKAReQxtflc+q9eAGcXVmUgpohyjp+GunCqhX9e6E=","voting_power":1},{"address":"BD5D222267997ADFE612A759D5D1FF4C3892E0C3","proposer_priority":10,"pub_key":"YuVBprI/uOHwjf6lFkvxVZaXvmHItDXiARw54xp0iHY=","voting_power":1},{"address":"BFB406202B0149DF14DBDAA862BB4762B6C09AA3","proposer_priority":-17,"pub_key":"3fayhxq8UFaEIMYBuGvwIx9XgWldqMvGinapS8GEsas=","voting_power":1},{"address":"C5F7ADA535E6DEE90779A837B58544B5333901F3","proposer_priority":-51,"pub_key":"+jnYrMKPWqj5cCg626tk5EF7nTSxME326hmNEPxv2X4=","voting_power":1},{"address":"C7A7ADAA6ECC510D3754842E810FFFE67A1A0DFF","proposer_priority":23,"pub_key":"1sjg2wPUjDxCVY2/wnfmPFMIi4nigccS6K2gDdSzFuU=","voting_power":1},{"address":"CB7555DDB14EDAD00C2240BF92D71C6F3AE56702","proposer_priority":-17,"pub_key":"ADgT0W6VGu1gTUA1nkb3t4OUsDmCLEq7h2S3FNjYSIU=","voting_power":1},{"address":"CB84A4916DAF98139790926CAAD30C7FFCD48D00","proposer_priority":-52,"pub_key":"Q4Dq1FbUrg8ar5DPYmq0GMpayvv8O++vU8xIo/MXAYM=","voting_power":1},{"address":"CBD9F43E0F301F272884E787CE1771B5144759FC","proposer_priority":-17,"pub_key":"oo/cCB8HM74STnjJyV/FdtXgRB5khYS9JBtc3eqUeSM=","voting_power":1},{"address":"D34CCB0A8AEF3DD03B30E7E25E229143E34E7697","proposer_priority":15,"pub_key":"89HJLaYlHX9ppg1Vcb8ebGnODfnxuVqm5PAXyJ/3WJo=","voting_power":1},{"address":"D4EC26408087B77E8D307DAE9EE45F080A6152D5","proposer_priority":-25,"pub_key":"0Kxq4Qga0pxk6Q80eueD/NFIV/ziUIOGDPjintRkklA=","voting_power":1},{"address":"D59ECC0F8349A5C23DF6DBCCFFDC3E726359EECE","proposer_priority":-38,"pub_key":"sj/yZifq8zy4mglkc1uH5bqsMdTY2Ih93QlnqMlxbx8=","voting_power":1},{"address":"D5D0560FCDF841800B7AE3C99A24CB1AADCD8C68","proposer_priority":5,"pub_key":"VRUwgOFobyq3Zb+oXIWH8KRj2ThzvK64AME7DcrayJI=","voting_power":1},{"address":"D6867F83C7720A930DD7AE8652BB32AF5BC274B3","proposer_priority":33,"pub_key":"L38JGaLt141SRk4GYea5wKsyHhUv7FUG0aYHfnrTJhU=","voting_power":1},{"address":"D686CAB9B2C29A95F00B94932811927420AC0E5E","proposer_priority":64,"pub_key":"ZY853CaaFMHdL6qbg3OrjBS/1dtdfkheYmT4MWzjIBk=","voting_power":1},{"address":"D88AD92A4603B89FC94C2309A67E30CD08481534","proposer_priority":-52,"pub_key":"EBANIruHmbbpvCDVMCe3ljpdCrsx43v5bowZG2BPECI=","voting_power":1},{"address":"DCED6624898B070382484AD7B737D83E60AD00ED","proposer_priority":-17,"pub_key":"M5GiRsL3g+JHtHXtXF67PhtEz/l3VpX1zFzhzDtopHQ=","voting_power":1},{"address":"DE0CF951421CB4A4F4DCD3ED579C6E22FCEDF208","proposer_priority":26,"pub_key":"uN3ms02bWCVAjiMCywFe9PdJH8xfK1VOf+E6vrkrN5s=","voting_power":1},{"address":"E86EE4C61C36AA342A2D83D9DA7D6EDA3DF09271","proposer_priority":29,"pub_key":"nUY8mM4eaGuX03vW3x+ufuLoziyssLSMQSLfReuDoPE=","voting_power":1},{"address":"E995A46B9B6D19F261557FC057AA6A6AE9B1F97C","proposer_priority":24,"pub_key":"ylYX2N2LT9Sv7N8F1GeaSGSSocbM0TZhiWuOAZ+Ivm8=","voting_power":1},{"address":"EAF01ECF1E9AB40116F79CE39A9A699699E9F67D","proposer_priority":45,"pub_key":"yUO1Hwz3hdY9CYGas+gXGd46LCe3SXvXGivUKVj+Rkg=","voting_power":1},{"address":"EAF96A684CE2633DB6CACBF44717476BA067347B","proposer_priority":51,"pub_key":"Ew0v4nx3EYW4V6g+kIW0Spbc85Yob+i9kT4d4s6SPUI=","voting_power":1},{"address":"EDE5AE276268ACB44A735F4C097A49A4A9BB4261","proposer_priority":35,"pub_key":"lNYaZQwncHnUQLBJfRpr+xzjcICokTmzPlYj30IEBl0=","voting_power":1},{"address":"EE1B34267A8C4C14835B05F938DDD38842E6510B","proposer_priority":-20,"pub_key":"hSVG6PEkVXpyryJoSEgJtT7PRnS4yfC9Eg/0XqtuGjg=","voting_power":1},{"address":"F3372A41204EB238BBBC485285FD13102191A88E","proposer_priority":16,"pub_key":"VM3XudHuJickkwEqrV9K04aXesHmjb0RuVAuhZ4S/vU=","voting_power":1},{"address":"F3B7F8F9E5EC2DC531CE79E9A2C8A8A539BA8C58","proposer_priority":24,"pub_key":"gTBfGM0iK9dF5T20TzGD6dJ7g9Zg2YQJ3hY88SYkL80=","voting_power":1},{"address":"F5A1C9D89ADE33E1491A4B7FFD6BAA8C7E9FF9B3","proposer_priority":-35,"pub_key":"eH2QlVVryzHXZflvf1OzDj0302LxXTa+FUhzmYUWdhU=","voting_power":1},{"address":"F6F7F4FA090D5ED24E085B3B3B0CBEC94CDCEE43","proposer_priority":24,"pub_key":"zpdOHmko0p0R9nrJcg3inFsxhwcjeBuy3awNrQzflEw=","voting_power":1},{"address":"FB64033AABB3287835FC84E75B8CC670FD374437","proposer_priority":9,"pub_key":"z9yATV+DXb3DDNmT/GFlu1jRfqw8sUyqhE8kNROX9jE=","voting_power":1},{"address":"FF70808AC8514ABE4F397E5107E84BF6A2FE6797","proposer_priority":59,"pub_key":"jxqtukqhf2eJXHV2fbP75SjYPc44W9QKUj6UxpmNLiw=","voting_power":1},{"address":"FFE6EB4663E5522402752982120B4CBE743872A8","proposer_priority":26,"pub_key":"kD6Zqqc8HJIdPByKLWJ7MYaseNgBmg7wNYYQGiu2HzQ=","voting_power":1}]},"locked_block":null,"locked_block_parts":null,"locked_round":-1,"proposal":null,"proposal_block":null,"proposal_block_parts":null,"round":0,"start_time":"2021-04-19T02:32:04.722116433Z","step":1,"triggered_timeout_precommit":false,"valid_block":null,"valid_block_parts":null,"valid_round":-1,"validators":{"proposer":{"address":"73E9C52B552826D3D074503407B2A514054FD73E","proposer_priority":-54,"pub_key":"aXL+/Fg1FCMDsjDcKWOnaYyUjvax+vzvRf9Y29ITAPM=","voting_power":1},"validators":[{"address":"0000A011642C7257A55B8CF0C483906DDE84C662","proposer_priority":-12,"pub_key":"+iweXQmRKCu1slxW2LsWPnyZZi5bRS/VlCV5df3Zm2s=","voting_power":1},{"address":"00BC1537CFE28E1491138D8D62C460CC8C12C6A7","proposer_priority":6,"pub_key":"wzKlKpQSEp1YSL+gYNU1x2aW+9SsH/+kgoH6QrFjKwU=","voting_power":1},{"address":"0F35498E5036E45CDC8C8B8BC1534CABEC918A29","proposer_priority":25,"pub_key":"zIBYhIhCssePUQbhAH+hE2eHw1SBm3ctkCIeEioioJ0=","voting_power":1},{"address":"10CFEF00EA194500F27EB0952B4C0E7C4C299636","proposer_priority":-50,"pub_key":"DjM/blDmS0Vez2X3q9/ZB9TOetdIAU9OdhjvAaH5shI=","voting_power":1},{"address":"117BBC9257C1C9BBE260BF385AB923E4660D2E9C","proposer_priority":-17,"pub_key":"GsNpxoQ5d7ubNRWiwB6JHWxg9zOhCMg50s1yZI4ES60=","voting_power":1},{"address":"12DC67AE69E0B17F09F90B1123BBD51D8CEBE7A5","proposer_priority":4,"pub_key":"azR2SYywpNMbHPs5BpfxWikHP6xkcA2wD5dOK7uyHUc=","voting_power":1},{"address":"183E1186B992E48EFE0717E0F6B57E1E0D9F6E95","proposer_priority":26,"pub_key":"Prv40f2Kcxad+d2JYkKgz2Qyzux15JQqYHGh7gUnv/c=","voting_power":1},{"address":"18D6D411CDB015CD46E531AEA5C4CDAF7607B8F5","proposer_priority":14,"pub_key":"iKK6U3622dDfblRwu+LwkKSG3mXU/jcCrZlEa4hc4O8=","voting_power":1},{"address":"19BC91C1E2F6A232D2AAC8E58D9CA69AA5592D6F","proposer_priority":16,"pub_key":"tE83b5X9qZqhxjktsSGJh/4CcCBx1maZqHwDOMJGXPg=","voting_power":1},{"address":"1A7F64933F54C3F25374512873B0190B9C0B0D93","proposer_priority":-29,"pub_key":"5R22RI0XWxpFH7hz395Dbt6vYv2uIIFqhESpp4AYDDI=","voting_power":1},{"address":"1BD74AE80BB7281FCA1095A27A4250654174BF44","proposer_priority":26,"pub_key":"lVBHCBIBDRC9mdps56ob94tEzjmyTiflxOmOEqX5Cjs=","voting_power":1},{"address":"1C008EA4394E5FA035ABCC4FF86FCF6F6C9AA327","proposer_priority":24,"pub_key":"Q2iI8RHP3XXaWdikjsmvKFLnTyJ2DYnEU9cknochUw8=","voting_power":1},{"address":"1EAA61788EC9F89C8419893F7269BDE8F6DEBE62","proposer_priority":-32,"pub_key":"4LNEHpBn9ZQES4Hd43c+utX0Htm3zCjsxxCH43GQNQk=","voting_power":1},{"address":"1ECE2EB9DDD293F3312821305F5405BBDA081238","proposer_priority":-1,"pub_key":"u8RpNoej23gbgiyunuWQO2g58VCbaY+QHg5xmBSR1Ys=","voting_power":1},{"address":"21CDA6B3132B6D782B45A56A48208A22C0B36D4E","proposer_priority":61,"pub_key":"RgVi37MhoukGO0nfRsk4aVWf+rD1/yxFSgxAad6vXK0=","voting_power":1},{"address":"21F52A13EEAECB6FDA8F2E50EA8099B951650285","proposer_priority":14,"pub_key":"e2WaT5qnE9v6lNBQUJYUqSLMfUnmN9HsoPuvhBLSJcs=","voting_power":1},{"address":"245820609BC563B2F55153EE021B1102B00B3AE2","proposer_priority":21,"pub_key":"HXmGXRqYXk8ukLkfcOTHEpQrTzSa41zzO2Y2W0NaLSY=","voting_power":1},{"address":"27CD156FF3493A5AF88A9C626EADE6C1B34082CF","proposer_priority":-1,"pub_key":"ELvzyuWU7gnAxdwU+cgSVXu76/qkJEbPnvvW2rwK47E=","voting_power":1},{"address":"28D49B389889BC966FC00F0858CE908C70B862F7","proposer_priority":-51,"pub_key":"Yxhgaz3uCXG/+nBBFXUzE028d58DfHgVm/Db+hVdiwU=","voting_power":1},{"address":"307FAE9A13CEE1F87908CED4A39D673C56A9AA0B","proposer_priority":-31,"pub_key":"VjfyN+lvTIvoFDVX4BpnT9sssezFDPK3wxOJuopCYL0=","voting_power":1},{"address":"31663C1DAFA38B2B753B8727D63FB9D03116D2AF","proposer_priority":-17,"pub_key":"96MokODjiYdKbRwC7i9ImLGqsaQBrKOLuQFKNnW1VrI=","voting_power":1},{"address":"38CC9B96398A1313E2F3F9AA8E08669C47A53020","proposer_priority":24,"pub_key":"zq7AwDHs+mlrI0kA+N1ezmRzrsDdwRRb1EO3VUIkAI0=","voting_power":1},{"address":"391404612738BB79F4117E9BE4CABED159683697","proposer_priority":27,"pub_key":"sNR8M4s3G5wOaQ2+2l6XcOmn7t7wullZJopgp272v64=","voting_power":1},{"address":"3A528EE6C2C422596E5909BC540969B8FEA05104","proposer_priority":-44,"pub_key":"QiIMktdviny9lV66pGBTkJgK1ioluOvkLh5GfIkjN/c=","voting_power":1},{"address":"3D8F7A7BA21557DB4BC23BBF2404D3654400EE43","proposer_priority":-8,"pub_key":"hjCrm/B0Ka+Tig33Sj2KoWznimE+3lbRprQjCWxn3HQ=","voting_power":1},{"address":"3DB24A4BFEAB5B38FF4B09537ED590B340776E03","proposer_priority":-21,"pub_key":"Pba4TVYuegfyUs4uGBgTrlK5Gxs84sPD11vfMP+7lO8=","voting_power":1},{"address":"3EA59AD07BC990B4AA76F203F93630CA40D6A82D","proposer_priority":12,"pub_key":"ZF/1JIGAKMkBEGtMp9H5Ec0c2x+oNkJNKhjv8Udc7gc=","voting_power":1},{"address":"448315121F7808D55ED01666EE01DF1543F15A22","proposer_priority":-17,"pub_key":"FdamrhsbyKUKyGPD2bw6M2hQhGl73PRmdKOxLUaX7uw=","voting_power":1},{"address":"45415A7E8573E006F7F536B14C754D5C079D7818","proposer_priority":59,"pub_key":"5JpN26mFff95rt328DBPGENTB1Lgt1CVzcSA8kWpMAY=","voting_power":1},{"address":"4573BADB25238B6634BF979E2A4CEE500435EB71","proposer_priority":-17,"pub_key":"LqUT69kMQZpIVlTZ0avM/YCa50AFQpAbN0zWQCYWy5I=","voting_power":1},{"address":"4B1B99D6FA14E4F935BB0C7E522BB0A10C62BD85","proposer_priority":-17,"pub_key":"3f0IhATVVO/e46irYZGVAPERvjO3CngfpLbhrb1fJ8Y=","voting_power":1},{"address":"4B2A7B3ACF94353E287F20175766CBE1084E3661","proposer_priority":28,"pub_key":"r2avkIHneKQFV77pLFStAcIFsh8UYYIPypWt02wQ4LI=","voting_power":1},{"address":"4D6A71797A5B807B04146060712367E879227ECB","proposer_priority":46,"pub_key":"Om2NIPurode+ejwm1pbkdv8YEM82UgmyFJGgJAt1Sy0=","voting_power":1},{"address":"4E0C9B1F4087B3AA8A8D6D03050A410AC3C5614E","proposer_priority":-17,"pub_key":"hnH9ADY8Uko1yj166Lkidwzn+U/oBPPeiXgG4dGrxfE=","voting_power":1},{"address":"4EC329FDBFA72E34B1873882FE497DFBB70645A0","proposer_priority":27,"pub_key":"rjUW/8UvEM8sU8tdaF1xTF0pXyNKsTzaSvbHJjTdDeI=","voting_power":1},{"address":"519ED95F4D0AE992627A5F120421530E6DE578F1","proposer_priority":27,"pub_key":"NjXwcjNdczAJCIk68nWd2jEDQaGXkqjY3iO6Nbqv2lU=","voting_power":1},{"address":"524245039F68533758D081071D0F556E530B8A83","proposer_priority":-31,"pub_key":"re96yuIrjJrV8kyjfTS6YlVfgQ2zh5E+HWbwmxBS5Rs=","voting_power":1},{"address":"52AF81CEFD1F78B344EED342F10B9FBAC7C234EE","proposer_priority":-12,"pub_key":"/m37xvGOce38LMe8Vj3yQG+OLDULfqiOhYx7MUw5ZbU=","voting_power":1},{"address":"52FC477F1623653DFD9E98A1A7D0F367928E0063","proposer_priority":-17,"pub_key":"pMgXytDTEV6xeseLgU3zFCrryhEyy4sqmqdTQCszHx4=","voting_power":1},{"address":"544B398778B85AD1C891BE62B447B5B91E5FE9B7","proposer_priority":5,"pub_key":"ZFm2YJRyAlgWGLPMum7rspaTTrrvunQUCpqXmBlZ8Xs=","voting_power":1},{"address":"54543FB8175029C5801A8878AF2098A585E29606","proposer_priority":14,"pub_key":"V02KnQ/Q9woI0ElaJ7fVmuFNHiFNNdQRrdWRw85jhzE=","voting_power":1},{"address":"56C49B70A917CCF07A420D98DAD6BA204FF5B3A1","proposer_priority":58,"pub_key":"QveqUTEyZ+2smzRQeeQ3+ChqpxuFKtijjiUOLcXQTAk=","voting_power":1},{"address":"590AE27A804DE7457EB2EA258951AA4FDB2A9746","proposer_priority":-9,"pub_key":"dHZ8oS8a9S7mgH0EoCYpsDgFV3SuTeAXPx8juVPQ2Aw=","voting_power":1},{"address":"5B7379EA8008A8996D5AD34FCB6C26156F7AF888","proposer_priority":-31,"pub_key":"u9wdfR+qPVOcHvQOhxDUPaSeBMN5j3GpEFEKjDrO9kk=","voting_power":1},{"address":"5C207BEA3338E820D5359EEBE96186C337B8F165","proposer_priority":-13,"pub_key":"h3l9bWeZ0p1h7x3p3w/pIYWfEtpvIVslSiA/eXED/AQ=","voting_power":1},{"address":"5FE6CBE370C8503595BADB187EDD60115787DCE3","proposer_priority":-50,"pub_key":"Yd44PpD2Z7GAvFgx+8VC9g4f/sg6jDV/0hKA67RmOvE=","voting_power":1},{"address":"61DAE6DB77FBD877EB2CFCDA61DF0085D60FEAEC","proposer_priority":-16,"pub_key":"vgtz4GLKwn/cxoiUmE4xjI2hTSqJoO7grOv5cvEmdbE=","voting_power":1},{"address":"64111299F214CBF71A6537BDDE6B4A6A9BB32CCE","proposer_priority":28,"pub_key":"MIlVMvQ+CIBxPurjek6LjKHuanazgBLujac5lHe79gY=","voting_power":1},{"address":"65B9B19C858B32161B8EDA89B918D23596E12989","proposer_priority":-2,"pub_key":"Xh1+PEY/8SsBNmfBLU8CWVtQHDVVlryqXdEVyEGxsx4=","voting_power":1},{"address":"6898966C8A85143EEEDB1DBD3EAB6C684F529A75","proposer_priority":-11,"pub_key":"eMQHdfEeHCnpcCQ5TaSiBtM7jB7r2tzv0iWpI0mOTSQ=","voting_power":1},{"address":"69471AA0DBC1B27405F112E26A2AE9E34A2951B2","proposer_priority":16,"pub_key":"t6MWozuIVDjdgoqCy1PPOrUtz8X094r3fu55t6K32/g=","voting_power":1},{"address":"6B9DFC20229B8122D4711294B52A6BC7CB2F3FCB","proposer_priority":-32,"pub_key":"IU/A97RbraOAeA4Ffbwtz/QhxYsEn2CaYMGLFwdDmEI=","voting_power":1},{"address":"6C4BB447EF7B6293E8B4E396937732570CD1245D","proposer_priority":2,"pub_key":"oEmFMGkVXPK5AN4mf9c0ou20Fwc+4P9HDhHHH54N0yA=","voting_power":1},{"address":"6D0124B1B839C0E8688CC3E11E2EB7F4643A3283","proposer_priority":-34,"pub_key":"z9GM2L83LJEcHVtnimV8pTKipCfFIYtw7OOyliUHHYw=","voting_power":1},{"address":"71424E5025F1C17BA80AA867124165B3DE723267","proposer_priority":-17,"pub_key":"+uLhQy+HHnR6Pjf9VplAsZg094XqovUWxsSMVs2smSU=","voting_power":1},{"address":"71A85203AB61D2B18E65F9E0F85E27E8A8A3F23E","proposer_priority":27,"pub_key":"E3hdhvQAEYMHRy30F2Rnpem8ftW3zN6kabJ3Zb/t30k=","voting_power":1},{"address":"73E9C52B552826D3D074503407B2A514054FD73E","proposer_priority":-54,"pub_key":"aXL+/Fg1FCMDsjDcKWOnaYyUjvax+vzvRf9Y29ITAPM=","voting_power":1},{"address":"752E55A0D6CAA2E293CA0464B5967815A6701068","proposer_priority":-17,"pub_key":"rhK2BZPgmTYg+kp0cBhsYE0KxfqZRlAFzPRXDtOrIpA=","voting_power":1},{"address":"770AB3B34106CA541E1EC8081550462562129370","proposer_priority":-17,"pub_key":"rXmo7L/AkMFjGcbEzl6+9gk3e3GBTSmnnrsBnlVbImw=","voting_power":1},{"address":"77725F66823E66C0707498C7F7B9441F66EED11A","proposer_priority":-31,"pub_key":"WkK3hfvO5yDy8muYJNMRFldQbMNcX4l2RKkjpt77Mms=","voting_power":1},{"address":"7A9F1B3F0B0EB7FD1A959C715F37BCA6DF39BF62","proposer_priority":-52,"pub_key":"OTyPF69htOCv6m/NF3B3Xk5oWOuzzz9YAL8jDc1UMhM=","voting_power":1},{"address":"81DBFC76EC1D2AAB2727D71DF406ECBFE797C39A","proposer_priority":4,"pub_key":"+bE1gukRUw7PITCbLbYNzlOFLhBP/IpZKzcNwvJRoXk=","voting_power":1},{"address":"82B18AE2C4DA4AB43F14222C09DA341EBE1D4569","proposer_priority":24,"pub_key":"qWAPlbdrCe4iEMgT4Og/rse6iu60IR4j14KA1wKmU3c=","voting_power":1},{"address":"8482AB39BDA9AF0CB2AADD8DDD382BDDE1800F17","proposer_priority":-30,"pub_key":"haeHVMXp3sTOjdZbeSBdB1e/fIhVCPA6/hagRRTn22U=","voting_power":1},{"address":"86B418CD2D8217BE747B4F92F9D99B55D1274393","proposer_priority":-10,"pub_key":"Dgm1OzZeU065AReI9pYHZsPpawu3qUGMF4pG6Rh4SJQ=","voting_power":1},{"address":"874B00974ECC89940FA2BD2154991ACD05A596D7","proposer_priority":-53,"pub_key":"xIzHIAdR3aZcy/4NOFs82nHfebfnw3VAXPJZOnYZ4s8=","voting_power":1},{"address":"89712F54D908B64F5090356C9412E73E60332B2E","proposer_priority":-35,"pub_key":"48QmMJWUEPqAb0b8DKuUYBc4NT8tWgnqbLfn3zI7al4=","voting_power":1},{"address":"89CFD21C1BB2C999B7CDF1983224ADE8C78E0D1E","proposer_priority":53,"pub_key":"KYXKr8EYUQTnN3wHeZ+WB0RqjKJ3v2kNz6cjDjId/Yw=","voting_power":1},{"address":"8AA2A9374BEE99CCF880D9542D0973F53A7F985C","proposer_priority":65,"pub_key":"s61pscZctI8B/vo+HEQp03849i1B0pOE86mBpKHdGi0=","voting_power":1},{"address":"8C0BBA3F9979EB304AF5D04435C12A6BCD659B14","proposer_priority":13,"pub_key":"HN5zytXy7/tafyF+zXLlUJM8JC6XYNnOmuOOfT2zsKM=","voting_power":1},{"address":"8C8CF9A7320345030F9B93D1151A8BE9C3CA0A61","proposer_priority":-17,"pub_key":"eoZxX/NcW9ptJpVoIzSWIcCudgxR9x+nL/Y6l++uq3c=","voting_power":1},{"address":"99A4C7C538746C17E6B73BA608534C514985E65B","proposer_priority":-14,"pub_key":"uQQwwasmU7idaG57+E+lgEyCap45ujDT5RgzoiDOZGk=","voting_power":1},{"address":"9A5491DB5E5D1FC0A996E604B6A28F9CBAD32DA3","proposer_priority":-38,"pub_key":"/mIYN/h8E9HllVBy1atAIHX5ivzVjjabXbKXr1vzAdg=","voting_power":1},{"address":"9AAEB33E7F234C6D4FF68A2E8582E1D5B5E5F126","proposer_priority":4,"pub_key":"uPFA0rUIcH8Qfq53Ll5MyUVfv8d4TDlKQxY+7ss8P6E=","voting_power":1},{"address":"9D66BE37915A229FC7F8DFB24F7C47E5D86C6A5F","proposer_priority":-50,"pub_key":"RE6V5f1XpqjskeZvf2q5i3RO4dYED75nh6pflZIv3FA=","voting_power":1},{"address":"9DA521AAB98169E75125C0C3F42ED7A5E048038E","proposer_priority":-42,"pub_key":"+5hgxLez8NuPFvSdlr0dGHDCvr3bIQwuOYlWCHWBL+k=","voting_power":1},{"address":"9F8893F14B30FC45F5BE438A0230431E0DA8B3A0","proposer_priority":26,"pub_key":"4HR7xm5b+Q6KhWp0Zsp18GI1o2Y/G9zsgYxu6lX7X0U=","voting_power":1},{"address":"A06F1475247A4E40CC6CB7A85FE1FECB26B16637","proposer_priority":18,"pub_key":"+HPt2R3e3CVkqO9KD/SBfcct33wfoBZ/F06bQbSIDJI=","voting_power":1},{"address":"A17A1E06D0A462E3C81F18D794DB24CE27A17BE6","proposer_priority":47,"pub_key":"q57VwuRuLKcRzTwSG5yXpl+1sE33c6ADkuiRf05ZQTw=","voting_power":1},{"address":"A525FAAB8E893AD942383A678C02591C492CFBEA","proposer_priority":-13,"pub_key":"hnMElc3vXDjEwmhPEZKAKIH4pkedFi7H08G+PL8dkhg=","voting_power":1},{"address":"A58F1719959DC32561788DFE58428BCB64895267","proposer_priority":47,"pub_key":"hZcMwzN/VkkIf93OADB/YJ1WfniP6pBA4dNi+zaLJxs=","voting_power":1},{"address":"A6B57710AD89044898344DA3078AD5C9BEACEB3B","proposer_priority":41,"pub_key":"S/8y3DrCKlJcsAnUfaWY8OVWl/ox8PRABCwh3WK3Hk4=","voting_power":1},{"address":"A6BC429BEF68A8C4E9E4EE669E99016661A9B5DF","proposer_priority":-17,"pub_key":"mYNAczro4JFQOVPx0pe5BR94cWzts1mnBFpscdgzWZg=","voting_power":1},{"address":"AAB6F2164396D8C066CD93629A55A044D9B70F82","proposer_priority":24,"pub_key":"zorOml4RGVbYY4TxUmdNt5PVX3L7LxFogBOyL+FRUnM=","voting_power":1},{"address":"AB3E625FDB7EA4566C4061CAEB3F6AE92435E569","proposer_priority":-17,"pub_key":"ojPOetm6WTy9PM6NiDXVpAmMSOncRgznt0QVxfEy098=","voting_power":1},{"address":"B6AF34335B7489D002A96D8AA21FC70D63EF2BBA","proposer_priority":-31,"pub_key":"U4FDog1EBLIc28CMKD35Uf4mAjvmh5vwvsMpRDp9UmI=","voting_power":1},{"address":"B75BCD6DDC16EEE9F08E09A2EE194346F96C043D","proposer_priority":38,"pub_key":"i9sWEFW7cWT9riIlskUQ6bfWmf4tud352ReH4Ey40C0=","voting_power":1},{"address":"B7E7C707A6612DC16977EE3EE3B8C1C9569FFEDA","proposer_priority":7,"pub_key":"RTlT3rcTfmAbsiNhkV9p9Fx3SrwLX5cosLS6lC1YplQ=","voting_power":1},{"address":"B8EF323DAE5224C8ABC98FDF2EF01BB3FE105101","proposer_priority":18,"pub_key":"qnGqtRjNW6t3soXqSWlVHhaG9ySOuoPSrS+Wm4JRzfY=","voting_power":1},{"address":"BB9784D7AAFE236BD87329E576425EBC6833EC99","proposer_priority":27,"pub_key":"oYvKAReQxtflc+q9eAGcXVmUgpohyjp+GunCqhX9e6E=","voting_power":1},{"address":"BD5D222267997ADFE612A759D5D1FF4C3892E0C3","proposer_priority":11,"pub_key":"YuVBprI/uOHwjf6lFkvxVZaXvmHItDXiARw54xp0iHY=","voting_power":1},{"address":"BFB406202B0149DF14DBDAA862BB4762B6C09AA3","proposer_priority":-16,"pub_key":"3fayhxq8UFaEIMYBuGvwIx9XgWldqMvGinapS8GEsas=","voting_power":1},{"address":"C5F7ADA535E6DEE90779A837B58544B5333901F3","proposer_priority":-50,"pub_key":"+jnYrMKPWqj5cCg626tk5EF7nTSxME326hmNEPxv2X4=","voting_power":1},{"address":"C7A7ADAA6ECC510D3754842E810FFFE67A1A0DFF","proposer_priority":24,"pub_key":"1sjg2wPUjDxCVY2/wnfmPFMIi4nigccS6K2gDdSzFuU=","voting_power":1},{"address":"CB7555DDB14EDAD00C2240BF92D71C6F3AE56702","proposer_priority":-16,"pub_key":"ADgT0W6VGu1gTUA1nkb3t4OUsDmCLEq7h2S3FNjYSIU=","voting_power":1},{"address":"CB84A4916DAF98139790926CAAD30C7FFCD48D00","proposer_priority":-51,"pub_key":"Q4Dq1FbUrg8ar5DPYmq0GMpayvv8O++vU8xIo/MXAYM=","voting_power":1},{"address":"CBD9F43E0F301F272884E787CE1771B5144759FC","proposer_priority":-16,"pub_key":"oo/cCB8HM74STnjJyV/FdtXgRB5khYS9JBtc3eqUeSM=","voting_power":1},{"address":"D34CCB0A8AEF3DD03B30E7E25E229143E34E7697","proposer_priority":16,"pub_key":"89HJLaYlHX9ppg1Vcb8ebGnODfnxuVqm5PAXyJ/3WJo=","voting_power":1},{"address":"D4EC26408087B77E8D307DAE9EE45F080A6152D5","proposer_priority":-24,"pub_key":"0Kxq4Qga0pxk6Q80eueD/NFIV/ziUIOGDPjintRkklA=","voting_power":1},{"address":"D59ECC0F8349A5C23DF6DBCCFFDC3E726359EECE","proposer_priority":-37,"pub_key":"sj/yZifq8zy4mglkc1uH5bqsMdTY2Ih93QlnqMlxbx8=","voting_power":1},{"address":"D5D0560FCDF841800B7AE3C99A24CB1AADCD8C68","proposer_priority":6,"pub_key":"VRUwgOFobyq3Zb+oXIWH8KRj2ThzvK64AME7DcrayJI=","voting_power":1},{"address":"D6867F83C7720A930DD7AE8652BB32AF5BC274B3","proposer_priority":34,"pub_key":"L38JGaLt141SRk4GYea5wKsyHhUv7FUG0aYHfnrTJhU=","voting_power":1},{"address":"D686CAB9B2C29A95F00B94932811927420AC0E5E","proposer_priority":65,"pub_key":"ZY853CaaFMHdL6qbg3OrjBS/1dtdfkheYmT4MWzjIBk=","voting_power":1},{"address":"D88AD92A4603B89FC94C2309A67E30CD08481534","proposer_priority":-51,"pub_key":"EBANIruHmbbpvCDVMCe3ljpdCrsx43v5bowZG2BPECI=","voting_power":1},{"address":"DCED6624898B070382484AD7B737D83E60AD00ED","proposer_priority":-16,"pub_key":"M5GiRsL3g+JHtHXtXF67PhtEz/l3VpX1zFzhzDtopHQ=","voting_power":1},{"address":"DE0CF951421CB4A4F4DCD3ED579C6E22FCEDF208","proposer_priority":27,"pub_key":"uN3ms02bWCVAjiMCywFe9PdJH8xfK1VOf+E6vrkrN5s=","voting_power":1},{"address":"E86EE4C61C36AA342A2D83D9DA7D6EDA3DF09271","proposer_priority":30,"pub_key":"nUY8mM4eaGuX03vW3x+ufuLoziyssLSMQSLfReuDoPE=","voting_power":1},{"address":"E995A46B9B6D19F261557FC057AA6A6AE9B1F97C","proposer_priority":25,"pub_key":"ylYX2N2LT9Sv7N8F1GeaSGSSocbM0TZhiWuOAZ+Ivm8=","voting_power":1},{"address":"EAF01ECF1E9AB40116F79CE39A9A699699E9F67D","proposer_priority":46,"pub_key":"yUO1Hwz3hdY9CYGas+gXGd46LCe3SXvXGivUKVj+Rkg=","voting_power":1},{"address":"EAF96A684CE2633DB6CACBF44717476BA067347B","proposer_priority":52,"pub_key":"Ew0v4nx3EYW4V6g+kIW0Spbc85Yob+i9kT4d4s6SPUI=","voting_power":1},{"address":"EDE5AE276268ACB44A735F4C097A49A4A9BB4261","proposer_priority":36,"pub_key":"lNYaZQwncHnUQLBJfRpr+xzjcICokTmzPlYj30IEBl0=","voting_power":1},{"address":"EE1B34267A8C4C14835B05F938DDD38842E6510B","proposer_priority":-19,"pub_key":"hSVG6PEkVXpyryJoSEgJtT7PRnS4yfC9Eg/0XqtuGjg=","voting_power":1},{"address":"F3372A41204EB238BBBC485285FD13102191A88E","proposer_priority":17,"pub_key":"VM3XudHuJickkwEqrV9K04aXesHmjb0RuVAuhZ4S/vU=","voting_power":1},{"address":"F3B7F8F9E5EC2DC531CE79E9A2C8A8A539BA8C58","proposer_priority":25,"pub_key":"gTBfGM0iK9dF5T20TzGD6dJ7g9Zg2YQJ3hY88SYkL80=","voting_power":1},{"address":"F5A1C9D89ADE33E1491A4B7FFD6BAA8C7E9FF9B3","proposer_priority":-34,"pub_key":"eH2QlVVryzHXZflvf1OzDj0302LxXTa+FUhzmYUWdhU=","voting_power":1},{"address":"F6F7F4FA090D5ED24E085B3B3B0CBEC94CDCEE43","proposer_priority":25,"pub_key":"zpdOHmko0p0R9nrJcg3inFsxhwcjeBuy3awNrQzflEw=","voting_power":1},{"address":"FB64033AABB3287835FC84E75B8CC670FD374437","proposer_priority":10,"pub_key":"z9yATV+DXb3DDNmT/GFlu1jRfqw8sUyqhE8kNROX9jE=","voting_power":1},{"address":"FF70808AC8514ABE4F397E5107E84BF6A2FE6797","proposer_priority":60,"pub_key":"jxqtukqhf2eJXHV2fbP75SjYPc44W9QKUj6UxpmNLiw=","voting_power":1},{"address":"FFE6EB4663E5522402752982120B4CBE743872A8","proposer_priority":27,"pub_key":"kD6Zqqc8HJIdPByKLWJ7MYaseNgBmg7wNYYQGiu2HzQ=","voting_power":1}]},"votes":[{"precommits":["nil-Vote","nil-Vote","nil-Vote","nil-Vote","nil-Vote","nil-Vote","nil-Vote","nil-Vote","nil-Vote","nil-Vote","nil-Vote","nil-Vote","nil-Vote","nil-Vote","nil-Vote","nil-Vote","nil-Vote","nil-Vote","nil-Vote","nil-Vote","nil-Vote","nil-Vote","nil-Vote","nil-Vote","nil-Vote","nil-Vote","nil-Vote","nil-Vote","nil-Vote","nil-Vote","nil-Vote","nil-Vote","nil-Vote","nil-Vote","nil-Vote","nil-Vote","nil-Vote","nil-Vote","nil-Vote","nil-Vote","nil-Vote","nil-Vote","nil-Vote","nil-Vote","nil-Vote","nil-Vote","nil-Vote","nil-Vote","nil-Vote","nil-Vote","nil-Vote","nil-Vote","nil-Vote","nil-Vote","nil-Vote","nil-Vote","nil-Vote","nil-Vote","nil-Vote","nil-Vote","nil-Vote","nil-Vote","nil-Vote","nil-Vote","nil-Vote","nil-Vote","nil-Vote","nil-Vote","nil-Vote","nil-Vote","nil-Vote","nil-Vote","nil-Vote","nil-Vote","nil-Vote","nil-Vote","nil-Vote","nil-Vote","nil-Vote","nil-Vote","nil-Vote","nil-Vote","nil-Vote","nil-Vote","nil-Vote","nil-Vote","nil-Vote","nil-Vote","nil-Vote","nil-Vote","nil-Vote","nil-Vote","nil-Vote","nil-Vote","nil-Vote","nil-Vote","nil-Vote","nil-Vote","nil-Vote","nil-Vote","nil-Vote","nil-Vote","nil-Vote","nil-Vote","nil-Vote","nil-Vote","nil-Vote","nil-Vote","nil-Vote","nil-Vote","nil-Vote","nil-Vote","nil-Vote","nil-Vote","nil-Vote","nil-Vote","nil-Vote","nil-Vote","nil-Vote"],"precommits_bit_array":"BA{119:_______________________________________________________________________________________________________________________} 0/119 = 0.00","prevotes":["nil-Vote","nil-Vote","nil-Vote","nil-Vote","nil-Vote","nil-Vote","nil-Vote","nil-Vote","nil-Vote","nil-Vote","nil-Vote","nil-Vote","nil-Vote","nil-Vote","nil-Vote","nil-Vote","nil-Vote","nil-Vote","nil-Vote","nil-Vote","nil-Vote","nil-Vote","nil-Vote","nil-Vote","nil-Vote","nil-Vote","nil-Vote","nil-Vote","nil-Vote","nil-Vote","nil-Vote","nil-Vote","nil-Vote","nil-Vote","nil-Vote","nil-Vote","nil-Vote","nil-Vote","nil-Vote","nil-Vote","nil-Vote","nil-Vote","nil-Vote","nil-Vote","nil-Vote","nil-Vote","nil-Vote","nil-Vote","nil-Vote","nil-Vote","nil-Vote","nil-Vote","nil-Vote","nil-Vote","nil-Vote","nil-Vote","nil-Vote","nil-Vote","nil-Vote","nil-Vote","nil-Vote","nil-Vote","nil-Vote","nil-Vote","nil-Vote","nil-Vote","nil-Vote","nil-Vote","nil-Vote","nil-Vote","nil-Vote","nil-Vote","nil-Vote","nil-Vote","nil-Vote","nil-Vote","nil-Vote","nil-Vote","nil-Vote","nil-Vote","nil-Vote","nil-Vote","nil-Vote","nil-Vote","nil-Vote","nil-Vote","nil-Vote","nil-Vote","nil-Vote","nil-Vote","nil-Vote","nil-Vote","nil-Vote","nil-Vote","nil-Vote","nil-Vote","nil-Vote","nil-Vote","nil-Vote","nil-Vote","nil-Vote","nil-Vote","nil-Vote","nil-Vote","nil-Vote","nil-Vote","nil-Vote","nil-Vote","nil-Vote","nil-Vote","nil-Vote","nil-Vote","nil-Vote","nil-Vote","nil-Vote","nil-Vote","nil-Vote","nil-Vote","nil-Vote"],"prevotes_bit_array":"BA{119:_______________________________________________________________________________________________________________________} 0/119 = 0.00","round":0}]} module=consensus
2:34AM ERR Error stopping consensus state err="not started" module=consensus
2:34AM ERR Stopped accept routine, as transport is closed module=p2p numPeers=0
2:34AM INF Closing rpc listener listener={"Listener":{}}
2:34AM INF RPC HTTP server stopped err="accept tcp [::]:26657: use of closed network connection" module=rpc-server
2:34AM ERR Error serving server err="accept tcp [::]:26657: use of closed network connection"
2:34AM INF exiting...
sh: 1: Bad substitution

Permission Missing

During Validator joining process, for a new node, validator A cannot run any of the steps prior to claim for validator B, due to permission missing for original Validator A, who already joined the network.

the Permissions dont come as default
not clear if this is intended or an error in the permission assignment

Block level mismatch in different containers

So in container 1 the height of the blocks was 171623, in container 2 177083, in container 3 0, in container 4 170094. In this case, the node has the status of a validator, but is inactive. Reinstalling the node did not solve the problem

Run as root

Dear Team,
Could you avoid running node with root account, please? It's a bad practice to use root + many issues may be missed as root account has highest privileges. If you plan to catch such issues in production or run production node also with root, you can close this incident.

As example I run it as non root user and what I have:

  • lack of permissions because it wants to do something in /root folder and modify system files in /etc
  • it ask to run it as non-root user at the end...

`$ cd tmp && read -p "Input branch name: " BRANCH && \

wget https://raw.githubusercontent.com/KiraCore/kira/$BRANCH/workstation/init.sh -O ./i.sh &&
chmod 555 -v ./i.sh && H=$(sha256sum ./i.sh | awk '{ print $1 }') && read -p "Is '$H' a [V]alid SHA256 ?: "$'\n' -n 1 V &&
[ "${V,,}" == "v" ] && ./i.sh "$BRANCH" || echo "ERROR: Setup failed or was cancelled by the user. Try again init command."
Input branch name: testnet-1
--2021-04-01 18:20:52-- https://raw.githubusercontent.com/KiraCore/kira/testnet-1/workstation/init.sh
Resolving raw.githubusercontent.com (raw.githubusercontent.com)... 185.199.109.133, 185.199.110.133, 185.199.111.133, ...
Connecting to raw.githubusercontent.com (raw.githubusercontent.com)|185.199.109.133|:443... connected.
HTTP request sent, awaiting response... 200 OK
Length: 17068 (17K) [text/plain]
Saving to: ‘./i.sh’

./i.sh 100%[=============================================================================>] 16.67K --.-KB/s in 0.001s

2021-04-01 18:20:52 (21.6 MB/s) - ‘./i.sh’ saved [17068/17068]

mode of './i.sh' changed from 0664 (rw-rw-r--) to 0555 (r-xr-xr-x)
Is '26237215b968ecfd201d92c61a13b4c4ce84aa65d57465fe949b2b49f8e66db0' a [V]alid SHA256 ?:
vchmod: changing permissions of '/etc/profile': Operation not permitted

STARTED: INIT v0.0.9
SKIP UPDATE: false
START TIME: 1617294055
INFRA BRANCH: testnet-1
INFRA REPO: https://github.com/KiraCore/kira
KIRA USER: root
ARCHITECTURE: x86_64

mkdir: cannot create directory ‘/home/root’: Permission denied
mkdir: cannot create directory ‘/home/root’: Permission denied
mkdir: cannot create directory ‘/home/root’: Permission denied
mkdir: cannot create directory ‘/home/root’: Permission denied
INFO: Initalizing setup script...

++ cat /proc/cpuinfo
++ grep processor
++ wc -l

  • CPU_CORES=12
    ++ grep MemTotal /proc/meminfo
    ++ awk '{print $2}'
  • RAM_MEMORY=263831480
  • '[' 12 -lt 2 ']'
  • '[' 263831480 -lt 3145728 ']'
  • '[' testnet-1 == master ']'
  • [[ testnet-1 == mainnet* ]]
  • [[ testnet-1 == testnet* ]]
  • DEFAULT_BRANCH=testnet-1
  • '[' -z '' ']'
  • SEKAI_BRANCH=testnet-1
  • '[' -z '' ']'
  • FRONTEND_BRANCH=testnet-1
  • '[' -z '' ']'
  • INTERX_BRANCH=testnet-1
  • '[' -z '' ']'
  • SEKAI_REPO=https://github.com/KiraCore/sekai
  • '[' -z '' ']'
  • FRONTEND_REPO=https://github.com/KiraCore/kira-frontend
  • '[' -z '' ']'
  • INTERX_REPO=https://github.com/KiraCore/sekai
  • '[' root == root ']'
    ++ logname
  • KIRA_USER=root
  • '[' root == root ']'
  • echo 'ERROR: You must login as non root user to your machine!'
    ERROR: You must login as non root user to your machine!
  • exit 1
    ERROR: Setup failed or was cancelled by the user. Try again init command.
    `

Follow up on issue 4 - Finding out why the chain stopped

Most validators that posted the error show this before the chained stopped:

[0m"commit failed for application: error changing validator set: duplicate entry Validator{EBAA8A1AA4EC636AE3345436C291B51977B06D5B PubKeyEd25519{6DDCB539FEC02B209DC7FAB0F2670CF3FEA7564BE58181A495013D5BB6B7427B} VP:1 A:0} in

The list was already filled with this validator:
image

Checking the address is showing:
image

(adding this issue to get a form submit with the findings)

Installation problems (not resolved to end testnet)

hi. my kira adress kira1rauchfdp5dcqp4j3gywhezt2wpy7hua6a9lkcv i'm in validators list. server's ip adress 75.119.154.212.
hardware: 4 cores amd epyc 7000, 8 gb ram, 100 gb ssd. Ubuntu 20.04

  1. after first installation my node hadn't receive'd status "waiting". i hade tried to use faucet (not helped for me). try'd to stop containers (not helped). try'd to send transaction to join validators set (sekaid tx customstaking claim-validator-seat). and it didn't help.

2.after this i made reinitialize. but process stopped with this issue:

Successfully tagged base-image: latest

  • docker image ls
    REPOSITORY TAG IMAGE ID CREATED SIZE
    base-image latest de6fb5aae7b2 1 second ago 4.09GB
    ubuntu 20.04 26b77e58432b 6 days ago 72.9MB
    registry 2.7.1 ee34aa9d8ab2 8 days ago 26.2MB
  • docker tag base-image: latest registry.regnet.local: 5000 / base-image
  • docker push registry.regnet.local: 5000 / base-image
    The push refers to repository [registry.regnet.local: 5000 / base-image]
    Get http: //registry.regnet.local: 5000 / v2 /: dial tcp 10.1.0.2:5000: connect: no route to host

i've found solution in kira testers tg - https://github.com/KiraCore/kira/edit/master/workstation/setup/registry.sh

3.after installation my node got status - consensus halted. and the status did not change whatever I did (restarting blocks, restarting server, sending "sekaid tx customstaking claim-validator-seat").

4.in kira testers tg i got advice to make clean installation - and that's all. i can not install kira node for 4 day's (6 reinitialisations) i got different errors while installation:

  • ERROR: Node failed or status could not be fetched (1/3), your netwok connectivity might have been interrupted

  • WARNING: sentry is not initialized yet (and installation stops in sentry getting blocks)

i had tried to use different ip of public nodes. but it didn't help. ip list 3.11.224.235, 68.183.113.128, 52.56.117.134

and after this i founded that testnet-2 is over. but i didn't install fine works node

Local dns stopped working, cannot ssh to it from main computer.

Running kira node privately on designated mini PC, it is convenient to ssh to it from main computer (windows), with computer name (local dns resolving). After installing kira and restarting PC, such feature does not work anymore, but I can still ssh to it with IP name.

[BUG] Testnet-3 Kira manager stuck on loading infrustructure

image

If the manager stuck like that - you need to check kirascan.service

  1. Logging as a root. service --status-all check if kirascan running. if not follow next step
  2. rm -rf /home/kira1/kirascan /home/kira1/kirascan/status /home/kira1/kirascan/logs /home/kira1/snap/status /home/kira1/dump/kirascan (kirascan.service will fail to start if this directories already present)
  3. systemctl start kirascan.service
  4. now we should check it systemctl status kirascan.service if it is active FINALLY:
  5. kira

Snapshot stuck

Kira V0.2.2.3 Validator mode, snapshot got stuck at first manual run, restart does not help:
`+ SNAP_BLOCK=89651
++ isNaturalNumber 89651
+++ isNullOrEmpty 89651
+++ '[' -z 89651 ']'
+++ '[' 89651 == null ']'
+++ echo false
++ false
++ VTMP=false
+++ isInteger 89651
++++ isNullOrEmpty 89651
++++ '[' -z 89651 ']'
++++ '[' 89651 == null ']'
++++ echo false
+++ false
+++ VTMP=false
+++ [[ 89651 =~ ^-?[0-9]+$ ]]
+++ VTMP=true
+++ echo true
++ true
++ '[' 89651 -ge 0 ']'
++ VTMP=true
++ echo true

  • true
    ++ isNaturalNumber 89651
    +++ isNullOrEmpty 89651
    +++ '[' -z 89651 ']'
    +++ '[' 89651 == null ']'
    +++ echo false
    ++ false
    ++ VTMP=false
    +++ isInteger 89651
    ++++ isNullOrEmpty 89651
    ++++ '[' -z 89651 ']'
    ++++ '[' 89651 == null ']'
    ++++ echo false
    +++ false
    +++ VTMP=false
    +++ [[ 89651 =~ ^-?[0-9]+$ ]]
    +++ VTMP=true
    +++ echo true
    ++ true
    ++ '[' 89651 -ge 0 ']'
    ++ VTMP=true
    ++ echo true
  • true
  • '[' 89651 -lt 89651 ']'
  • echo 'INFO: Latest Block Height: 89651'
    INFO: Latest Block Height: 89651
  • '[' false == true ']'
  • '[' 89651 -gt 0 ']'
  • echo 'INFO: Updating progress bar...'
    INFO: Updating progress bar...
  • '[' 89651 -lt 109342 ']'
    ++ bc
    ++ echo 'scale=2; ( ( 100 * 89651 ) / 109342 )'
  • PERCENTAGE=81.99
  • '[' 89651 -ge 109342 ']'
  • echo 81.99
  • ps -p 48
  • echo 'INFO: Waiting for snapshot node to sync 89651/...'
    INFO: Waiting for snapshot node to sync 89651/...
  • sleep 30
  • '[' 89651 -gt 89651 ']'
  • echo 'WARNING: Block did not changed! (89651)'
    WARNING: Block did not changed! (89651)
  • '[' 89651 -lt 109342 ']'
  • '[' 0 -ge 4 ']'
  • '[' -z 48 ']'
  • i=1
  • echo 'INFO: Waiting for block update test 1/4'
    INFO: Waiting for block update test 1/4
  • :
  • echo 'INFO: Checking node status...'
    INFO: Checking node status...
    ++ sekaid status
    ++ jq -rc .
  • SNAP_STATUS='{"NodeInfo":{"protocol_version":{"p2p":"8","block":"11","app":"0"},"id":"c25bf455046807ac6aaa9555c1d5ea4598dcfc1f","listen_addr":"tcp://0.0.0.0:26656","network":"testnet-2","version":"","channels":"402021222330386061","moniker":"KIRA SNAPSHOT NODE","other":{"tx_index":"on","rpc_address":"tcp://0.0.0.0:26657"}},"SyncInfo":{"latest_block_hash":"248DD5F5889F30321E174E9E01475AE2549D4BE3A4EB43A526E137048BCD6A1B","latest_app_hash":"21E2B73A3CA45C2E7B742E71F675703AA43CBCDFF72C91F565C39C52F544A7F1","latest_block_height":"89651","latest_block_time":"2021-04-08T07:43:03.385546127Z","earliest_block_hash":"F43DB96CF71EFD830CB6EEFB86A66832A20FDD41B8D62254C0163CC2EDE36980","earliest_app_hash":"E3B0C44298FC1C149AFBF4C8996FB92427AE41E4649B934CA495991B7852B855","earliest_block_height":"1","earliest_block_time":"2021-04-03T03:54:14.832180699Z","catching_up":true},"ValidatorInfo":{"Address":"A64378251ED1702C14959FA4BBFDA50715A22503","PubKey":{"type":"tendermint/PubKeyEd25519","value":"eLVoZ/C2o1u+ebR5LGNMs4JwQsAIwPHMY5OGJo8P9os="},"VotingPower":"0"}}'
    ++ echo '{"NodeInfo":{"protocol_version":{"p2p":"8","block":"11","app":"0"},"id":"c25bf455046807ac6aaa9555c1d5ea4598dcfc1f","listen_addr":"tcp://0.0.0.0:26656","network":"testnet-2","version":"","channels":"402021222330386061","moniker":"KIRA' SNAPSHOT 'NODE","other":{"tx_index":"on","rpc_address":"tcp://0.0.0.0:26657"}},"SyncInfo":{"latest_block_hash":"248DD5F5889F30321E174E9E01475AE2549D4BE3A4EB43A526E137048BCD6A1B","latest_app_hash":"21E2B73A3CA45C2E7B742E71F675703AA43CBCDFF72C91F565C39C52F544A7F1","latest_block_height":"89651","latest_block_time":"2021-04-08T07:43:03.385546127Z","earliest_block_hash":"F43DB96CF71EFD830CB6EEFB86A66832A20FDD41B8D62254C0163CC2EDE36980","earliest_app_hash":"E3B0C44298FC1C149AFBF4C8996FB92427AE41E4649B934CA495991B7852B855","earliest_block_height":"1","earliest_block_time":"2021-04-03T03:54:14.832180699Z","catching_up":true},"ValidatorInfo":{"Address":"A64378251ED1702C14959FA4BBFDA50715A22503","PubKey":{"type":"tendermint/PubKeyEd25519","value":"eLVoZ/C2o1u+ebR5LGNMs4JwQsAIwPHMY5OGJo8P9os="},"VotingPower":"0"}}'
    ++ jq -rc .SyncInfo.latest_block_height
  • SNAP_BLOCK=89651
    ++ isNaturalNumber 89651
    +++ isNullOrEmpty 89651
    `

Validator resource usage

Validator is using too many resources, i want to mention more about ssd usage as it has really high read/write
hddusageaverage
netusage
cpuusage

Validator activation msg

while running the "activate" command:

message index: 0: validator still inactivated; cannot be activated",

how we proceed?

[PERFOMANCE] Missed block qty improvement

I made a script to get avg ping among all network actors.
To have a good peers is a good start to imporve your node perfomance. #my personal opinion

sudo apt update
sudo apt install git
cd /${HOME} #enter home directory
mkdir - p tmp #creating tmp directory if not exist
cd tmp/ #entering tmp dir
git clone https://github.com/MrLutik/KiraScan.git #getting script
cd KiraScan #entering dir
python3 kirascan.py #starting a script

it takes a while to process.
image

after processing through all peers you will get a result(comma separated list of IPs) with a best 20 peers by avg ping.

image

after that i went here:
image

than to private peers:
image
pressed V
image

than copypast peers ip
image

after that many times Y you have to push

Than S for save changes and R for restart oriv_sentry

it will take couple mins.

P.S. This is my steps only. NOT AN INSTRUCTION OR RECOMENDATION.
IT IS NOT APPROVED BY ADMINS as well. SO IT IS UP TO YOU TO PROCEED OR NOT.

Formula to check perfomance:
(1 - STREAK/BLOCK_HEIGHT)*100% = RES - is a % of missed block

I think I know why testnet-1 has halted!

So this morning at least 20 or 30 validators whom have been using Google Cloud Provider have been banned and their virtual machines which their kira nodes have been running on, got shutdown by Google support. Reasoning was Cryptocurrency mining.
Some of them reached out to support and got their issue resolved but some of them were not that lucky.

So, I believe this is the issue that caused the testnet-1 to get halted. This is just a theory but I've heard from at least 10 people, some of them are my friends some of them are Kira community members, that they have been banned at the same time on Google Cloud Provider. Their only similarity was that they all have been running Kira Network Testnets.

I believe if you look at the logs you will see that, so many validators got cut off at the same time frame and this might be the reason consensus or network has halted. You can ask the community about the Google banning people for Kira node, you'll probably see more than 30 people.

Just my 2 cents on the situation, wanted to share with y'all. Thanks and looking forward to the Testnet-2!

Issue. Not getting last snap from a seeds

In both variants of installation Quick and Advanced, I have met the same issue with detecting snaps.
It is important because slow sync can take a lot of time to get on track for the validator.
In advanced mode, you can add seeds manually. I have listed all seeds from testnet-2 readme.
But deploy failed to find any snapshot.
The only option that worked for me is to deploy in quick mode iterating through seeds until snap obtained.

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.