thlorenz/valuepack-mine

Conducts mining data from different sources for valuepack.

valuepack-mine

Conducts mining data from different sources for valuepack.

valuepack-mine's Issues

mining github seems to leak memory

Below is memory usage data taken every 10s:

  cat log.log | grep increase
{ total: 191367680, used: 158187016, increase: 116954584 }
{ total: 222289664, used: 195830584, increase: 37643568 }
{ total: 243960320, used: 187165632, increase: -8664952 }
{ total: 241896448, used: 210162848, increase: 26953192 }
{ total: 261503232, used: 215270712, increase: 5107864 }
{ total: 291429376, used: 257447368, increase: 42176656 }
{ total: 303824640, used: 225592392, increase: -31854976 }
{ total: 303824640, used: 223676224, increase: -33771144 }
{ total: 303824640, used: 265662304, increase: 8214936 }
{ total: 297645056, used: 236239408, increase: -29422896 }
{ total: 301772800, used: 199583520, increase: -66078784 }
{ total: 301772800, used: 230167088, increase: -35495216 }
{ total: 301772800, used: 210801040, increase: -54861264 }
{ total: 301772800, used: 244847864, increase: -20814440 }
{ total: 302804736, used: 236833040, increase: -28829264 }
{ total: 306932480, used: 219429864, increase: -46232440 }
{ total: 307964416, used: 256423912, increase: -9238392 }
{ total: 307964416, used: 255530728, increase: -10131576 }
{ total: 318283776, used: 278936240, increase: 13273936 }
{ total: 325507328, used: 290133648, increase: 11197408 }
{ total: 327571200, used: 244355776, increase: -45777872 }
{ total: 327571200, used: 281884400, increase: -8249248 }
{ total: 343050240, used: 265032192, increase: -25101456 }
{ total: 347177984, used: 307838280, increase: 17704632 }
{ total: 360593152, used: 330258672, increase: 22420392 }
{ total: 374008320, used: 326001536, increase: -4257136 }
{ total: 376072192, used: 352193832, increase: 21935160 }
{ total: 387423488, used: 362111528, increase: 9917696 }
{ total: 409094144, used: 384325768, increase: 22214240 }
{ total: 410126080, used: 325738200, increase: -58587568 }
{ total: 410126080, used: 338612616, increase: -45713152 }
{ total: 413221888, used: 368895184, increase: -15430584 }
{ total: 423541248, used: 343689576, increase: -40636192 }
{ total: 423541248, used: 356179816, increase: -28145952 }
{ total: 423541248, used: 371233512, increase: -13092256 }
{ total: 433860608, used: 368545720, increase: -15780048 }
{ total: 437988352, used: 391182408, increase: 6856640 }
{ total: 437988352, used: 388353784, increase: -2828624 }
{ total: 441084160, used: 398517112, increase: 7334704 }
{ total: 455531264, used: 417617728, increase: 19100616 }
{ total: 469978368, used: 434648640, increase: 17030912 }
{ total: 479265792, used: 374106872, increase: -60541768 }
{ total: 479265792, used: 377844288, increase: -56804352 }
{ total: 479265792, used: 402710984, increase: -31937656 }
{ total: 479265792, used: 431372296, increase: -3276344 }
{ total: 490617088, used: 443829448, increase: 9180808 }
{ total: 493712896, used: 411587168, increase: -32242280 }
{ total: 494744832, used: 418475512, increase: -25353936 }
{ total: 497840640, used: 430837600, increase: -12991848 }
{ total: 509191936, used: 444333936, increase: 504488 }
{ total: 522607104, used: 465838224, increase: 22008776 }
{ total: 529830656, used: 480709368, increase: 14871144 }
{ total: 538086144, used: 439286496, increase: -41422872 }
{ total: 538086144, used: 441379312, increase: -39330056 }
{ total: 538086144, used: 452878464, increase: -27830904 }
{ total: 538086144, used: 464312768, increase: -16396600 }
{ total: 545309696, used: 491632464, increase: 10923096 }
{ total: 556660992, used: 496457416, increase: 4824952 }
{ total: 563884544, used: 512591456, increase: 16134040 }
{ total: 570076160, used: 523253984, increase: 10662528 }
{ total: 574203904, used: 460813800, increase: -62440184 }
{ total: 574203904, used: 492956160, increase: -30297824 }
{ total: 574203904, used: 511901592, increase: -11352392 }
{ total: 580395520, used: 527778456, increase: 4524472 }
{ total: 590714880, used: 542428472, increase: 14650016 }
{ total: 569676800, used: 493730944, increase: -48697528 }
{ total: 594842624, used: 505119600, increase: -37308872 }
{ total: 595874560, used: 523612416, increase: -18816056 }
{ total: 603098112, used: 538970648, increase: -3457824 }
{ total: 610321664, used: 541909160, increase: -519312 }
{ total: 623736832, used: 565259720, increase: 22831248 }
{ total: 633024256, used: 583541688, increase: 18281968 }
{ total: 615081984, used: 500534176, increase: -83007512 }
{ total: 623470592, used: 505167504, increase: -78374184 }
{ total: 640247808, used: 528268832, increase: -55272856 }
{ total: 640247808, used: 533001912, increase: -50539776 }
{ total: 640247808, used: 545003528, increase: -38538160 }
{ total: 640247808, used: 565388640, increase: -18153048 }
{ total: 645407488, used: 567932160, increase: -15609528 }
{ total: 654694912, used: 593397968, increase: 9856280 }
{ total: 628397312, used: 534845144, increase: -58552824 }
{ total: 659854592, used: 561219200, increase: -32178768 }
{ total: 659854592, used: 572581424, increase: -20816544 }
{ total: 663982336, used: 576587384, increase: -16810584 }
{ total: 673269760, used: 592051912, increase: -1346056 }
{ total: 682557184, used: 603272784, increase: 9874816 }
{ total: 691844608, used: 611626528, increase: 8353744 }

leveldown is not found when using node 0.8

~/dev/js/projects/valuepack/mine/main (master *)
➝  node index.js
info mine { npm: true, github: true }
info mine-npm fetching npm users ...
[Error: UNABLE_TO_VERIFY_LEAF_SIGNATURE] <-- other unrelated stream bug

~/dev/js/projects/valuepack/mine/main (master *)
➝  nave use 0.8 node index.js
Already installed: 0.8.25
using 0.8.25

/Users/thlorenz/dev/js/projects/valuepack/mine/main/node_modules/valuepack-core/node_modules/level/node_modules/levelup/lib/util.js:126
        throw new errors.LevelUPError(missingLevelDOWNError)
              ^
LevelUPError: Could not locate LevelDOWN, try `npm install leveldown`
    at getLevelDOWN (/Users/thlorenz/dev/js/projects/valuepack/mine/main/node_modules/valuepack-core/node_modules/level/node_modules/levelup/lib/util.js:126:15)
    at LevelUP.open (/Users/thlorenz/dev/js/projects/valuepack/mine/main/node_modules/valuepack-core/node_modules/level/node_modules/levelup/lib/levelup.js:110:43)
    at createLevelUP (/Users/thlorenz/dev/js/projects/valuepack/mine/main/node_modules/valuepack-core/node_modules/level/node_modules/levelup/lib/levelup.js:451:15)
    at Object.module.exports.leveldb.open (/Users/thlorenz/dev/js/projects/valuepack/mine/main/node_modules/valuepack-core/leveldb.js:32:5)
    at Object.<anonymous> (/Users/thlorenz/dev/js/projects/valuepack/mine/main/index.js:65:11)
    at Module._compile (module.js:449:26)
    at Object.Module._extensions..js (module.js:467:10)
    at Module.load (module.js:356:32)
    at Function.Module._load (module.js:312:12)
    at Module.runMain (module.js:492:10)
failed with code=1