licoffe / poe-stash-indexer Goto Github PK
View Code? Open in Web Editor NEWA Path of Exile stash indexer for Windows, Mac and Linux
A Path of Exile stash indexer for Windows, Mac and Linux
Hi!
I'm using the indexer on Windows (with a few minor tweaks) gathering data from the start of the stream to around now, which I estimate will take about 26 days and no more than 4 terabytes. However I have a small problem - RAM usage by MongoDB server goes up straight to 99% after about 10 minutes. Do you know if this is caused by a memory leak somewhere in the code or if this is normal for processing jobs of this size?
Thanks and sorry if this is a stupid question. Paul
will add more to this issue once I find that it is missing
will check them here also once they are implemented
all "findings" are based on experience with poe.trade and the features it has
I am currently running in to a problem where my first search works as long as I don't change any of the parameters, but any search thereafter is only returning 0 results.
My indexer stopped at the following error:
19-10-2016 6:54:35 > [Indexer] SyntaxError: Unexpected token < in JSON at position 0
I think it would make sense to just continue running the indexer at this point? Or maybe not, I don't why it happens, but would be nice to log some more, or just continue if we can.
when i run the indexer i get this spamming -
29-10-2017 6:10:28 > [Indexer] Insert issue mod: Error: ER_LOCK_DEADLOCK: Deadlock found when trying to get lock; try restarting transaction
Looks like a nice tool, I've tried on debian 4.7.5.-1 and I'm getting following(also ctrl+c doesn't kill the proces gotta manualy kill nodejs):
2-10-2016 12:22:26 > [Indexer] Connected to MongoDB.
2-10-2016 12:22:26 > [Indexer] Attempting to create or reuse POE_price collection
2-10-2016 12:22:26 > [Indexer] Last chunk ID found
2-10-2016 12:22:26 > [Indexer] Found 0 entries
2-10-2016 12:22:26 > [Indexer] Starting new indexation
2-10-2016 12:22:26 > [Indexer] Downloading compressed data[]
2-10-2016 12:22:31 > [Indexer] Downloaded
2-10-2016 12:22:31 > [Indexer] Extracting data
2-10-2016 12:22:31 > [Indexer] Error occured, retrying
2-10-2016 12:22:33 > [Indexer] Downloading compressed data[]
2-10-2016 12:22:37 > [Indexer] Downloaded
2-10-2016 12:22:37 > [Indexer] Extracting data
2-10-2016 12:22:37 > [Indexer] Error occured, retrying
using nodejs v4.3.1
It's like he is not getting the id or something?
As mentionned by @dukenuking:
2-10-2016 12:55:52 > [Indexer] There was an error inserting value: undefined
Loading data into DB: 2377ms
2-10-2016 12:55:52 > [Indexer] Next ID: 6892-7570-6012-10171-3898
2-10-2016 12:55:52 > [Indexer] Cleaning up
I just tested it, and it works fine on Windows 10?
So am I missing something, or does this indeed work on Windows?
To reproduce :
Search for gloves with
#% of Physical Attack Damage Leeched as Life
Expected :
0.xx% LL
Result
0% LL
A declarative, efficient, and flexible JavaScript library for building user interfaces.
๐ Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
An Open Source Machine Learning Framework for Everyone
The Web framework for perfectionists with deadlines.
A PHP framework for web artisans
Bring data to life with SVG, Canvas and HTML. ๐๐๐
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
Some thing interesting about web. New door for the world.
A server is a program made to process requests and deliver data to clients.
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Some thing interesting about visualization, use data art
Some thing interesting about game, make everyone happy.
We are working to build community through open source technology. NB: members must have two-factor auth.
Open source projects and samples from Microsoft.
Google โค๏ธ Open Source for everyone.
Alibaba Open Source for everyone
Data-Driven Documents codes.
China tencent open source team.