Comments (6)
Hi @montanaflynn,
I usually add a small subset (max 30 pairs) to exchange-scrapers.json
for avoiding to increase too much the file in line for easy editing in the future if necessary. I agree with you that maybe it is better to automate the pairs population via request API, or at least choose from the two scenarios before run the scraper.
from diadata.
@PumpkingWok is that documented anywhere? Just pick random 30? I was looking for a specific token I know is traded on gate and didn't find it which is what led me to create this issue.
from diadata.
Hi @montanaflynn, it depends. In some old issues there was a list of preferred crypto pairs, but most of the time many pairs does not exist. I add the top volume pairs or the more known, most china exchange have crypto pair in top volume that I have never heard.
Which token don't you find on gate ? I can look on gateIO without problems, sometimes the name is little different, mostly with BCH.
Have a nice day !!!
from diadata.
Hi @montanaflynn very good point, we need to add some pairs discovery into the APIScraper interface
from diadata.
Ok so we would need a pair discovery service, that would fetch all available pairs for each exchange and store it in redis.
from diadata.
Closing, continues in #87
from diadata.
Related Issues (20)
- Who to contact for security issues HOT 1
- Write an Exchange scraper for AcalaSwap DEX HOT 2
- Write a Trades Scraper for BitMart Exchange HOT 3
- Write a Trades Scraper for MEXC Exchange HOT 4
- Write a Trades Scraper for Platypus Finance DEX HOT 1
- Write a Trades Scraper for BKEX Exchange HOT 1
- Write a Trades Scraper for Orca DEX on Solana HOT 2
- Add connection handling to MEXC trades scraper
- Fix Serum Asset Collector HOT 3
- Amend MagicEden NFT Trades Scraper
- Fix LBank Trades Scraper
- Write a Liquidity Scraper for Orca DEX
- Write a Trades Scraper for Bitstamp Exchange
- Write an NFT Trades Scraper for blur.io Marketplace HOT 5
- Write a Trades Scraper for Osmosis DEX on Cosmos HOT 5
- Write a Quotation Scraper
- Parse TokenExchangeUnderlying event from Curve.Finance contracts HOT 3
- Write a Google Finance Forex Scraper HOT 1
- Write Velodrome DEX Scraper Suite
- Write TraderJoe2.1 DEX Scraper Suite HOT 2
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from diadata.