Giter Site home page Giter Site logo

man90es / bdo-rest-api Goto Github PK

View Code? Open in Web Editor NEW
14.0 6.0 4.0 165 KB

Scraper for Black Desert Online community data with a built-in API server.

Home Page: https://man90es.github.io/BDO-REST-API/

License: MIT License

Go 99.06% Dockerfile 0.89% Procfile 0.05%
go rest-api blackdesertonline scraper rest api bdo blackdesert

bdo-rest-api's Introduction

bdo-rest-api's People

Contributors

dependabot-preview[bot] avatar man90es avatar

Stargazers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

Watchers

 avatar  avatar  avatar  avatar

bdo-rest-api's Issues

Failed to fetch

o/

Ur Guildranking website seems to be fail to fetch the data since a while now. just wanted to let u know. maybe u could look into it.

greetings

Caching issue

During the website maintenance today, I requested a profile search through my application to see how it handles unexpected responses. The API returned 503 as expected. Approximately 5 hours later, I tried requesting the same profile search but until now, I get the same response.

However, if I omit the &region=EU parameter (which was provided in the initial request during maintenance), I do get the correct search result. But when I add back the parameter, it responds with 503 again.

Aside from that, it seems to me like negative lookups are cached for too long (at least for responses other than 404), as even if I prevent API calls during usual maintenance times, I cannot prevent others from requesting that profile.

Query Length Restriction inadequate

It seems like the restriction of /adventurer/search query strings to no more than 16 characters is inadequate. Family names with more than 16 characters exist and are searchable on the website, so I believe this restriction should be removed.

I'm not sure why the restriction exists or if there is currently a length restriction for new accounts. The instance I am aware of which is longer than 16 characters resulted from a name change due to the old name breaking the rules. But clearly such names are possible and the website search supports them.

Some profiles are unreachable

So i use this to scrap a bunch of guilds from my server, since 17 of november some profiles are unrecheable no just by API also on their website.

Seems api is bugged or has removed some profiles witouth no reason, it happens in all guilds. fam_name targetProfile is given in the guildprofile response but once u use that for get specific profile information it returns 404

example in EU:
Len tbXSK7e39Sb3U3yPi7UDjg2VSLOpE%2BViBWRPOyKN0Jx4w%2B8Xgk7UqdBmnpY1yK3PN%2Bo0C5aPPAP%2FpF%2FoaRwwv6SDqEdT4xN85Yop2aDfa8uFnIxCYV4HdEurwZ7%2F7%2BeSw5FzoCGuFS%2FBED8zhR6pH51tM1Ttu1Im3RDQoDWyEwE%3D

Summer_Rains tbXSK7e39Sb3U3yPi7UDjo3CEsmGRkA8X6TawCH5ThlTAhurEUBQhiA1DhxKseeMK6zhqeHW2SvyICr8yHGAmaRhBQ0GiLOHhZZQFwoBB6aTpR6PLCnBSeLutepqvoJXoKbQgVAzxajAJPA7cRhFaU557WyZpwB7Ni8WskRvpNfPHmVTqxtvKS20oIirIZxx

Slowot tbXSK7e39Sb3U3yPi7UDjhhgm9NtzBE%2F8lNhXWL%2F8MiIqNBZvBafIaiZGpiXPjyma2PEJb%2BPk%2BZkNT3qXhVmgEC4wOlM39FlWQYh850I2wPDydp2C8fHtlZoaIlWDKqudnA96CRFjcDlVE66DKVJMwQkFyt7CdU5%2BAYtFePjU1Y%3D

Detect main character

On the BDO website, the player's selected "main" character is visually identified on the profile page, but this info is not parsed.

Parse a copy of provided data

Currently, if a user provides data like guild name when making a request, this info is not parsed but copied to the response.
But since the official website is bugged, it sometimes returns irrelevant data.
It would be easier for API users to work around such issues if this scraper parsed all data.

Profile Error

I can't seem to get the response of https://bdo.hemlo.cc/communityapi/v1/adventurer?profileTarget=tbXSK7e39Sb3U3yPi7UDjkszPyso2WujtM3ghFiULdHT9qX8fqF0ssHBh/gphTNwomVWBHd9j8yu8EA9uaGUmCtXp76ix+Q59Cja/otSuj7WR0o9KzzcZO9oehNgBeUqi0wQW/NlqAJpCSziUpxkkbPjW+vkxu7oi7I7rNuzW0s=&region=EU from the api. I always get a 404 error with no content. On the other hand this request does work (https://bdo.hemlo.cc/communityapi/v1/guild?guildName=Vexa&region=EU). Online https://bdo.hemlo.cc/leaderboards/EU/Vexa/farming it works too, just can't seem to get it working. Tried using headers and ua. The only thing I can think of is that it uses HTTP3.0 and not 1.x or 2.x

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.