Giter Site home page Giter Site logo

"this doesn't seem right" :smile: about .github HOT 6 CLOSED

ssbc avatar ssbc commented on May 21, 2024
"this doesn't seem right" :smile:

from .github.

Comments (6)

staltz avatar staltz commented on May 21, 2024 2

Yeah I know CI is telling me to remove @mycognosist but I don't feel like doing that. 😅 Our process (explained in a n SSB thread) is that these calculations inform us what to do but we don't need to blindly follow them. I disagree with the calculation this time because it seems like the trustnet score is gradually going down over time (not just for mycognosist, but for lots of other people, including me and arj and mix) and this doesn't seem right.

I believe soon enough the algorithm will tell us to add you, decentral1se. :)

from .github.

cblgh avatar cblgh commented on May 21, 2024 1

i wonder if it would be any different if you used the built-in breaks? on ssb i wrote about an experiment i did where i reimplemented what you're doing with the manual threshold, @staltz, but using the built-in mechanism of breaks and clustering. can't find that post while looking around tho cause patchwork's search is ass X)

with trustnet, the numeric score doesn't necessarily matter, so much as the final clusterings. e.g. you're using a fixed threshold (4) while the rankings are dynamically changing over time. how things are clustered depends on the differences in scores, thus the question about trying the built-in system of breaks, potentially tweaking things a bit with e.g. 4 breaks instead or something of that kind

some other things top of mind:

  • the metric used atm is probably naive if it's purely that a pr was merged without taking into account e.g. size of PR or type of repo? in other words: the trust weights are uniform for actions that might not be uniform.
  • also curious to see what would happen if there were different trust roots, e.g. arj or staltz and compare that with dominic.
  • as noted this underlying point that people in the graph are competing for energy is definitely the weakpoint of trustnet as it is today! it's basically a fundamental flaw that comes from how the graph is evaluated with appleseed. the flaw doesn't matter as much in a moderation context since direct trust assignments from the root are implicitly included in the final trusted group e.g. me trusting A, B, C => A, B, C guaranteed to be trusted in final output

anyway it's interesting to see real life data coming of it in a non-moderation setting :)

from .github.

cblgh avatar cblgh commented on May 21, 2024 1

oh and two more cents:

the strategy of using a clustering algorithm to split the rankings into different groups (3, as of writing) was only ever intended to be one strategy trustnet could use in refining the final set of rankings into a final group of trusted peers :> it happens to be a great fit for the subjective moderation context, where you know who you are trusting directly and don't mind getting in some recommendations from those peers according to how much they are trusted.

in this more uniform and widespread graph, perhaps something else makes more sense! i have a feeling, after looking at the numbers, that using perhaps 5-6 breaks of the clustering group would be enough to exclude very low trust-ranked contributors while lessening the inherent competitive dynamic of appleseed's energy propagation

from .github.

decentral1se avatar decentral1se commented on May 21, 2024

Haha, right! Title updated to reflect algorithmic suspicion 🙃

from .github.

staltz avatar staltz commented on May 21, 2024

@cblgh what are "breaks"?

from .github.

cblgh avatar cblgh commented on May 21, 2024

@staltz what i call it when you break the computed rankings into different clusters; breaking something continuous into smaller pieces (e.g. an uncooked noodle, crispbread, what have you): https://github.com/cblgh/trustnet/blob/master/trustnet.js#L70

from .github.

Related Issues (4)

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.