Giter Site home page Giter Site logo

Comments (3)

rmcelreath avatar rmcelreath commented on August 24, 2024 1

Michael Betancourt has a long post about this: https://betanalpha.github.io/assets/case_studies/hierarchical_modeling.html

I didn't review it this morning, but if I remember right, you get an inverted funnel problem when the likelihood is strong and use non-centered.

from rethinking.

rmcelreath avatar rmcelreath commented on August 24, 2024

Hi Chris. This is a major topic in my book and course, the centered vs non-centered parameterizations of multilevel priors. In the book, see Chapter 13. In most recent lectures, lecture 13. Here's a linked set to the beginning of the relevant section:

https://www.youtube.com/watch?v=sgqMkZeslxA&list=PLDcUM9US4XdPz-KxHM4XHt7uUVGWWVSus&index=13&t=2432s

Lecture 14 has more content on the topic, including some technical aspects with multivariate priors.

from rethinking.

cjungerius avatar cjungerius commented on August 24, 2024

Thank you! These are exactly the bits of your lecture series I watched last night which led to my edit - which has taught me a valuable lesson about not taking shortcuts 😅. Because of various factors, including brms using non-centered parameterization as the default, I assumed it was strictly better than the alternative. I understand now that my type of data (many trials, approximately equal trial numbers for each condition for each participant) might be an example of a case where it is not.

Out of curiosity, is there any intuition for why the non-centered parameterization does worse in such data dominant cases? I mean to say: I understand the opposite, where unnesting allows for more efficient exploration of e.g. Neal's funnel-type posteriors, but how can the unnesting of parameters make the posterior harder for the MCMC chains to explore? Is it because the chains spend a lot of time in low-probability areas when the exploration of e.g. a_bar is made independent from the lower level parameters?

I clearly have some more reading to do, so I shall return to the relevant chapters of your book. Thanks again!

from rethinking.

Related Issues (20)

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.