Comments (29)
Hi all,
as soon as this PR ReScience/articles#14 and this PR ReScience/rescience.github.io#93 are merged, the paper should appear on the ReScience website!
Congratulations @apdavison !
from submissions.
I can edit this.
from submissions.
Many thanks @rougier, I've added more explanation to the manuscript as you suggested.
@otizonaizit I think everything is now ready to go.
from submissions.
The paper is online: https://rescience.github.io/read/
from submissions.
Thank your for your submission, we'll assign an editor soon.
@otizonaizit @gdetor @eroesch Can you edit this submission for the Ten Years Reproducibility Challenge (only 1 reviewer needed. Reproduction using Neuron and hoc language.
from submissions.
@rossant : would you be up to review this?
from submissions.
@pdebuyl : would you be up to review this?
from submissions.
@pdebuyl : friendly ping. Can you review this?
from submissions.
sorry @otizonaizit I am not familiar with either the domain or the language, maybe someone else? I can do it after my other ongoing reviews if necessary.
from submissions.
OK @pdebuyl I'll look for another reviewer :-)
from submissions.
@heplesser : do you think you could review this? It is for the Ten Years Reproducibility Challenge, with a simplified review process (only one reviewer).
from submissions.
@heplesser : also, have a look at the guidelines for authors: I did not find them in the website...
from submissions.
@otizonaizit I work rather too closely with @apdavison to be a sufficiently impartial reviewer, I'm afraid.
from submissions.
It's getting difficult to get a reviewer. Sorry for the mass call, but is anyone of the Neuroscience reviewers up for review this paper?
@vitay @neuronalX @piero-le-fu @benureau @damiendr @anne-urai @stephanmg @pietromarchesi @miladh @mlosch @degoldschmidt @Vahidrostami @TiinaManninen @appukuttan-shailesh @rcaze @junpenglao @thmosqueiro @cJarvers @rgutzen @schmidDan
from submissions.
too far from my expertise, sorry.
from submissions.
Same here, sorry. Not my area of expertise.
from submissions.
Same for me, and at the moment I'm still occupied with another review, sorry.
from submissions.
I am a postdoc under Andrew Davison (one of the authors), so probably not ideal for me to take this up ;-)
from submissions.
I'll review it. See also apdavison/bulbnet-reproduction#1
from submissions.
from submissions.
@rougier : ping!
from submissions.
Thanks for the reminder. I'll try to do it by Friday night (I've started playing with the code). Ping me again if not done.
from submissions.
This paper was a real pleasure to review. It is well written and I had no problem to re-run most of the simulations (some were very long and I did no test them) and got the expected results with some discrepancies.
What is a bit troubling though is that for some figures, I got results very similar to the original article and a bit different from the replication (see figure 4B below: I think my re-run is closer to the original). For some other figures, my re-run is a bit farther from both the original and the replication. See for example figure 2b below. I guess this is linked with the initialization of the
pseudo-random number generator but the qualitative behavior seems a bit impacted. Any idea what could be the explanation ?
Apart from that, I've only a few minor comments and I spotted a typo.
-
"Compartmental models of the mitral and granule cells of the had..."
-> "Compartmental models of the mitral and granule cells of olfactory
bulb the had..." -
The time estimation of the different simulation could be added in the README since there is no progress indicator during a simulation and you have no idea if the simulation is running as expected.
-
In the dependencies, maybe you can add gnuplot as well.
-
I was lucky enough to have a warning about a failed conversion of ICC profile that indicated me where was the result. In the output of each simulation, there is a bunch of text but nothing said about where is the actual result.
Overall, the reproduction is really nice, especially given the complexity of the model and the number of results. Congratulations. And I was happy to learn that Gnuplot still exists and seem to be pretty stable.
from submissions.
@apdavison : could you comment on @rougier 's review? I think we are very near to publishing the paper. It would be nice to hear your comments so that we can move forward with this :-)
from submissions.
@otizonaizit yes, I haven't forgotten about it ;-) Based on @rougier's comments, I want to make a few tweaks to give more progress information, I'll do that this week.
from submissions.
Many thanks @rougier for your kind comments.
I've fixed the typo, added information about dependencies and the expected simulation times to the README, and the scripts now print the location of the outputs.
The differences in the figures are certainly due to the random number generator initialisation. For individual granule cell responses (Fig 2B using the numbering from the original manuscript, Fig 1B in the reproduction), the qualitative behaviour can indeed change considerably, as the seed affects the connectivity and hence the number of inputs each cell receives. At the network level, however, the qualitative behaviour is unchanged, as reflected in the mitral cell IPSC (Fig 2C; a disynaptic response) and in the granule cell population spike time histogram (Fig 2E). To confirm this, I've added an extra panel 'F' to Figure 1 (the reproduction of the original Fig. 2) which overlays the original mitral cell IPSC trace from 2003 on top of 50 runs of the simulation with different random seeds. The original trace lies within the range of responses seen with different seeds.
By the way, on re-running all of the simulations in a fresh install, I actually get results closer to what you posted above than to the figure in the first version of the manuscript. It is possible I was experimenting with different seeds when I produced the first version of the figures.
Finally, to increase the reproducibility further, I've built the manuscript using the Sumatra LaTeX package: each figure now links to a record on my website of the simulation that produced that figure.
from submissions.
@apdavison Thanks for the explanation. Maybe you can add a small paragraphs in the manuscript with the above explanations.
@otizonaizit I think we can accept the paper. There is one pending suggestion that @apdavison is free to take into account or not but apart from that, I think the paper's ready for publication.
from submissions.
Thanks @rougier !
@apdavison : let me know if you want to add the mentioned paragraph. You'll get a PR from me on your repo to update the metadata before publication.
from submissions.
Many thanks @rougier and @otizonaizit !
from submissions.
Related Issues (20)
- [Re] Reproductive pair correlations and the clustering of organisms HOT 54
- [Re] Object Detection Meets Knowledge Graphs HOT 50
- [Re] An anatomically constrained neural network model of fear conditioning HOT 27
- [Re] Groups of diverse problem-solvers outperform groups of highest-ability problem-solvers - most of the time HOT 68
- [Re] A general model of hippocampal and dorsal striatal learning and decision making HOT 40
- [¬Re]Simulating socioeconomic-based affirmative action HOT 66
- [Re] A Detailed Data-Driven Network Model of Prefrontal Cortex Reproduces Key Features of In Vivo Activity HOT 27
- [Re] Biodiversity of plankton by species oscillations and chaos HOT 42
- [Re] Periodic forcing of a limit-cycle oscillator: fixed points, Arnold tongues, and the global organization of bifurcations HOT 15
- [¬Re] Setting Inventory Levels in a Bike Sharing Network HOT 18
- [Re] A circuit model of auditory cortex HOT 16
- [Re] Predicting Dynamic Embedding Trajectory in Temporal Interaction Networks HOT 32
- [Re] Predictive model for the size of bubbles and droplets created in microfluidic T-junctions HOT 15
- [Re] Inter-areal balanced amplification enhances signal propagation in a large-scale circuit model of the primate cortex HOT 67
- [Re] Exploration in Model-based Reinforcement Learning by Empirically Estimating Learning Progress HOT 41
- [Re] The Discriminative Kalman Filter for Bayesian Filtering with Nonlinear and Non-Gaussian Observation Models HOT 17
- [Re] When Does Label Smoothing Help? HOT 12
- [Re] A Simple Framework for Contrastive Learning of Visual Representations HOT 28
- [Re] Bootstrap Your Own Latent: A new approach to self-supervised learning HOT 6
- [RE] MEDIRL Maximum Entropy Deep Inverse Reinforcement Learning for Human Social Navigation HOT 3
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from submissions.