Comments (8)
n(z) may not be ideal as you could have small storage errors that all average to zero and leave n(z) untouched. You thus may want to focus more on applications where individual object p(z)'s matter. Examples include cluster finding, intrinsic alignment mitigation in weak lensing, and strong lensing analyses. Of course Phil is an expert on the latter...
from qp.
I think the strong lensing environment requirements will be similar to those of cosmic shear, and be (more or less) that the n(z) comes out accurately. One cheap alternative to checking the hierarchical inference of n(z) is to use the "stacked p(z)" approximation, just to quantify how n(z) estimation accuracy depends on p(z) approximation.
I like the idea of checking some alternatives to n(z) on scientific grounds. Alex, let's talk to Eli Rykoff today about the cluster-finding application, and we can ask around on Slack for input on the IA application. On the galaxies side, are there uses for p(z)'s that suggest particular combinations of them? Thanks Jeff!
from qp.
Reports from Slack:
- David Alonso @damonge says:
"In the simplest scenario, we're interested in the global n(z) of a given sample (e.g. a photo-z redshift bin for a particular population), but ideally including the possible uncertainties on that n(z). It would be great to understand whether the latter can be provided and if so, in what format.
This is for the simplest analysis scenario we're envisaging right now, but other options might need individual p(z)'s."
- Michael Troxel @matroxel suggested we look at the mean inverse lensing sigma_crit, between pairs of redshift bins (and pointed to the test code he is using in DES here as a guide). He says:
Averaging sigma crit of individual pairs in two bins [tells] you something different [from n(z)].
You can produce sufficient signal to noise to directly measure the inferred bias without rescaling your covariance. We did both [this and the n(z) test] in the DES SV photo-z paper."
Thanks both! We'll look into these.
from qp.
For strong lensing, I thought you'd be interested in basically making a foreground mass map, which would require p(mass, z) for each potential foreground object?
For galaxies science I think there are few applications that would ever need very high precision, I'd look towards cosmology instead.
from qp.
from qp.
@drphilmarshall Are we still thinking of including metrics on Sigma_crit^-1? I think it's nontrivial to calculate without point estimators of redshift and don't want to muddy the waters with straying too many layers beyond the PDFs -- wouldn't this involve calculating metrics on quantities derived from point estimators derived from PDFs?
from qp.
from qp.
I'm closing this along with #57 now that #54 is done.
from qp.
Related Issues (20)
- Make the approximate PDFs HOT 1
- Metric analysis HOT 3
- Gridded approximation HOT 1
- Upgrade .travis.yml to make and deploy Note PDF HOT 2
- Data exploration notebook HOT 10
- Expand format conversion options HOT 2
- Code is not currently python3 compatible.
- Normalize all approximations HOT 2
- Parallelization
- qp.PDF.integrate() function
- Extrapolation options for qp.PDF interpolator
- Epic: Polishing for response to referee report HOT 2
- Bug in quantile interpolation HOT 3
- Paper revisions
- Extrapolation of probability may break normalization HOT 1
- Better handling of samples
- Need pathos installed HOT 1
- Epic: Major refactoring
- Rethink qp.PDF.limits HOT 1
- make an autoencoder representation
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from qp.