astromatic/scamp

Compute astrometric solutions from SExtractor catalogs

SCAMP

a utility that computes astrometric solutions from SExtractor catalogs.

Check out the on-line documentation, the official web page, and the user forum.

scamp's Issues

missing script in xsl file

I'm trying to display an xml file with Firefox, however, the tables no longer expand. I get the following error:

Loading failed for the <script> with source “http://terapix.iap.fr/cplt/xsl/sorttable.js”

If I visit terapix.iap.fr, here is the message i get:

Thank you for your interest in content once hosted at terapix.iap.fr!
These pages have now been archived on a new server at calet.org.
They will no longer be updated.
If you can't find what you are looking for, please take a look at the archive layout.

is sorttable.js available somewhere else?

scamp 2.9.0/ 2.9.2 segmentation fault on Ubuntu 20.04 LTS

scamp-2.9.2.log
Hi,
I hope this is the right place to let you know:
calling scamp with many files ( 177 pc and more or maybe less) starts but crashes.
I put you a log file from 2> console.
If I split the files in two groups, both groups run correctly each. Putting both groups together, it does not. ( samp is driven by Theli V3, Schirmer )
It is curious, because the old version 2.0.4 right out of of a distribution deb file does not crash, but could not resolve properly.scamp-2.9.2.log
Ubuntu 20.04 LTS, on a virtual Box, 4 GB RAM, 4 CPU,
Regards
Carsten

SCAMP 2.7.2 seg fault on Mac when calculating colour shifts

With ATLAS from fink, see attached crash report
scamp_2018-08-23-162304_macprojb.crash.zip

SCAMP 2.7.0 gives pairs of sources at exactly the same positions and epochs, but significantly different magnitudes

Using the command
~/Soft/scamp/bin/scamp -c /Volumes/baskerville/erosdata/astromatic_params/scamp.conf lm*/lm*cat -MATCH_RESOL 0.3 -CROSSID_RADIUS 0.3
then on two catalogue directories corresponding to the two EROS-2 cameras yields pairs of sources at exactly the same positions and epochs.
Working data are at link https://mycore.core-cloud.net/index.php/s/yEedrCdjY67R6tu
scamp.conf file is attached below.
For example in full_1.cat from the above link:
For CATALOG_NUMBER = 595, PHOT_INSTRUM = 2, and SOURCE_NUMBER = 9921, 9922, both have exactly the same coordinates, but the former has MAG = -5.429747 while the latter has MAG = -3.4192264

Working on Mac Darwin Kernel Version 16.7.0

Thanks for any hint,
Cheers,
JB

scamp.conf.zip

GAIA mags

GAIA-DR2 provides three magnitudes Gmag, GBmag and GRmag. They should be provided by the usual scheme for ASTREF-BAND (DEFAULT, BLUEST, REDDEST).

What replaced FGROUP_RADIUS

Older versions of scamp had the parameter FGROUP_RADIUS in the config file, however this quantity has been removed from later versions. Where can I set the field size now?

Wrong RA in photometric matching in SCAMP 2.10.0

Using 993 catalogues from EROS-2 "blue" camera and 962 catalogues from the "red" one leads to numerous negative right ascension values in the merged catalogue.
Processing those data independently of each other works fine.

Command line parsing error with "--astrefmag_limits"?

Hi Emmanuel,
I recently switched to Debian 11 which carries scamp version 2.10.0. This version might have a possible bug when parsing the command line option for ASTREFMAG_LIMITS, e.g. when using

scamp ... -astrefmag_limits -99,14.5 ...

I do obtain the error message

astrefmag_limits list has not enough members

Everything works as expected when providing the same parameter values via a config file.
Thanks for help,
Thomas

Error while loading shared libraries

Hi,

I have followed the whole installation and everything seems to have been installed properly.
However, when I call "scamp" in my shell, I get the following error message:

scamp: error while loading shared libraries: libtatlas.so: cannot open shared object file: No such file or directory

Libtatlas.so is in location /local/atlas/lib and I don't know how Scamp searches for such file.
I have been looking for a long time now and I found no solution for my problem.

Can you help me ?

2.10: test error on big endian systems

The version 2.10 fails on one test when compiled on big endian systems like PowerPC 64 bit or IBM zSystems with :

FAIL: test_integration01.py
===========================


> WARNING: This executable has been compiled using a version of the ATLAS library without support for multithreading. Performance will be degraded.

sh: 1: convert: not found

> WARNING: FLAGS parameter not found in catalog GAIA-DR1_1334+3754_r46.cat


*** PLPLOT WARNING ***
Driver does not support hardware solid fills, switching to software fill.

Running Test #1 ...
SCAMP execution          ... passed
Minimum AS contrast: 44.1086 expected: > 22.00 ... passed
Minimum XY contrast: 48.8126 expected: > 22.90 ... passed
# of matched detections: 189983 expected: > 180100 ... passed
# of matched references: 2226 expected: > 1640 ... passed
Internal dispersion: 0.0354290517341998 expected: < 0.035 ... failed
Reference dispersion: 0.09366372231264102 expected: < 0.097 ... passed
1 errors.
FAIL test_integration01.py (exit status: 1)

Full build logs here for S390x (official Debian architecture), and here for PowerPC 64 bit (additional port).
I could ofcourse just adjust the limit for the internal dispersion, but I am afraid that this may hide a real problem.

Incomplete retrieval of ALLWISE reference catalog - solved (kind of)

My photometry code fails when using ALLWISE as a Scamp reference catalog but works fine for, e.g., 2MASS. The reason is a lack of common objects, as illustrated by the attached figure. It shows detections (green), 2MASS stars (cyan), and ALLWISE objects (red). The retrieval of NEOWISE sources is incomplete. This is for SCAMP version 2.10.0 (2020-12-12).
I recommend to replace ALLWISE with the more recent catWISE2020 catalog.

Segmentation Fault during Photometry (ver 2.6.2)

Dear Emmanuel,

I am encountering an issue where SCAMP crashes due to a segmentation fault during the photometry stage:

----- Photometric stats (external):

                     All detections     |        High S/N        
         Instru mag RMS    chi2  nstars | mag RMS    chi2  nstars

Segmentation fault (core dumped)

I wonder if this is a well-known issue related to something I did during the configuration stage? I configured with OpenBLAS since my ATLAS libraries are a mess and I couldn't make that work.

I have been using Astromatic software packages for a few years now and very much appreciate the work you put in to them.

James

Output header files .head

How to read .head file? Fits complains that it is not valid fits file, and I want to read it so I can create wcs and use it to convert pixel coordinates to sky coordinates

split blas and lapack in configure

One thing that would help building on a mac (where installing openblas and lapack happens separately) is to allow options to separately specify blas and lapack (rather than just a single path to atlas).

Epoch parameter in Group description lacks of decimals

Example:
Group 1: 12 fields at 05:23:13.51 -69:45:39.3 with radius 48.36'
instruments epoch center coordinates radius scale
lm00106l0250.mef.cat A1 P1 1996.9 05:23:12.61 -69:45:43.6 48.11' 0.6024"
lm00106l0444.mef.cat A1 P1 1996.9 05:23:12.56 -69:45:41.2 48.11' 0.6024"
lm00106l0665.mef.cat A1 P1 1996.9 05:23:11.71 -69:45:39.3 48.11' 0.6024"
lm00106l0841.mef.cat A1 P1 1996.9 05:23:12.63 -69:45:36.1 48.11' 0.6024"
lm00106l1018.mef.cat A1 P1 1996.9 05:23:11.21 -69:45:48.0 48.11' 0.6024"
lm00106l1236.mef.cat A1 P1 1996.9 05:23:12.66 -69:45:44.0 48.11' 0.6024"
lm00106l1443.mef.cat A1 P1 1997.0 05:23:15.04 -69:45:36.0 48.11' 0.6024"
lm00106l1693.mef.cat A1 P1 1997.0 05:23:13.36 -69:45:42.5 48.11' 0.6023"
lm00106l1818.mef.cat A1 P1 1997.0 05:23:16.08 -69:45:33.7 48.11' 0.6024"
lm00106l2048.mef.cat A1 P1 1997.0 05:23:13.19 -69:45:34.0 48.11' 0.6024"
lm00106l2452.mef.cat A1 P1 1997.0 05:23:16.01 -69:45:38.3 48.11' 0.6024"
lm00106l2932.mef.cat A1 P1 1997.0 05:23:15.12 -69:45:34.4 48.11' 0.6024"

All these catalogs are from images of 1996, the last one from 29 December 1996. But at some stage the rounding of Epoch yields 1997.0, which is confusing. Some more decimals should be useful.

*Error*: incorrect linear conversion in TAN

I've been trying to get Photometry Pipeline working for an astronomer (I am just in IT) but I've hit an issue while testing the installation with example data.

When running the pipeline, it seems that scamp fails to create an output file. I've traced down that this is the command being ran:
scamp -c ~/photometrypipeline/setup/vatt4k.scamp -ASTR_FLAGSMASK 0x00fc -FLAGS_MASK 0x00fc -ASTREF_CATALOG FILE -ASTREFCAT_NAME GAIA.cat mscience0218.ldac

Running this command on it's own produces the output seen below (same as when ran with PP). I believe the convert: missing required argument error is the cause of the issue, but I've tried to dig into the code and cannot find reference to this conversion. Any help or guidance is greatly appreciated.

Link to the conf file being used: https://github.com/mommermi/photometrypipeline/blob/master/setup/vatt4k.scamp

> WARNING: FGROUP_RADIUS keyword unknown
 
 
> WARNING: Obsolete configuration; replacing cocat1.u-strasbg.fr with vizier.u-strasbg.fr
 
convert: missing required argument  @ error/convert.c/ConvertImageCommand/565.
----- SCAMP 2.10.0 started on 2023-11-20 at 11:34:28 with 8 threads
 
----- 1 input:
mscience0218.ldac:  "3552               "  no ext. header   1 set     234 detections
 
----- 234 detections loaded
> 
----- 1 instrument found for astrometry:
 
Instrument A1 :
1 extension
FILTER  = 'TOP 2 BOT 1'                                                         
QRUNID  =                                                                       
 
----- 1 instrument found for photometry:
 
Instrument P1 :
FILTER  = 'TOP 2 BOT 1'                                                         
 
----- 1 field group found:
 
 Group  1: 1 field at 11:58:07.99 +00:19:56.7 with radius 8.985'
                  instruments  epoch      center coordinates     radius   scale 
mscience0218.ldac    A1  P1    2017.1  11:58:07.99 +00:19:56.7   8.985'  0.3750"
 
----- Reference catalogs:
 
> Loading Catalog GAIA.cat...
> WARNING: FLAGS parameter not found in catalog GAIA.cat
 
 654 astrometric references loaded from GAIA.cat
 Group  1:      654 standards found in file (1 band)
 
----- Astrometric matching:
 
 Group  1:      654 standards in file (band 1)
              instruments  pos.angle   scale    cont.        shift        cont.
mscience0218.ldac  A1  P1    nan deg   0.000"   10.4 +2.9e+34"+3.6e+34"   9.35
 
chealpix.c, 858 (ang2pix_nest64):fications in group 1
theta out of range

Compile error on Ubuntu 22.04

I try to compile the latest git-code on Ubuntu 22.04. The configure step runs fine but make stops with the error:

poly.c: In function ‘poly_solve’:
poly.c:594:24: error: type of formal parameter 1 is incomplete
  594 |   return clapack_dposv(CblasRowMajor, CblasUpper, n, 1, a, n, b, n);
      |                        ^~~~~~~~~~~~~

The same issue appears again later in the file poly.c:

poly.c: In function ‘poly_initortho’:
poly.c:807:18: error: type of formal parameter 1 is incomplete
  807 |   clapack_dtrtri(CblasRowMajor, CblasLower, CblasNonUnit, ncoeff,
      |                  ^~~~~~~~~~~~~

As there is a scamp 2.10 as an Ubuntu 22.04 package, this issue must have been solved already and I ask before digging into it myself. Does anybody know the solution?

Here the output of the configure script:

 checking for a BSD-compatible install... /usr/bin/install -c
checking whether build environment is sane... yes
checking for a race-free mkdir -p... /usr/bin/mkdir -p
checking for gawk... gawk
checking whether make sets $(MAKE)... yes
checking whether make supports nested variables... yes
******** Configuring:  SCAMP 2.10.0 - 1 (2023-11-07) ********
checking if compilation flags are set automatically... no
checking whether the INTEL compiler is enabled... no
checking whether INTEL's MKL is enabled... no
checking whether make supports the include directive... yes (GNU style)
checking for gcc... gcc
checking whether the C compiler works... yes
checking for C compiler default output file name... a.out
checking for suffix of executables... 
checking whether we are cross compiling... no
checking for suffix of object files... o
checking whether the compiler supports GNU C... yes
checking whether gcc accepts -g... yes
checking for gcc option to enable C11 features... none needed
checking whether gcc understands -c and -o together... yes
checking dependency style of gcc... gcc3
checking for library containing strerror... none required
checking build system type... x86_64-pc-linux-gnu
checking host system type... x86_64-pc-linux-gnu
checking how to print strings... printf
checking for a sed that does not truncate output... /usr/bin/sed
checking for grep that handles long lines and -e... /usr/bin/grep
checking for egrep... /usr/bin/grep -E
checking for fgrep... /usr/bin/grep -F
checking for ld used by gcc... /usr/bin/ld
checking if the linker (/usr/bin/ld) is GNU ld... yes
checking for BSD- or MS-compatible name lister (nm)... /usr/bin/nm -B
checking the name lister (/usr/bin/nm -B) interface... BSD nm
checking whether ln -s works... yes
checking the maximum length of command line arguments... 1572864
checking how to convert x86_64-pc-linux-gnu file names to x86_64-pc-linux-gnu format... func_convert_file_noop
checking how to convert x86_64-pc-linux-gnu file names to toolchain format... func_convert_file_noop
checking for /usr/bin/ld option to reload object files... -r
checking for objdump... objdump
checking how to recognize dependent libraries... pass_all
checking for dlltool... no
checking how to associate runtime and link libraries... printf %s\n
checking for ar... ar
checking for archiver @FILE support... @
checking for strip... strip
checking for ranlib... ranlib
checking command to parse /usr/bin/nm -B output from gcc object... ok
checking for sysroot... no
checking for a working dd... /usr/bin/dd
checking how to truncate binary pipes... /usr/bin/dd bs=4096 count=1
checking for mt... mt
checking if mt is a manifest tool... no
checking for stdio.h... yes
checking for stdlib.h... yes
checking for string.h... yes
checking for inttypes.h... yes
checking for stdint.h... yes
checking for strings.h... yes
checking for sys/stat.h... yes
checking for sys/types.h... yes
checking for unistd.h... yes
checking for sys/param.h... yes
checking for dlfcn.h... yes
checking for objdir... .libs
checking if gcc supports -fno-rtti -fno-exceptions... no
checking for gcc option to produce PIC... -fPIC -DPIC
checking if gcc PIC flag -fPIC -DPIC works... yes
checking if gcc static flag -static works... yes
checking if gcc supports -c -o file.o... yes
checking if gcc supports -c -o file.o... (cached) yes
checking whether the gcc linker (/usr/bin/ld -m elf_x86_64) supports shared libraries... yes
checking whether -lc should be explicitly linked in... no
checking dynamic linker characteristics... GNU/Linux ld.so
checking how to hardcode library paths into programs... immediate
checking whether stripping libraries is possible... yes
checking if libtool supports shared libraries... yes
checking whether to build shared libraries... yes
checking whether to build static libraries... yes
checking for sin in -lm... yes
checking for egrep... (cached) /usr/bin/grep -E
checking for dlfcn.h... (cached) yes
checking for fcntl.h... yes
checking for limits.h... yes
checking for malloc.h... yes
checking for stdlib.h... (cached) yes
checking for string.h... (cached) yes
checking for sys/mman.h... yes
checking for sys/types.h... (cached) yes
checking for unistd.h... (cached) yes
checking for an ANSI C-conforming const... yes
checking for off_t... yes
checking for size_t... yes
checking for unsigned long long int... yes
checking for long long int... yes
checking for unsigned long long int... (cached) yes
checking whether struct tm is in sys/time.h or time.h... time.h
checking how to run the C preprocessor... gcc -E
checking for uid_t in sys/types.h... yes
checking for error_at_line... yes
checking for getpagesize... yes
checking for working mmap... yes
checking whether lstat correctly handles trailing slash... yes
checking whether stat accepts an empty string... no
checking for strftime... yes
checking for atexit... yes
checking for getenv... yes
checking for mallopt... yes
checking for memcpy... yes
checking for memmove... yes
checking for memset... yes
checking for mkdir... yes
checking for munmap... yes
checking for setlinebuf... yes
checking for strstr... yes
checking for sysconf... yes
checking for isnan... yes
checking for special C compiler options needed for large files... no
checking for _FILE_OFFSET_BITS value needed for large files... no
checking for _LARGEFILE_SOURCE value needed for large files... no
checking whether OpenBLAS is enabled... no
checking whether PLPlot is enabled... no
checking for profiler mode... checking best linking option... no
checking for multithreading... maximum of 1024 thread(s)
checking for pthread.h... yes
checking for the pthreads library -lpthreads... no
checking whether pthreads work without any flags... yes
checking for joinable pthread attribute... PTHREAD_CREATE_JOINABLE
checking if more special flags are required for pthreads... no
checking for cc_r... gcc
checking for fftw3.h... yes
checking for fftwf_execute in -lfftw3f... yes
checking for fftwf_init_threads in -lfftw3f... no
checking for fftwf_init_threads in -lfftw3f_threads... yes
checking for cblas.h... yes
checking for clapack.h... yes
checking for library containing clapack_dpotrf... no
checking for library containing clapack_dpotrf... no
checking for library containing clapack_dpotrf... no
checking for library containing clapack_dpotrf... -llapack_atlas
configure: WARNING: Parallel ATLAS not found, reverting to serial!
checking for curl-config... no
checking for curl/curl.h... yes
checking for library containing curl_easy_init... -lcurl
checking for PLPlot pkg-config info... yes
***************************************************************
Compile cmdline:  gcc   -I/usr/include/plplot    -D_REENTRANT -g -O2
Link    cmdline:  gcc   -lcurl  -llapack_atlas -lfftw3f_threads -lfftw3f -lm   -lplplot
Default XSLT URL: 
***************************************************************
checking that generated files are newer than configure... done
configure: creating ./config.status
config.status: creating Makefile
config.status: creating scamp.spec
config.status: creating debian/Makefile
config.status: creating debian/changelog
config.status: creating doc/Makefile
config.status: creating doc/src/conf.py
config.status: creating man/Makefile
config.status: creating man/scamp.1
config.status: creating src/Makefile
config.status: creating src/fits/Makefile
config.status: creating src/wcs/Makefile
config.status: creating tests/Makefile
config.status: creating config.h
config.status: config.h is unchanged
config.status: executing depfiles commands
config.status: executing libtool commands