taskGNU Astronomy Utilities - Tasks: task #15892, Search VizieR datasets that cover...


You are not allowed to post comments on this tracker with your current authentication level.

task #15892: Search VizieR datasets that cover a certain location

Submitted by:  Mohammad Akhlaghi <makhlaghi>
Submitted on:  Fri 22 Jan 2021 05:18:13 PM UTC  
Should Start On:  Fri 22 Jan 2021 12:00:00 AM UTC Should be Finished on:  Fri 22 Jan 2021 12:00:00 AM UTC
Category:  Query Priority:  5 - Normal
Item Group:  Enhancement Status:  None
Privacy:  Public Percent Complete:  30%
Assigned to:  None Open/Closed:  Open
Effort:  0.00

( Jump to the original submission)

Wed 10 Mar 2021 08:59:17 AM UTC, comment #6: 

I fixed the box option and solve the units in the program, now it works with the same units in all options[degrees].

Thanks a lot Francois.

Adrián Hernández Padrón <adrihp06>
Project Member
Tue 09 Mar 2021 12:32:54 PM UTC, comment #5: 

Boxes are defined with the parameters -c.bd= (degrees) or -c.bm (arcmin) or -c.bs (arcsec), e.g. -c.bd=1x3 (rectangle of 1x3°) or just -c.bd=1 (for a 1x1° square).

For simple queries to vizier, and a short list of parameters, the GET method (with urlencoded parameters) is shorter and simpler than the form (--form); the GET message may alternatively be transmitted by appending the question mark and parameters separated by an ampersand to the remote server. Example:

curl "http://vizier.unistra.fr/viz-bin/asu-tsv?-c=123.45+54.321&-c.bd=1&-ucd=src.redshift"

is identical to

curl -G --data-urlencoded -c=123.45+54.321 --data-urlencoded -c.bd=1 --data-urlencoded -ucd=src.redshift http://vizier.unistra.fr/viz-bin/asu-tsv

Replacing the --data-urlencoded by --form (and removing the -G) generates a form, which is much more verbose.

If you would like to see the actual differences, I've a very simple script as http://www.ochsenbein.org/cgi-bin/Echo which shows exactly what is received, e.g. try

curl -G --data-urlencoded -c=123.45+54.321 --data-urlencoded -c.bd=1 --data-urlencoded -ucd=src.redshift http://www.ochsenbein.org/cgi-bin/Echo


curl --form -c=123.45+54.321 --form -c.bd=1 --form -ucd=src.redshift http://www.ochsenbein.org/cgi-bin/Echo

Francois Ochsenbein <fochsenbein>
Project Member
Mon 08 Mar 2021 08:23:38 PM UTC, comment #4: 

I made a commit adding the target and the radio/box option. I also add the curl with the ucd columns list and a format option for the output.
I have doubt about the curl from the box type, I use --form -c.br because was the only option that download data but I don't know if it correct.
I also update the help panel I recommend reviewing it before using the program.

Adrián Hernández Padrón <adrihp06>
Project Member
Sun 07 Mar 2021 07:24:19 PM UTC, comment #3: 

Just 2 remarks:

1) Would be useful to allow a target, not only via a FITS image, but also as a target parameter -c= which can be a circle (-c.r) or a box (rectangle: -c.r), following the ASU convention at
http://vizier.u-strasbg.fr/vizier/doc/asu.html (almost 25 years ago!). The box is aligned with the coordinate system (no tilt angle) therefore it's not as accurate as the descriptor of a FITS image, but it can still be useful, I guess.

2) The list of UCDs in VizieR can also be accessible with
curl "http://vizier.u-strasbg.fr/viz-bin/asu-tsv?-source=METAucd"

[ As a general rule, all elements describing the vizier tables (the list of "META" tables) can be accessed from
http://vizier.u-strasbg.fr/viz-bin/VizieR?-source=META ]

Francois Ochsenbein <fochsenbein>
Project Member
Wed 03 Mar 2021 07:54:22 PM UTC, comment #2: 

Adrian has written a first implementation for this job (focusing on redshifts within each catalog) in this respository.

I will try to test it soon and hopefully take the core command into  'astquery' to easily use with all the other aspects. Until then, if others get to look into it, try it and and provide feedback it would be great ;-).

Mohammad Akhlaghi <makhlaghi>
Project Administrator
Wed 17 Feb 2021 12:13:37 AM UTC, comment #1: 

Adrian Hernandez Padron recently found another way to limit the queried datasets to only those that have a redshift column:

curl -oz-meta.tsv --form -c=23.4621+30.66 --form -c.rm=5 --form -ucd=src.redshift http://vizier.unistra.fr/viz-bin/asu-tsv?-meta

After a search, I found the The UCD1+ controlled vocabulary (PDF) which describes all such columns.

François, is there a way to apply such a constraint in the TAP interface?

Mohammad Akhlaghi <makhlaghi>
Project Administrator
Fri 22 Jan 2021 05:18:13 PM UTC, original submission:  

VizieR is a very large database, containing many datasets. But most of the datasets only cover a portion of the sky. So when a user is interested in a certain part of the sky, it is very helpful for them to be able to limit the list of the datasets based on their covered position.

Doing this type of query based on the standard TAP features is not trivial. However, Francois Ochsenbein kindly noted that it is possible with ViziR's non-TAP interface with a command like below (for example to find catalogs within 5 arc-minutes of the RA,Dec coordinates of 23.4621, 30.66)

curl -oout.tsv --form -c=23.4621+30.66 --form -c.rm=5 http://vizier.unistra.fr/viz-bin/asu-tsv?-meta

If we remove the '?-meta' part, all the matching rows within this  center and radius will also be downloaded, and it is possible to download in FITS format (when one extension per matched catalog, each extension containing the rows of that table). However, this file can be large (because of all the data, for example the output above is 38Mb). So we only want the meta format here.

Currently in the 'meta' mode (which is what we want in this scenario) a FITS format output isn't supported. But the Tab Separated Value (TSV) output isn't hard to parse automatically. So we should add this feature for queries related to VizieR.

Mohammad Akhlaghi <makhlaghi>
Project Administrator


No files currently attached


Depends on the following items: None found

Items that depend on this one: None found


Carbon-Copy List
  • -email is unavailable- added by adrihp06 (Posted a comment)
  • -email is unavailable- added by fochsenbein (Posted a comment)
  • -email is unavailable- added by makhlaghi
  • -email is unavailable- added by makhlaghi (Submitted the item)
  • -email is unavailable- added by makhlaghi

    Do you think this task is very important?
    If so, you can add your encouragement to it.
    This task has 0 encouragements so far.

    Only logged-in users can vote.




    Follow 3 latest changes.

    Date Changed by Updated Field Previous Value => Replaced by
    2021-03-03 makhlaghi Percent Complete0% => 30%
    2021-02-17 makhlaghi Carbon-Copy- => Added alu0101034539@ull.edu.es
    2021-01-22 makhlaghi Carbon-Copy- => Added francois.ochsenbein@gmail.com

    Back to the top

    Powered by Savane 3.6