data:data_analysis_manual
Differences
This shows you the differences between two versions of the page.
| Both sides previous revision Previous revision Next revision | Previous revision | ||
|
data:data_analysis_manual [2024/01/23 19:27] eric buchlin [Burn-in Effects] corrected files published in data release 4.0 |
data:data_analysis_manual [2024/03/29 14:21] eric buchlin [Find data] format warning |
||
|---|---|---|---|
| Line 2: | Line 2: | ||
| <WRAP center round important 70%> | <WRAP center round important 70%> | ||
| - | This manual is very preliminary, please be patient or help adding what is missing. | + | This manual is preliminary, please be patient or help adding what is missing. |
| </WRAP> | </WRAP> | ||
| Line 58: | Line 58: | ||
| - Run SPICE\_CAT | - Run SPICE\_CAT | ||
| * The catalogue of all files in a specific data release is included with the data release (see below). This version of the catalogue also include additional columns for the list of windows, the file size, and a reference to the dark used for on-ground dark subtraction. | * The catalogue of all files in a specific data release is included with the data release (see below). This version of the catalogue also include additional columns for the list of windows, the file size, and a reference to the dark used for on-ground dark subtraction. | ||
| - | * How to use it in Python: a [[data:data_analysis_manual:read_catalog_python|simple script]] can be used to read it as a Python pandas DataFrame object. The same can be done using the ''Catalog'' object from the [[https://sospice.readthedocs.io/en/stable/|''sospice'' Python module]] (see examples in [[https://git.ias.u-psud.fr/spice/data-analysis-club/-/blob/main/20230627-sospice/sospice-demo.ipynb|this tutorial]]). | + | * How to use it in Python: the catalogue can be read as a ''Catalog'' object from the [[https://sospice.readthedocs.io/en/stable/|''sospice'' Python module]], and then used to find observations with specific characteristics (see examples in [[https://git.ias.u-psud.fr/spice/data-analysis-club/-/blob/main/20230627-sospice/sospice-demo.ipynb|this tutorial]]). |
| * How to use it in IDL: [[data:data_analysis_manual#the_spice_catalog|see below]] | * How to use it in IDL: [[data:data_analysis_manual#the_spice_catalog|see below]] | ||
| Line 65: | Line 65: | ||
| * All L1 and L2 files with their latest versions (at a given date) are collected in a data release | * All L1 and L2 files with their latest versions (at a given date) are collected in a data release | ||
| - | * The releases are provided under https://spice.osups.universite-paris-saclay.fr/spice-data/ | + | * The releases are provided under https://spice.osups.universite-paris-saclay.fr/spice-data/, in subdirectories named ''release-{release_tag}/'' |
| + | * The latest release tag can be obtained from the content of [[https://spice.osups.universite-paris-saclay.fr/spice-data/metadata/latest-release.txt|latest-release.txt]] | ||
| * Released files are also sent to the SOAR (see below) | * Released files are also sent to the SOAR (see below) | ||
| * The latest release is updated with new data as they arrive (and after a superficial validation step). | * The latest release is updated with new data as they arrive (and after a superficial validation step). | ||
| Line 72: | Line 73: | ||
| SOAR: | SOAR: | ||
| - | * [[https://soar.esac.esa.int/|SOAR]] ([[https://issues.cosmos.esa.int/solarorbiterwiki/display/SOSP/SOAR+(Solar+Orbiter+Archive)+-+How+to+Use|how to use it]], [[https://www.cosmos.esa.int/web/soar/home|SOAR help pages]]) | + | * [[https://soar.esac.esa.int/|SOAR]] ([[https://issues.cosmos.esa.int/solarorbiterwiki/display/SOSP/SOAR+(Solar+Orbiter+Archive)+-+How+to+Use|how to use it]], [[https://www.cosmos.esa.int/web/soar/home|SOAR help pages]], [[https://www.cosmos.esa.int/web/soar/inventory-plots|SOAR data coverage]]) |
| * SOAR has a TAP interface that can be used for automated queries ([[https://www.cosmos.esa.int/web/soar/tables-views-and-columns|documentation of available tables]]) | * SOAR has a TAP interface that can be used for automated queries ([[https://www.cosmos.esa.int/web/soar/tables-views-and-columns|documentation of available tables]]) | ||
| * The ''sunpy-soar'' [[https://github.com/sunpy/sunpy-soar/|Python module]] uses this TAP interface for queries through SunPy/Fido | * The ''sunpy-soar'' [[https://github.com/sunpy/sunpy-soar/|Python module]] uses this TAP interface for queries through SunPy/Fido | ||
| Line 80: | Line 81: | ||
| * Quicklook archive (to be developed) | * Quicklook archive (to be developed) | ||
| * [[https://github.com/ITA-Solar/solo-spice-ql/wiki/spice_xfiles|Quicklooks procedure in SSW]] | * [[https://github.com/ITA-Solar/solo-spice-ql/wiki/spice_xfiles|Quicklooks procedure in SSW]] | ||
| - | * A quicklook app (in Python) is in development at IAS. | + | * A [[https://git.ias.u-psud.fr/spice/data_quicklook|quicklook app]] (in Python) is in development at IAS. |
| * [[https://git.ias.u-psud.fr/spice/pre-analysis/|"Pre-analysis"]]: already processed quicklook images (per STP) | * [[https://git.ias.u-psud.fr/spice/pre-analysis/|"Pre-analysis"]]: already processed quicklook images (per STP) | ||
| Line 86: | Line 87: | ||
| * Released SPICE files are ingested from SOAR to the VSO ([[https://sdac.virtualsolar.org/cgi/search|search form]]) | * Released SPICE files are ingested from SOAR to the VSO ([[https://sdac.virtualsolar.org/cgi/search|search form]]) | ||
| * Accessible through IDL/SSW and Python/Fido | * Accessible through IDL/SSW and Python/Fido | ||
| + | * FIXME As of 2024-03-29, the SPICE files on VSO are old files from release 3.0 only | ||
| ===== Tips and Advice on Analyzing SPICE Data ===== | ===== Tips and Advice on Analyzing SPICE Data ===== | ||
data/data_analysis_manual.txt · Last modified: 2024/03/29 14:21 by eric buchlin
Page Tools
Except where otherwise noted, content on this wiki is licensed under the following license: CC Attribution-Share Alike 4.0 International
