User Tools

Site Tools


data:data_analysis_manual

**This is an old revision of the document!**

Data analysis user's manual

This manual is very preliminary, please be patient or help adding what is missing.

Introduction

SPICE instrument and capabilities

SPICE papers:

  • Instrument paper: Astron. Astrophys., 642, A14, 2020. DOI, ADS
  • First results: Submitted
  • In-flight calibration: Not available yet
  • Other papers can be found in the SPICE ADS library

SPICE online information:

Data products

The data levels, FITS files, and headers are described in

The full SPICE data set (to be cited in papers) has a DOI: doi:10.5270/esa-lbmdy7c. DOIs will also be attributed to each data release.

Find data

UiO catalogue:

  • Can be generated with IDL/SolarSoft (SSW) from a local data tree:
    1. Make sure $SPICEDATA points to the data tree you want to have catalogued - Run SPICEGENCAT. The catalogue file will be written to the data tree root directory (you need to have write access) - Run SPICECAT * The catalogue file generated from all SPICE files is accessible through the UiO website (restricted to SPICE team) * How to use it in Python * A CSV export of the part of the catalogue corresponding to each release is provided with the release. SOAR (and institute mirrors): * SOAR (how to use it) Quicklooks: * Quicklook archive (to be developed) * Quicklooks in SSW In the future: VSO. VSO through SSW or sunpy. Sunpy/Fido ===== Access data ===== SPICE team internal access: * UiO website (restricted). Once the data will be released: * SOAR (and institute mirrors) * List of data releases. * VSO. VSO through SSW or sunpy. Sunpy/Fido ===== Read and display data (IDL) ===== External links: * Oslo's quicklook tools spice_data, spice_object... * Peter Young's SPICE Analysis Guide ==== Environment variables ==== Choose a location to store your SPICE data (e.g., '/mydata/spice') and then point the environment variable $SPICEDATA to it:

setenv,'SPICEDATA=/mydata/spice'

This line should be added to your IDL_STARTUP file.

Data are organized under $SPICE_DATA with a year/month/day subdirectory structure. See the “Ingesting downloaded data” section below.

The SPICE catalog

The SPICE catalog can be accessed by doing:

IDL> spice_cat

Use the “SPICEGENCAT” button to make sure you have the most up-to-date list.

Reference data-sets

Perhaps the most useful data from the early commissioning phase (before July 2020) are the raster scans on 28-May-2020.

16:05, 16:50 - disk center rasters with 20s exposures
17:50, 18:35 - north limb rasters with 20s exposures
19:35, 20:20 - south limb rasters with 20s exposures
21:20, 22:05 - west limb rasters with 20s exposures
23:05, 23:47 - east limb rasters with 20s exposures

The first true science observations were obtained during 18 to 22 November 2020. For example, an active region can be seen in the raster beginning 19:57 UT on 18-Nov-2020.

Ingesting downloaded data

After you have downloaded some SPICE FITS files, you can ingest them into your data directory with spice_ingest:

IDL> spice_ingest, files

This routine automatically creates the sub-directory structure (year/month/day) within $SPICE_DATA for the files.

Finding and reading a FITS file

Once a file has been ingested, then you can find it with spicefindfile using the observation time:

IDL> file=spicefindfile('28-may-2020 16:05')

A file can be read into an IDL object with:

IDL> d=spice_object(file)

Extracting information from the data object

The table below gives some methods for extracting information out of the data object. Where “i” is given, it means the index of a wavelength window should be specified (indices begin at 0).

You can get a list of all methods by doing:

IDL> d→help

Command Function
d→getnumberwindows() No. of spectral windows
d→getwindowdata(i,/load) Extract a data window
d→getheader(i) | Extract a data window header | | d→getwindowid(i) | Get the data window ID | | d→getstarttime() | Start time of observation | | d→getendtime() | End time of observation | | d→getsitandstare() Set to 1 if sit-and-stare observation
d→getnumberexposures() Number of exposures in raster
d→getxcen(i) | Get the X-center for the window | | d→getycen(i) Get the Y-center for the window

Read and display data (Python)

Links:

Analyze data

Instrument performance

Calibration reports (links)

Data calibration applied to L2 data (links)

Known instrumental artefacts: see release notes.

Line fitting

TBW

data/data_analysis_manual.1625073001.txt.gz · Last modified: 2021/06/30 19:10 by Peter Young