Open Data Interface, ODI


ESTEC/Contract No. 21964/08/NL/AT

Monthly Progress Report

ODI-MR-13-08/09


Period: 2009-10-01--10-31

Author: Lars Eliasson


1. Progress status

The administrator guide has been updated. See http://www.lund.irf.se/odi/internal/.


An updated version of ODI (0.91) was released. See http://www.lund.irf.se/odi/internal/odi-0.91/.


Version 0.91 uses SAAPS compiled with Java SE 6 and will thus not work with earlier versions of the Java Runtime Environment. The user guides will be updated accordingly.

PM 3 was held at Estec on October 20. See agenda and minutes at http://www.lund.irf.se/odi/internal/.


The ODI dataset table has been updated with two additional columns according to the minutes: numrecs and availability.


The ODI version number should be included in the ODI tables. A solution to store it in the table comment fields has been discussed.


The parser routines have now been split up so that the ODI library files need not to be edited when new parsing routines are added.

ODI 0.91 did not include the possibility of storing additional CDF_EPOCH variables except the default Epoch variable. A solution is to convert additional CDF_EPOCH variables to MySQL DOUBLE using the mapping from ODI data_type table.


DH has split up the directory and data file parser routines.


The directory parser is now able to handle arbitrary directory tree depth instead of a fixed 2 levels.


Treatment of cdf.gz files has now been generalized.


populate.php now accepts a list of dataset names as command line arguments.


DH and HE installed the ODI routines on a live SEDAT server at ESTEC. A couple minor bugs in the SEDAT set up were discovered and corrected along the way. The IDL routines to write out ASCII and cdf files were finished and installed. All functionality has been tested on different databases. DH created an odi version of addds.pl to set up the system dataset directory structures in SEDAT.


DH added the Herschel, Planck and AMPTE datasets. Ingestion of all GOES/SEM datasets has been completed. The SEDAT IDL tools were extended to handle variables with 2 dimensions. DH checked the process of setting up 2D variables and using them with the AMPTE ELX electron flux: creation of the data table columns from the original cdf files, ingestion of the data into the tables, reading from the database and outputting ASCII and cdf files. All appeared to be consistent.


DH discussed with BIRA how to set up an ODI database for use with SPENVIS.


Web page http://www.lund.irf.se/odi

WP 100 Core Database System

A draft of the ECSS-E40 documents (D1) is prepared including e.g. Software System Specification (version 0.1, dated 2008-11-14).

The URD has been updated to version 1.1 (2009-09-22).

The Database Technical Note (D3) has been updated to version 1.0 (2009-09-25).

User manual for the database administrator (D2) has been updated to version 1.2 (2009-10-16).

Database system and source code (S1) has been updated to version 0.91.


WP200 Database

The structure of the database (S2) is basically fixed and was delivered in September.

The Database Technical Note has been updated to version 1.0.


WP300 SAAPS interface

Updated ECSS-E40 document at September 2009 according to the schedule

Software (S3) has been updated to version 0.91.

Technical note (D4a note D1 in SoW) version 1.0 has been written.


WP400 SEDAT interface

Updated ECSS-E40 document at September 2009 according to the schedule

Software (S4) has been updated to version 0.91.

Technical note (D4b note D1 in SoW) version 1.0 has been written.


WP500 SPENVIS interface

Updated ECSS-E40 document September 2009 according to the schedule

Software (S5) has been updated to version 0.91.

Technical note (D4c note D1 in SoW) version 1.0 has been written.

WP600 Maintenance and support

Start October 2009 according to the present schedule.


WP700 Administration/management

Monthly progress reports

Final Report (D5, note D2 in SoW) ready in March 2010 according to the present schedule.

Abstract (D6, note D3 in SoW) ready in March 2010 according to the present schedule.


2. Problem areas/reasons for slippages

The date for delivery of software was delayed, partly due to part-time parental leave.


3. Events anticipated to be accomplished during next reporting period

Software and documentation was delivered at the end of September.


4. Status report on all long lead or critical delivery items

None

5. Action items

The following action item was decided during the PM1:

Action Item PM-1 Hugh Evans shall investigate where the system will be hosted at ESTEC, allocate space, and arrange for the necessary licences and servers to be set up at ESTEC.


The following action item was decided during the PM2:

Action Item PM-2 Check if the software is supposed to be open source.


6. Milestone payment status

Progress payment invoiced was sent September 2009 and payment received.


7. Expected dates for major schedule items

A preliminary date for the next progress meeting is during the ESWW (17 Nov). The maintenance phase will run until March 2010.