Catalog Cleanup

The Engineering Node (EN) is actively working with the Discipline Nodes (DNs) to synchronize the PDS Central Catalog and data holding at the DNs. The intial focus is to reconcile data set IDs. Periodically (quarterly and on an as needed basis), EN uses a program to query DNs Product Servers for data holding information to compare with the Catalog, and to generate reconciliation reports. Each report provides details of discrepancies and a summary of data set counts found in both the Catalog and at the DN, the number of data sets found only at the DN, and the number of data sets found only in the Catalog. EN and DNs work together to fix the discrepancies found in the reports by taking corrective actions such as:

  • DNs provide Catalog templates to EN to be ingested
  • DNs correct erroneous labels
  • DNs update data holding/inventory
  • EN updates Catalog for data sets that have been superseded
  • EN ingests Catalog files of missing data sets

Working Group

The Catalog Cleanup effort never defined an official working group. It has consisted mostly of the EN staff working directly with the various staff from all the DNs.

Milestones

Near-term milestones include:

  • Compare PDS Catalog and data holdings at DNs (Quarterly)

Long-term milestones include:

  • Reconcile all data set terse descriptions with all DNs (TBD)
  • Reconcile all data set archive status with all DNs (TBD)
  • Reconcile all data set citations with all DNs (TBD)
  • Reconcile all data set NSSDC ID with all DNs (TBD)

Current Status

Summary of progress (with metrics), as well as the latest (January 2008) reconciliation report for each DN are posted below.

Historical Documents

The historical documents, are provided below in reverse chronological order:

  • MC Presentation – November 2006 Operations Report presentation given to the MC at the November 2006 face to face meeting including Catalog Cleanup status
  • MC Presentation – August 2006 Presentation given to the MC at the August 2006 face to face meeting
  • MC Presentation – March 2006 Presentation given to the MC at the March 2006 face to face meeting