REPORT OF TECHNICAL COMMITTEE ON DATA EXCHANGE
(draft - Nov 19 version)
The meeting of the Technical Committee on
Data Exchange was held from 13:30 – 18:00 hours on October 17, 2004. The Chairman, Dr. Igor Shevchenko,
called the meeting to order and welcomed the participants (TCODE Endnote 1). The Committee reviewed the draft agenda and
it was adopted as provided (TCODE Endnote 2).
Review
progress on items in the 2003/2004 Workplan
1) TCODE - WG 15 (HAB Section) : TCODE/WG 15 work on Harmful
Algae Bloom database.
Robin Brown reported
on the results of the HAB Section and their trial with the IOC /ICES Harmful
Algal Event Database (HAE-DAT http://ioc.unesco.org/hab/data3.htm). Each
country entered data from their nation for one year (selection of year varied
by country). Each nation reviewed their
experiences using a “report card” approach.
Several issues were identified:
·
There was some variation in the
definition of “event” used by each countries.
·
There were some difficulties in
separating the coastline of each country into segments as recommended by
ICES/IOC. Each country took a somewhat different approach, based on the length
of their coastline and existing administrative area structures.
·
Duration of a single event was
often hard or impossible to determine.
·
Each country reported that
there were many blank fields in the database that they were unable to complete
due to lack of data. The distribution of
“blank fields” was highly variable amongst countries. For example, the only
data that Canada could report was toxicity data from their shellfish monitoring
program and no data on taxonomic composition of harmful blooms was available.
Russia, on the other hand, contributed taxonomic and abundance data on
potentially harmful blooms, but has no toxicity data.
·
Some countries reported that it
was difficult to consolidate the data from within their nation, due to the high
volume of data and/or administrative barriers.
There was an
active discussion the strengths and weaknesses of the HAE-DAT approach, but the
group agreed that (within the limitations discussed), this was a useful
approach and should be adopted by PICES nations. The plan for 2004/2005 is for each country to
enter that data from a common year (2000) plus as many years after 2000 as is
feasible. The group also agreed that it
was important that each country prepare a short, high-level description of the
characteristics of the data entered for their country to allow users to
interpret any data retrievals. This
metadata could be provided on the PICES web site or the HAEDAT web site.
2) TCODE - GLOBEC IPO: International GLOBEC Project office /PICES TCODE interactions on
GLOBEC Data Management)
Dr. Shevchenko
reported that no replies were received from the GLOBEC IPO on his queries about
the data management activity. He
reported that changes in personnel at the IPO appear to have stalled
activity. After some discussion, the
committee agreed to drop this item from the TCODE agenda for 2004/2005, with
the suggestion that this could be reintroduced if there were signs of activity
at the GLOBERC IPO. Members also noted
that GLOBEC programs in some countries were fully complete or approaching
completion and that the opportunity to efficiently inventory and archive the
GLOBEC data holdings was rapidly disappearing.
3) North Pacific Ecosystem Metadatabase
Bern Megrey and Allen Macklin reported on the
status and ongoing activities with this database (http://www.pmel.noaa.gov/np/mdb/index.html). Specific activities include:
·
AFSC staff are continuing to
actively search for and add records to the database.
·
Automated processes are now in place to email record
contributors and solicit updates to the records they have submitted.
·
Search queries have been modified and updated.
·
Capabilities for “federated searching”, where multiple
metadatabases may be searched with a single query are
being implemented. Dr. Megrey reported on plans to implement this capability
between the NP Ecosystem Metadatabase and databases
at the Korean Oceanographic Data Centre as a demonstration project across the
PICES region. Dr. Megrey submitted a proposal for
this activity and a request for partial support from PICES. The Committee endorsed this proposal.
·
Dr. Megrey
and Mr. Macklin reported on their activities with the Gulf of Alaska Ecosystem
Monitoring (GEM) project and the use of a new standard using new standard
(Ecological Metadatabase Language – EML - http://knb.ecoinformatics.org/software/eml/)
which is better suited to in situ biological observational data.
·
Mr. Macklin reminded the
committee that there was an extensive article on the North Pacific Ecosystem Metadatabase in a recent issue of PICES Press
http://pices.int/publications/pices_press/volume12/July04/pp_30_33.pdf.
The Committee noted that the North Pacific Ecosystem Metadatabase
supported through a variety of “soft money” sources and this makes the system
somewhat vulnerable.
4) TCODE web pages Updating
Dr. Shevchenko reported on the updates to TCODE web pages (http://tcode.tinro.ru).
All national reports and supporting documents for TCODE activities will be
place on this web.
5) Electronic Poster Session
for PICES XIII (Honolulu)
Dr. Royer reported that nine submissions were received for the TCODE electronic
poster session (S11 – Data Visualization of Open Ocean Processes in the North
Pacific) at PICES XIII.
4) Annual reports and updates on data
management activities in PICES member countries
Reports on data management activities were presented and discussed.
Mr. Robin Brown (Canada) reported on key contacts and sources for data,
software and educational/outreach material in Canada. In addition, he provided
copies of the DFO Policy for management of scientific data. In terms of new data management activities in
Canada, Mr. Brown noted that the VENUS and NEPTUNE cabled ocean observatories
will require an advanced data management and archival system and may present
some interesting new opportunities.
Mr. Ling Tong (China) reported that data management and exchange
(including standards) is an acknowledged challenge in China and they are
working on a plan to address this issue.
He noted that biological data are a particular challenge. Policies on charging for data (internally and
externally) are further complicating the issue.
Dr. Kenji Asano reviewed the key data management contacts in Japan (JODC
for oceanographic data; Fisheries Research Agency for biological data). He also reported on a new Japan Fisheries
Oceanography database that will soon be publicly available.
Mr. Hae-Seok Kang (Korea) reviewed the
principal data management agencies for KOREA (KORDI, NFRDI, and NORI). He further reported that KORDI will assume
responsibilities for real time data, while NFRDI will focus on delayed mode
data.
Dr. Igor Shevchenko (Russia) reported on a
workshop on mathematical modelling and information technologies in Ocean
Studies held in Vladivostok. He also provided information on recently published
“Atlas of quantitative
distribution of nekton species in the Okhotsk Sea”.
Alaska Ocean
Observing System - Data Management and Communication activities
Mr. Allen Macklin
(USA) reported on the Alaska Ocean Observing System and the central role that
data management will play in this system. A pilot project will be undertaken in
2005 to integrate the Prince William Sound data sources. Key components of the
data management system will be:
- metadata
standards (FGDC)
- open data
transport (OpenDAP)
- Live Access Server
(to browse data)
On SGXML Meeting (SGXML
- ICES-IOC Study Group on the Development of Marine Data Exchange Systems using
Extensible Markup Language )
Dr. Igor Shevchenko reported on the ICES-IOC
Study Group on XML. Dr. Georgy Moissenko attended a
meeting of this group as a TCODE representative. Mr. Brown (Canada) and Mr. Macklin (USA)
offered to gather further information on the progress made by the XML group and
provide this information to the chairman for circulation.
TCODE
noted that all new mentioned projects (the VENUS and NEPTUNE cabled ocean
observatories, the Alaska Ocean Observing System) will require an advanced data
management.
Dr. Shevchenko will post all these reports and
links to supporting materials on the TCODE web site (http://tcode.tinro.ru).
5) The second Inter-Sessional
Science Board Meeting
Dr. Shevchenko provided a short report from this meeting.
6) Discussion of the TCODE activity in relation to the PICES Strategic Plan and
development of a draft action plan for current and future activity
Dr. Shevchenko and Mr. Brown agreed to prepare a draft
strategic plan for circulation and review by TCODE members, prior to interim
Science Board Meeting.
7) Discussion of capacity building
opportunities
TCODE noted that the capacity building plan
includes several items which have direct connections to TCODE terms of
reference: sharing data, methodologies, computing power, etc.
TCODE
nominates Dr. Franz J. Mueter (Joint Institute for the Study of the Atmosphere and the
Oceans, P.O. Box 354235, University of Washington, Seattle, WA, 98115, U.S.A.,
e-mail: fmueter@alaska.net)
as a potential member of an Organizing Committee of PICES/ICES Young Scientists Conference (2007).
Ms. Yazvenko
(PICES Secretariat) reported on the new, much expanded PICES web site and
solicited feedback and advice from TCODE members. The committee congratulated
the Secretariat on the revised web site, which is much more comprehensive and
up-to-date than formerly. Dr. Megrey suggested that web-based collaboration software (SharePoint) might be a good investment for the PICES web
site, to more fully support the activities of Working Groups, Study Groups and
Committees. However, this software has a disadvantage – it works only with the
MS Internet Explorer browser.
It
was proposed to provide services at the PICES web site for the
news subscription and web site monitoring.
9) Discussion of steps
towards next major PICES scientific program(s)
10) Topic session proposals for PICES XIV
TCODE recommends a
½ day scientific session on “Data Management and Data Delivery Systems
to support Ecosystem Monitoring”. This
session will be convened by Allen Macklin, Bern Megrey
and a third convenor to be determined. (TCODE Endnote 3)
11) PICES XV theme
The Committee had
no recommendation for the PICES XV Theme.
12) Relations with other international
programs/organizations
The
Committee recommended to include IODE, (CoML)
Ocean Biological Information System (http://www.iobis.org/) and (IOC) MarineXML (<http://marinexml.net>) project into the
PICES Standing List.
14) Summary of items with financial
implications
Proposed inter-sessional meetings for 2005 and beyond
·
Support for one invited speaker for TCODE session on
“Data Management and Data Delivery Systems to support Ecosystem Monitoring” to
be held at PICES XIV. (TCODE Endnote 3)
·
Support for the “Federated Search” project (TCODE Endnote 4)
Proposed publications for 2005 and beyond
Support for publishing the “Federated Search” project findings in 2006 (TCODE Endnote 4)
Travel support requests
·
Travel support for TCODE representation to Ocean
Biodiversity Informatics (International Conference on Marine Biodiversity Data
Management, Hamburg, Germany: 29 November to 1 December 2004) to get a better
understanding and linkage of such initiatives as the Generic Information
Retrieval (DiGIR), OBIS, MarineXML,
Global Biodiversity Information Facility (GBIF), etc. with TCODE Activities.
15)
New business
There were no
additional items.
16) Discussion and adoption of the TCODE Workplan for 2004/2005
TCODE Workplan for 2004/2005
·
Arrange session on “Data
Management and Data Delivery Systems to support Ecosystem Monitoring”
·
Carry out “federated searching”
test program
·
Develop TCODE Action Plan to
complement the PICES Strategic Plan and Capacity Building Plan
·
Update TCODE Web pages,
including annual national reports, information on metadata languages, etc.
·
Assist HAB team with database
activities and publicize HAB database activity
·
Coordinated TCODE activities
with new MONITOR Technical Committee
·
Develop improved understanding
of the Ocean Biological Information Systems and other related projects.
Participation List
Members in
attendance;:
Canada
Robin Brown
China
Ling Tong
Japan
Korea
Hae Seok Kang
Hee-Dong Jeong
Russia
Igor Shevchenko
U.S.A
Bernard Megrey
Thomas Royer
Observers:
Japan
Tatsu Kishida
Kenji Asano
U.S.A
Allen Macklin
Tom Malone (Ocean.US)
Phillip Mundy (Chair, Technical Committee
on Monitoring)
Chairman: Igor Shevchenko
(Russia)
PICES XIV (Vladivostok)
TCODE half-day Session
on “Data Management and Delivery Systems to Support Ecosystem Monitoring”
Co-convenors: S.
Allen Macklin & Bernard A. Megrey, USA
TBD,
Asian member nation(s)
A
stated objective of PICES is to provide data in exchangable
formats to better enable evaluation of North Pacific ecosystems status and
trends and to support other strategic pursuits. PICES scientists face
challenges in managing and delivering data in a shareable way. Furthermore, a growing number of ocean
observing systems require data management and communication methodologies that
conform to rigid standards and protocols.
For the most part, traditional science education of the past century
offered little training in data management.
Today’s typical scientist, although supportive of data exchange, lacks
the background to understand techniques to facilitate it.
This
workshop will acquaint PICES scientists with state-of-the-art information about
metadata description, data delivery and data browse techniques, with emphasis
on existing standards and web services recommended for ocean observing
systems. Basic to advanced methods will
be presented in a graduated format.
Presenters and participants will describe and explore existing,
successful systems. Participants will
learn ways to map existing data structures into conformant, exchangeable
formats using no-cost, open-source applications.
Requested
support: Travel for one invited speaker,
e.g., ICES XML expert
Suggested
resources: 5-10 work stations with
Internet connectivity
PICES
TCODE Data-Sharing Project to Federate Metadata on North Pacific Ecosystems
Hee-Dong Jeong
(KODC/NFRDI, Korea)
Hae-Seok Kang (KORDI, Korea)
S. Allen Macklin (NOAA PMEL, USA)
Bernard A. Megrey
(NOAA AFSC, USA)
Informal discussions between the Korea Oceanographic Data Center (KODC) and the North Pacific Ecosystem Metadatabase (NPEM) have taken place over the past year.
The goal of these discussions ultimately is to connect PICES member nations’ metadatabase systems into one integrated resource. In this
way, a user of any one metadata inventory will have the ability to search for
data catalogued by any and all other participating system with a single search
request. Using modern data management
techniques to cross-search separate metadatabases
provides the advantages of shared metadata without compromising national
ownership, data integrity, or security of national metadata products.
Our informal discussions indicated that this project is feasible and
worthy of immediate pursuit. TCODE has
adopted a pilot KODC-NPEM federation as part of its 2005 work plan. We plan to initiate a series of meetings,
open to all PICES member nations, to discuss the required technical details.
During the process of outlining and discovering the technical hurdles and the
means to address and solve problems with KODC and other participants, we intend
to document our findings in a report, to be published during 2006, that can be
used by other PICES countries wishing to join the federation. In this way,
success with this project should easily scale up to similar efforts with other
PICES countries with a nominal investment of time and planning.
We
believe this project is compatible with the PICES strategic plan and PICES
scientific interests. It accomplishes capacity sharing because all subscribing
systems will possess the ability to virtually expand their holdings to those of
the complete network. Data sharing between PICES countries helps to advance
PICES science.
We
ask PICES to support this project on a shared-cost basis. Korea and USA will
contribute ~37% of the total cost for two meetings of four persons from each
organization. TCODE requests that PICES
pay 25%. Other participants are welcome
to join the meetings, as possible.
Budget: Two
~2-day meetings, 4 people from each country (2 managers, 2 technical staff) at
$US2,000/person/trip.
Total cost: $US16,000
USA Contribution:
$US 6,000
Korea
Contribution: $US 6,000
PICES
Contribution: $US 4,000