Jeremy Cohen: An e-Science Platform for on-demand management and processing of environmental data
based on the Message - Mobile Environmental Sensing System Across Grid Environments
sensors connected by bluetooth, wifi & 3g
100,000s of sensors imply highly variable rates of data aquisition .. using amazon elastic cloud commodity computing to cope with the varying load.
on-demand modelling ..
.. requires on-demand computing .. ogsa-dai, ogsa-dqp and ec2
.. on-demand being driven by both back end data availability and front end user request
www.message-project.org
www.imperial.ac.uk/
Nathan Cummngham: Optimising Antarctic research cruises
"Big Data" Nature
"Growing your data" Lynch 2008, Nature 455:7209
planning is influenced by real time ice information, realtime pengiun tracks - showing where polar fron is, real time chlorophile imaging etc
delivery is over 128k sat link to research ship.
www.edp.ac.uk/ .. environmental data portal.
Liangxiu Han: FireGrid: an eInfrastructure for next generation Emergency Response Report
http://firegrid.org/
Jim Myers: A Digital Synthesis Framework for Virtual Observatories
Context
.. Ocean Observatories Initiative
.. National Ecological Obs Net
.. WATERS Net
want 3d immersive equivalent to goingthere but augmented by data richness
even though there is general initial user agreement of the concept, in fact great deal of variation in specifics
as soon as you read about it you should be able to action it via workflow.
Digital Synthesis Framework .. data playground
Semantic Content Management
Streaming Data Management
CyberCollaboration Portal
Cyberintegrator.
Content Repositories
.. all stored in RDF
Restful, using restlets
front end widgets uses google toolkit
interwidget interactions
Dynamic Analysis Environment
eg Corpus Christi Bay Dashboard
Community Annotation.
code at:
svn.ncsa.uiuc.edu/svn/cyberintegrator &dse
Thursday, 11 September 2008
AHM08: Sharing and Collaboration
Jeremy Cohen: Sharing and Collaboration (in the laboratory) Blogs, Logs and Pods
Laboratory e-Notebook
leverage off things we already do
.. COSHH
.. Process todo vs plan vs record - all integrated diagramatically in PDA
.. Integration of lab records with building management system
. so that PDAs etc can subscribe to building message broker
. after all the building mgmt system knows such things as lab room temp
.. results can be made available WITH data in databases to provide remotely sources for validation
.. record the units
. eg bridge from Germany to Switzerland, didnt meet by 10cm, because elevations against diff sea levels, which differed by 5cm but the sign was got wrong
BioBlog .. http://chemtools.chem.soton.ac.uk/projects/blog/blogs.php/blog_id/15
bioblog templates essential
barcode to url convertion
or 2d-array barcode plus phone conversion to url and retrieval
http://simile.mit.edu/welkin .. Welkin is a graph-based RDF visualizer
discover that the use of blog actually improves the quality of what is recorded.
.. comment by sketch .. chemists are scriblers
also cf .http://wikispaces.com/, which is wiki based
finally still need to link all the component parts from publication to conversations to lab notebook.
LaBlog/wiki .. myExperiment vs ourExperiment.org
semantic web .. data deluge .. maintaining & communicating context
. major problem of communicating meaning
. eg ppt arrows on hebrew system which is a right to left language . which arrow is forward?
ie people and their backgrounds needed..
maybe call this 'semiotics of semantic web' or the 'semiotic web'?
Laboratory e-Notebook
leverage off things we already do
.. COSHH
.. Process todo vs plan vs record - all integrated diagramatically in PDA
.. Integration of lab records with building management system
. so that PDAs etc can subscribe to building message broker
. after all the building mgmt system knows such things as lab room temp
.. results can be made available WITH data in databases to provide remotely sources for validation
.. record the units
. eg bridge from Germany to Switzerland, didnt meet by 10cm, because elevations against diff sea levels, which differed by 5cm but the sign was got wrong
BioBlog .. http://chemtools.chem.soton.ac.uk/projects/blog/blogs.php/blog_id/15
bioblog templates essential
barcode to url convertion
or 2d-array barcode plus phone conversion to url and retrieval
http://simile.mit.edu/welkin .. Welkin is a graph-based RDF visualizer
discover that the use of blog actually improves the quality of what is recorded.
.. comment by sketch .. chemists are scriblers
also cf .http://wikispaces.com/, which is wiki based
finally still need to link all the component parts from publication to conversations to lab notebook.
LaBlog/wiki .. myExperiment vs ourExperiment.org
semantic web .. data deluge .. maintaining & communicating context
. major problem of communicating meaning
. eg ppt arrows on hebrew system which is a right to left language . which arrow is forward?
ie people and their backgrounds needed..
maybe call this 'semiotics of semantic web' or the 'semiotic web'?
AHM08/W9-3: The Global Datacentric View
Ian Atkinson: ARCHER Data Services
HERMES - generic datagrid tool
PLONE tools
cf archer.edu.au
hermes ..
http://commonsvfsgrid.sf.net
plone srb & ICAT
http://eresearch.jcu.edu.au/wiki
PJ Kirsch: Developing a common data discovery, browsing and access framework
BAS multi-disciplinary requirerments.
used be scientist (mis)managed
need to have a framework for the data its documentation
tech drivers - 24/7 link & bandwidth even to remote data sensors
free client tools - eg google maps etc
must have
- efficient discovery
- appropriate visualisation .. what does appropriate mean - user perspective & data dependance
- access to data
- aaaccess of ancilliary/auxilliary data
- sometimes reference to accession num for no digital holdings
initial response to query is a timeline showing availability and quality indicator and list of associated other docs in a subversion db eg s/w, code, reports etc
as you 'zoom' in on the data the timelines may show additional variants such as region, raw vs processed, instrument variants etc.
provider nominated visualisation, as scrollable zoomable time or space display .. linked to dataset download.
iso 690 - ref for citing data.
Andrew Treloar: ANDS - what are we doing, why are we different, whether we are courageous.
Platforms for Collaboration ..
follow on arrow dart and archer
blueprint: 'towards the australian data commons'
.. why data - because data deluge need to spend more and more
.. need for standardisation
. s/w & h/w gets cheaper, wetware more expnsive
.. role of data federations
. cross disciplinary opportunity opens door to new research
. but it is difficult
cf australian code for the responsible conduct of research
.. institutional and researcher obligations.
.. signed up to by all chancellors etc . so serious
.. funding will become tied to compliance
ANDS programmes
.. developing frameworks
.. providing national utilities
. discovery
. persistent identifier - pilin
. collections registry
discovery - iso2146 - high level architecture for registry
collection, party/people, activity, service
expose this to google web service harvest
.. seeding the commons, ie work with lead exemplars
.. building (human) capabilities
. train the traners
1st review .. 'strategic roadmap aug 2008.pdf'
cf p21 ,p22, p23, p23
http://ands.org.au
HERMES - generic datagrid tool
PLONE tools
cf archer.edu.au
hermes ..
http://commonsvfsgrid.sf.net
plone srb & ICAT
http://eresearch.jcu.edu.au/wiki
PJ Kirsch: Developing a common data discovery, browsing and access framework
BAS multi-disciplinary requirerments.
used be scientist (mis)managed
need to have a framework for the data its documentation
tech drivers - 24/7 link & bandwidth even to remote data sensors
free client tools - eg google maps etc
must have
- efficient discovery
- appropriate visualisation .. what does appropriate mean - user perspective & data dependance
- access to data
- aaaccess of ancilliary/auxilliary data
- sometimes reference to accession num for no digital holdings
initial response to query is a timeline showing availability and quality indicator and list of associated other docs in a subversion db eg s/w, code, reports etc
as you 'zoom' in on the data the timelines may show additional variants such as region, raw vs processed, instrument variants etc.
provider nominated visualisation, as scrollable zoomable time or space display .. linked to dataset download.
iso 690 - ref for citing data.
Andrew Treloar: ANDS - what are we doing, why are we different, whether we are courageous.
Platforms for Collaboration ..
follow on arrow dart and archer
blueprint: 'towards the australian data commons'
.. why data - because data deluge need to spend more and more
.. need for standardisation
. s/w & h/w gets cheaper, wetware more expnsive
.. role of data federations
. cross disciplinary opportunity opens door to new research
. but it is difficult
cf australian code for the responsible conduct of research
.. institutional and researcher obligations.
.. signed up to by all chancellors etc . so serious
.. funding will become tied to compliance
ANDS programmes
.. developing frameworks
.. providing national utilities
. discovery
. persistent identifier - pilin
. collections registry
discovery - iso2146 - high level architecture for registry
collection, party/people, activity, service
expose this to google web service harvest
.. seeding the commons, ie work with lead exemplars
.. building (human) capabilities
. train the traners
1st review .. 'strategic roadmap aug 2008.pdf'
cf p21 ,p22, p23, p23
http://ands.org.au
AHM08: Cloud data mining
Robert Grossman: The Emergence of the Data Centre as a scientific instrument
Diff between google and escience
.. scale to datacentre . google, esci, health
.. scale over datacentre . esci only
.. support large data flows . esci only
.. user and file security . google, health
For Sector
implies transport and routing services needed in a addition to google's stack -
. so developed UDT 'UDP based Data Transport'
UDF map reduce applied across this stack
sector / sphere is fast, easy to program customisable 2-3x, 4-6x faster than hadoop
sphere is the compute cloud, sector is the data cloud
sector's security based on SSL and also the audit tracking that is needed.
Diff between google and escience
.. scale to datacentre . google, esci, health
.. scale over datacentre . esci only
.. support large data flows . esci only
.. user and file security . google, health
For Sector
implies transport and routing services needed in a addition to google's stack -
. so developed UDT 'UDP based Data Transport'
UDF map reduce applied across this stack
sector / sphere is fast, easy to program customisable 2-3x, 4-6x faster than hadoop
sphere is the compute cloud, sector is the data cloud
sector's security based on SSL and also the audit tracking that is needed.
AHM08: Visualising the Future
Chris Johnson: Scientific Computing & Imaging Institute, Utah .. pronounced 'ski'
Not retrospective visualisation of the results, but integrated visualisation in the problem solving process
GPU - massively parallel architecture
.. scaling many times faster than multi-core cpu
.. now have high precision floating pt gpu from nvidia
using GPUs to process petabytes of neuro slice data.
volume rendering ...
traditional 'maximum intensity projection' (MIP) to 'full volume rendering'
new was too computationally extensive, but with GPU becomes tractable +
multi-dimensional transfer function - mapping derivatives & integrals across multi slices to rgb
... s/w called seg3d .. bioimage .. hardest part was making it usefull !
time dependant visualisation
isosurface extraction
.. marching cubes Lorensen & Cline 1987
.. but ow pisa, rtrt, noise, octree up to 10^4 faster algorithm, but not available .. ie opensource,
pisa .. livnat & tricoche '04 .. if the triangle is too small to see, dont calc it.
ray-tracing
as # objects goes up ray tracing becomes more efficient than raster (traditional gpu) algorithm
DOE asci c-safe .. simulate explosion from first principles & vis it.
.. manta - real time ray tracer
.. how to simulate the right colours of flames correctly, rather than map temp to colour ramp
.. perception of shadows .. currently base on phong and gurow in 1970s but todays hardware is faster
.. so if solve maxwell for realism .. need to artificially introduce an appropriate light source into say cat scan .. not always obvious how to do it.
3d vis of error and uncertainty ..
.. working on it . no one way to do it
.. what about mapping rgb to fuzzyness or sensitivity or confidence
.. uncertainty animation
in 2003 as much info was generated as was published in all preceeding human history, and have repeated that every year since.
cf www.vistrails.org with taverna & myexperiment .. visualisation of differences due to technique variation.
http://www.sci.utah.edu/vaw2007/ .. book from Visualisation and Analytics Workshop
Not retrospective visualisation of the results, but integrated visualisation in the problem solving process
GPU - massively parallel architecture
.. scaling many times faster than multi-core cpu
.. now have high precision floating pt gpu from nvidia
using GPUs to process petabytes of neuro slice data.
volume rendering ...
traditional 'maximum intensity projection' (MIP) to 'full volume rendering'
new was too computationally extensive, but with GPU becomes tractable +
multi-dimensional transfer function - mapping derivatives & integrals across multi slices to rgb
... s/w called seg3d .. bioimage .. hardest part was making it usefull !
time dependant visualisation
isosurface extraction
.. marching cubes Lorensen & Cline 1987
.. but ow pisa, rtrt, noise, octree up to 10^4 faster algorithm, but not available .. ie opensource,
pisa .. livnat & tricoche '04 .. if the triangle is too small to see, dont calc it.
ray-tracing
as # objects goes up ray tracing becomes more efficient than raster (traditional gpu) algorithm
DOE asci c-safe .. simulate explosion from first principles & vis it.
.. manta - real time ray tracer
.. how to simulate the right colours of flames correctly, rather than map temp to colour ramp
.. perception of shadows .. currently base on phong and gurow in 1970s but todays hardware is faster
.. so if solve maxwell for realism .. need to artificially introduce an appropriate light source into say cat scan .. not always obvious how to do it.
3d vis of error and uncertainty ..
.. working on it . no one way to do it
.. what about mapping rgb to fuzzyness or sensitivity or confidence
.. uncertainty animation
in 2003 as much info was generated as was published in all preceeding human history, and have repeated that every year since.
cf www.vistrails.org with taverna & myexperiment .. visualisation of differences due to technique variation.
http://www.sci.utah.edu/vaw2007/ .. book from Visualisation and Analytics Workshop
Wednesday, 10 September 2008
AHM08/RS1: Regular Session
Jeremy Cohen: ICENI II
Coordinate forms:
declarative workflow lnguage
.. describe what not how
.. much easier to logically analyze the flow
use of coordination forms for matching
workflow execution .. bpel, scufl etc
declarative workflow generation tuned to users normal activities
.. automated workflow generation
.. extract from a users real-time use of their natural software - matlab etc
workflow execution with performance .. performance repository .. used to drive planning of optimal execution plan
ICENA II plan
Daniel Goodman: Decentralised Middleware and Workflow Enactment for the Martlet Workflow Language
Middleware comprises:
.. Process Coordinator
.. Data Store
.. Data Processor
Essentially introduces an efficient protocol for P2P communication between PCs and DPs such that each node becomes aware in changes in state and availability of the network as a whole in a decentralised robust efficient way.
Ahmed Algaoud: Workflow Interoperability
API for workflow interoperablity providing direct interaction
.. based on WS-eventing .. asynchronous
.. look to implement in eg Triana Taverna Kepler
WS-Eventer set up witth four types
.. subscriber, sink service, subscribe manager, source servce
also use WSPeer & working with NAT issues.
Asif Akram: Dynamic Workflow in GRID Environment
Imperial College
part of ICENI project
GridCC incl QoS, BPEL, ActiveBPEL
introduce QoS language
QoS criteria incl security, performance (from performance criteria)
Used WS Addressing engine (WSA) to achieve dynamic redefinition of the BPEL partner link within the BPEL.
BPEL Editor / Monitor
Conclusion .. QoS can be injected into BPEL which makes dynamic workflow much easier to achieve, and this can be achieved within existing standard specification.
Jos Koetsier: A RAPID approach to enabling domain specfic applications
User prefers domain specific portlet, but there is quite a lot of work creating domain specific portlets so ..
OK so approach is to build a custom portlet generator ..
have written one based on jsdl and jsdl xml file (GridSAM)
Uses OMII.uk s/w
obtain at http://research.nesc.ac.uk/rapid
Martin Dove: MaterialsGrid: An end-to-end approach for computational projects
3yr 5fte project www.materialsgrid.org
based on CASTEP to simulate the behaviour of materials to predict the properties of material.
results are contributed to a database .. which may also hold measured properties.
so database content is computed on demand for groups of users that dont want to know the computational under the hood stuff.
workflow using scitegic pipeline pilot instead of bpel, partly because the bpel std wasnt uniformly implemented.
cml.sourceforge.net .. chemical ml from cmlcomp.org
cml2sql & www.lexical.org golem to construct cml
.. jquery allows mix of pulldown and autocompletion & constrains to allowed values ..
Coordinate forms:
declarative workflow lnguage
.. describe what not how
.. much easier to logically analyze the flow
use of coordination forms for matching
workflow execution .. bpel, scufl etc
declarative workflow generation tuned to users normal activities
.. automated workflow generation
.. extract from a users real-time use of their natural software - matlab etc
workflow execution with performance .. performance repository .. used to drive planning of optimal execution plan
ICENA II plan
Daniel Goodman: Decentralised Middleware and Workflow Enactment for the Martlet Workflow Language
Middleware comprises:
.. Process Coordinator
.. Data Store
.. Data Processor
Essentially introduces an efficient protocol for P2P communication between PCs and DPs such that each node becomes aware in changes in state and availability of the network as a whole in a decentralised robust efficient way.
Ahmed Algaoud: Workflow Interoperability
API for workflow interoperablity providing direct interaction
.. based on WS-eventing .. asynchronous
.. look to implement in eg Triana Taverna Kepler
WS-Eventer set up witth four types
.. subscriber, sink service, subscribe manager, source servce
also use WSPeer & working with NAT issues.
Asif Akram: Dynamic Workflow in GRID Environment
Imperial College
part of ICENI project
GridCC incl QoS, BPEL, ActiveBPEL
introduce QoS language
QoS criteria incl security, performance (from performance criteria)
Used WS Addressing engine (WSA) to achieve dynamic redefinition of the BPEL partner link within the BPEL.
BPEL Editor / Monitor
Conclusion .. QoS can be injected into BPEL which makes dynamic workflow much easier to achieve, and this can be achieved within existing standard specification.
Jos Koetsier: A RAPID approach to enabling domain specfic applications
User prefers domain specific portlet, but there is quite a lot of work creating domain specific portlets so ..
OK so approach is to build a custom portlet generator ..
have written one based on jsdl and jsdl xml file (GridSAM)
Uses OMII.uk s/w
obtain at http://research.nesc.ac.uk/rapid
Martin Dove: MaterialsGrid: An end-to-end approach for computational projects
3yr 5fte project www.materialsgrid.org
based on CASTEP to simulate the behaviour of materials to predict the properties of material.
results are contributed to a database .. which may also hold measured properties.
so database content is computed on demand for groups of users that dont want to know the computational under the hood stuff.
workflow using scitegic pipeline pilot instead of bpel, partly because the bpel std wasnt uniformly implemented.
cml.sourceforge.net .. chemical ml from cmlcomp.org
cml2sql & www.lexical.org golem to construct cml
.. jquery allows mix of pulldown and autocompletion & constrains to allowed values ..
AHM08/W9-2 : The Global Data Centric View
Jon Blower: A Framework to Enable Harmonisation of Globally-Distributed Environmental Data holdings using Climate Science Modeling Language
How we use the climate science modeling language.
data from many instruments .. need to combine them all to:
.. validate numerical models
.. calibrate instruments
.. data assimilation - formal method for combing data and model ..
.. making predictions - eg floods, climate, drift at sea and search and rescue
The need for harmonisation leads to Scientists spend lots of time (up to 80% of some post docs) dealing with low-level technical issues .. need a common view onto all appropriate datasets
OGC aim to describe all geographic data . mandated by inspire .. but fiendishly complex evolved from maps
Need to bridge the gap: CSML
both abstract data model & xml encoding
provides a new view of existing data, doesnt actually change it.
14 feature types ..
classified by geometry not their content
Harmonise two datasets with CSML plugs into GeoServer (like GeoSciML)
Second way via Java-CSML
.. aim to reduce the cost of doing analysis
.. high-level analysis/vis routines completely decoupled from the data
Java-CSML Design attempts
.. transform CSML xml schema to java codeusing automated tool
.. leads to v complex code
.. OGC geoapi but incomprehensible & geoapi is a moving target
.. based on well-known java concepts
.. reduce the users code
.. you can always wrap something
.. wrappers for wfs, netcdf, opendap etc to make them all look the same
.. also have plotting routines
Problem is that the more you abstract the more info you loose, so need some more specific profiles that inherit the parent profile and add the extra know for a specific instance.
Wider lessons ..
.. intolerable data formats not necesarily suitable for storage
.. trade-offs between scope and complexity
.. symbiotic relationship between stds, tools & applications.
Aside more opendap services than wcs services for raster data.
Alistair Grant: Bio-Surveillance: Towards a Grid Enabled Health Monitoring System
Problem .. SQL SELECT blah, count from databases where diagnosis = 'X'
databases is a set of databases with non-std schemas
OGSA-DAI used to solve this.
RODSA-DAI was one solution ..
Views canbe implemented in a database, but Views can also be hosted at an ogsa-dai service layer
.. this allows both security to be implemented remote from the database, also allows remote organisations to see a view without requiring hosts to support a particular view or set of views
.. output transformed as required to google maps/earth
.. ogsa-dai view are slower, but not so much slower as to work against the disadvantages.
cf www.ogsadai.org.uk
www.phgrid.net
www.omii.ac.uk
Chris Higgins report that SEE GEO has implemented OGSA-DAI wrapper for WFS.
Lourens E Veen: Virtual Lab ECOGrid: Turning Field Observations into Ecological Understanding
ECOGrid
also www.science.uva.nl/ibed-cge
Species Behaviour
Biotic and abiotic data, incl human behavior
Field Data
Statistical analyses
Organisations incl govt, infrastructure & conservation, & private volunteers
Different datamodels:
Approach incorporated a hierarchical approach of
.. Core data
.. Extended attribute
.. Set Specific extensions to preserve original data
info goes back at least to the 50s, but also earier data if available.
Tamas Kukla, Tamas Kiss, Gabor Terstyananszky: Integrating OGSA-DAI into Computational Grid Workflows
University of Westminster
want to expand workflows in two ways ...
Major problem of all the common system is limited - mainly file or v limited database
eg Triana, Taverna, Kepler, P-Grade Portal
Workflow level interoperation of grid data resources
OGSA-DAI is sufficiently generic for it to be a good candidate.
Data staging
Static vs semi dynamic vs dynamic
static staging - in spec and access before and out spec and access after but not during
semi-dynamic - in and out specified before and in out executed during
dynamc - all access during the workflow **
ogsa-dai integration , tool, workflow editor vs workflow engine
only integration into the engine provides fully dynamic access
either implemented at the port or within the node - chosen within the node - which provides better integration
required functionality .. everything is too complex.
more specific support tool &/or totally generic - chose to support both styles of access.
Chose P-Grade Portl workflow engine, based on GridSphere with extended DAG workflow engine
in P-Grade nodes are jobs, ports represent files and links file transfer
direct submission not possible .. need an application repository so
Chose GEMLCA application repository, which is also a job submitter part of Globus.
This approach has advantage is that GEMCLA is sufficiently generic that it can be used in a range of other workflow systems.
cf http://ngs-portal.cpc.wmin.ac.uk/
How we use the climate science modeling language.
data from many instruments .. need to combine them all to:
.. validate numerical models
.. calibrate instruments
.. data assimilation - formal method for combing data and model ..
.. making predictions - eg floods, climate, drift at sea and search and rescue
The need for harmonisation leads to Scientists spend lots of time (up to 80% of some post docs) dealing with low-level technical issues .. need a common view onto all appropriate datasets
OGC aim to describe all geographic data . mandated by inspire .. but fiendishly complex evolved from maps
Need to bridge the gap: CSML
both abstract data model & xml encoding
provides a new view of existing data, doesnt actually change it.
14 feature types ..
classified by geometry not their content
Harmonise two datasets with CSML plugs into GeoServer (like GeoSciML)
Second way via Java-CSML
.. aim to reduce the cost of doing analysis
.. high-level analysis/vis routines completely decoupled from the data
Java-CSML Design attempts
.. transform CSML xml schema to java codeusing automated tool
.. leads to v complex code
.. OGC geoapi but incomprehensible & geoapi is a moving target
.. based on well-known java concepts
.. reduce the users code
.. you can always wrap something
.. wrappers for wfs, netcdf, opendap etc to make them all look the same
.. also have plotting routines
Problem is that the more you abstract the more info you loose, so need some more specific profiles that inherit the parent profile and add the extra know for a specific instance.
Wider lessons ..
.. intolerable data formats not necesarily suitable for storage
.. trade-offs between scope and complexity
.. symbiotic relationship between stds, tools & applications.
Aside more opendap services than wcs services for raster data.
Alistair Grant: Bio-Surveillance: Towards a Grid Enabled Health Monitoring System
Problem .. SQL SELECT blah, count from databases where diagnosis = 'X'
databases is a set of databases with non-std schemas
OGSA-DAI used to solve this.
RODSA-DAI was one solution ..
Views canbe implemented in a database, but Views can also be hosted at an ogsa-dai service layer
.. this allows both security to be implemented remote from the database, also allows remote organisations to see a view without requiring hosts to support a particular view or set of views
.. output transformed as required to google maps/earth
.. ogsa-dai view are slower, but not so much slower as to work against the disadvantages.
cf www.ogsadai.org.uk
www.phgrid.net
www.omii.ac.uk
Chris Higgins report that SEE GEO has implemented OGSA-DAI wrapper for WFS.
Lourens E Veen: Virtual Lab ECOGrid: Turning Field Observations into Ecological Understanding
ECOGrid
also www.science.uva.nl/ibed-cge
Species Behaviour
Biotic and abiotic data, incl human behavior
Field Data
Statistical analyses
Organisations incl govt, infrastructure & conservation, & private volunteers
Different datamodels:
Approach incorporated a hierarchical approach of
.. Core data
.. Extended attribute
.. Set Specific extensions to preserve original data
info goes back at least to the 50s, but also earier data if available.
Tamas Kukla, Tamas Kiss, Gabor Terstyananszky: Integrating OGSA-DAI into Computational Grid Workflows
University of Westminster
want to expand workflows in two ways ...
Major problem of all the common system is limited - mainly file or v limited database
eg Triana, Taverna, Kepler, P-Grade Portal
Workflow level interoperation of grid data resources
OGSA-DAI is sufficiently generic for it to be a good candidate.
Data staging
Static vs semi dynamic vs dynamic
static staging - in spec and access before and out spec and access after but not during
semi-dynamic - in and out specified before and in out executed during
dynamc - all access during the workflow **
ogsa-dai integration , tool, workflow editor vs workflow engine
only integration into the engine provides fully dynamic access
either implemented at the port or within the node - chosen within the node - which provides better integration
required functionality .. everything is too complex.
more specific support tool &/or totally generic - chose to support both styles of access.
Chose P-Grade Portl workflow engine, based on GridSphere with extended DAG workflow engine
in P-Grade nodes are jobs, ports represent files and links file transfer
direct submission not possible .. need an application repository so
Chose GEMLCA application repository, which is also a job submitter part of Globus.
This approach has advantage is that GEMCLA is sufficiently generic that it can be used in a range of other workflow systems.
cf http://ngs-portal.cpc.wmin.ac.uk/
Subscribe to:
Posts (Atom)
