Pedro Goncalves - Academia.edu (original) (raw)
Uploads
Papers by Pedro Goncalves
Developer Cloud Sandbox interferogram processing with ROI_PAC
ABSTRACT GENESI-DR (Ground European Network for Earth Science Interoperations - Digital Repositor... more ABSTRACT GENESI-DR (Ground European Network for Earth Science Interoperations - Digital Repositories) is a European Commission (EC)-funded project, kicked-off early 2008 lead by ESA; partners include Space Agencies (DLR, ASI, CNES), both space and no-space data providers such as ENEA (I), Infoterra (UK), K-SAT (N), NILU (N), JRC (EU) and industry as Elsag Datamat (I), CS (F) and TERRADUE (I). GENESI-DR intends to meet the challenge of facilitating "time to science" from different Earth Science disciplines in discovery, access and use (combining, integrating, processing, ...) of historical and recent Earth-related data from space, airborne and in-situ sensors, which are archived in large distributed repositories. "Discovering" which data are available on a "geospatial web" is one of the main challenges ES scientists have to face today. Some well- known data sets are referred to in many places, available from many sources. For core information with a common purpose many copies are distributed, e.g., VMap0, Landsat, and SRTM. Other data sets in low or local demand may only be found in a few places and niche communities. Relevant services, results of analysis, applications and tools are accessible in a very scattered and uncoordinated way, often through individual initiatives from Earth Observation mission operators, scientific institutes dealing with ground measurements, service companies or data catalogues. In the discourse of Spatial Data Infrastructures, there are "catalogue services" - directories containing information on where spatial data and services can be found. For metadata "records" describing spatial data and services, there are "registries". The Geospatial industry coins specifications for search interfaces, where it might do better to reach out to other information retrieval and Internet communities. These considerations are the basis for the GENESI-DR scientific portal, which adopts a simple model allowing the geo-spatial classification and discovery of information as a loosely connected federation of nodes. This network had however to be resilient to node failures and able to scale with the growing addition of new information about data and services. The GENESI-DR scientific portal is still evolving as the project deploys the different components amongst the different partners, but the aim is to provide the connection to information, establish rights, access it and in some cases apply algorithms using the computer power available on the infrastructure with simple interfaces. As information is discovered in the network, it can be further exploited, filtered or enhanced according to the user goals. To implement this vision two specialized graphical interfaces were designed on the portal. The first, concentrates on the text-based search of information, while the second is a command and control of submission and order status on a distributed processing environment. The text search uses natural language features that extract the spatial temporal components from the user query. This is then propagated to the nodes by mapping them to OpenSearch extensions, and then returned to the user as an aggregated list of the resources. These can either be access points to dataset series or services that can be further analysed and processed. At this stage, the user is presented with dedicated interfaces that correspond to context of the action that is performing. Be it a bulk data download, data processing or data mining, the different services offer specialized interfaces that are integrated on the portal. In the overall, the GENESI-DR project identifies best practices and supporting context for the use of a minimal abstract model to loosely connect a federation of Digital Repositories. Surpassing the apparent lack of cost effectiveness of the Spatial Data Infrastructures effort in developing "catalogue services" is achieved by trimming the use cases to the most common and relevant. The GENESI-DR scientific portal is, as such, the visible front-end of a dedicated infrastructure providing transparent access to information and allowing Earth Science communities to easily and quickly derive objective information and share knowledge based on all environmentally sensitive domains.
ABSTRACT GENESI-DR (Ground European Network for Earth Science Interoperations - Digital Repositor... more ABSTRACT GENESI-DR (Ground European Network for Earth Science Interoperations - Digital Repositories) is a European Commission (EC)-funded project, kicked-off early 2008 lead by ESA; partners include Space Agencies (DLR, ASI, CNES), both space and no-space data providers such as ENEA (I), Infoterra (UK), K-SAT (N), NILU (N), JRC (EU) and industry as Elsag Datamat (I), CS (F) and TERRADUE (I). GENESI-DR intends to meet the challenge of facilitating "time to science" from different Earth Science disciplines in discovery, access and use (combining, integrating, processing, ...) of historical and recent Earth-related data from space, airborne and in-situ sensors, which are archived in large distributed repositories. GENESI-DR provides a framework where data repositories can be easily integrated and users are given a single access point for discovery and access to heterogeneous data and processing resources. Processing services can be easily integrated as well so supporting the users in the analysis of the data. Coupled with high-performance and sizeable computing resources managed by Grid technologies, GENESI-DR provides indeed the necessary flexibility for building a virtual environment that gives transparent, fast, and easy access to data (even heterogeneous and dispersed among different archives), processing services, computing resources, and results. These characteristics make GENESI-DR an ideal platform for processing large amounts of heterogeneous data (e.g., satellite and in-situ data), developing services which require fast production and delivery of results, comparing approaches and fully validating algorithms. Security solutions adopted in GENESI-DR guarantee that only authorized users can access data, processing services and processing resources. GENESI-DR is designed to support the need for an effective exploitation of the large archives. Among the different applications already integrated in GENESI-DR, in this presentation we will describe some results related to Differential SAR Interferometry (DInSAR). This is an effective technique to detect and monitor ground displacements with centimetre accuracy. The recent development of advanced DInSAR techniques, aimed at the generation of deformation time series, has led to the need of suitable environments and approaches for an effective exploitation of the large archive of SAR data acquired by the ERS, ENVISAT and RADARSAT satellites. Accordingly, we discuss, from a data access and processing point of view, some results obtained merging the robustness of an advanced DInSAR approach (namely the Small Baseline Subset (SBAS) algorithm proposed and developed by Italian CNR - IREA) with the high computing capability provided by the distributed infrastructure available through GENESI-DR. A similar analysis is currently performed using Cloud Computing resources. As final remark, it is evident the importance that the presented distributed processing solution may have in scenarios as for the Supersite initiative, which is aimed at stimulating "an international and intergovernmental effort to monitor and study selected reference sites by establishing open access to relevant datasets according to GEO principles to foster the collaboration between all various partners and end-users".
Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), 2011
This paper presents a simple tool that, thanks to the precise geolocation information contained i... more This paper presents a simple tool that, thanks to the precise geolocation information contained in Envisat Advanced Synthetic Aperture Radar products alongside with their internal organization, allows a fully automatic and distributed orthorectification of ASAR Wide Swath Medium resolution (WSM) data and ASAR Image Mode Medium resolution (IMM) data. Such a tool has been developed and integrated on Grid Processing
ESA …, 2003
The rapid developments in distributed supercomputing and parallel computing in recent years have ... more The rapid developments in distributed supercomputing and parallel computing in recent years have led to the high-performance computing facilities of several independent scientific research organisations being joined up via high-speed networks to construct very-large-scale ...
Developer Cloud Sandbox interferogram processing with ROI_PAC
ABSTRACT GENESI-DR (Ground European Network for Earth Science Interoperations - Digital Repositor... more ABSTRACT GENESI-DR (Ground European Network for Earth Science Interoperations - Digital Repositories) is a European Commission (EC)-funded project, kicked-off early 2008 lead by ESA; partners include Space Agencies (DLR, ASI, CNES), both space and no-space data providers such as ENEA (I), Infoterra (UK), K-SAT (N), NILU (N), JRC (EU) and industry as Elsag Datamat (I), CS (F) and TERRADUE (I). GENESI-DR intends to meet the challenge of facilitating "time to science" from different Earth Science disciplines in discovery, access and use (combining, integrating, processing, ...) of historical and recent Earth-related data from space, airborne and in-situ sensors, which are archived in large distributed repositories. "Discovering" which data are available on a "geospatial web" is one of the main challenges ES scientists have to face today. Some well- known data sets are referred to in many places, available from many sources. For core information with a common purpose many copies are distributed, e.g., VMap0, Landsat, and SRTM. Other data sets in low or local demand may only be found in a few places and niche communities. Relevant services, results of analysis, applications and tools are accessible in a very scattered and uncoordinated way, often through individual initiatives from Earth Observation mission operators, scientific institutes dealing with ground measurements, service companies or data catalogues. In the discourse of Spatial Data Infrastructures, there are "catalogue services" - directories containing information on where spatial data and services can be found. For metadata "records" describing spatial data and services, there are "registries". The Geospatial industry coins specifications for search interfaces, where it might do better to reach out to other information retrieval and Internet communities. These considerations are the basis for the GENESI-DR scientific portal, which adopts a simple model allowing the geo-spatial classification and discovery of information as a loosely connected federation of nodes. This network had however to be resilient to node failures and able to scale with the growing addition of new information about data and services. The GENESI-DR scientific portal is still evolving as the project deploys the different components amongst the different partners, but the aim is to provide the connection to information, establish rights, access it and in some cases apply algorithms using the computer power available on the infrastructure with simple interfaces. As information is discovered in the network, it can be further exploited, filtered or enhanced according to the user goals. To implement this vision two specialized graphical interfaces were designed on the portal. The first, concentrates on the text-based search of information, while the second is a command and control of submission and order status on a distributed processing environment. The text search uses natural language features that extract the spatial temporal components from the user query. This is then propagated to the nodes by mapping them to OpenSearch extensions, and then returned to the user as an aggregated list of the resources. These can either be access points to dataset series or services that can be further analysed and processed. At this stage, the user is presented with dedicated interfaces that correspond to context of the action that is performing. Be it a bulk data download, data processing or data mining, the different services offer specialized interfaces that are integrated on the portal. In the overall, the GENESI-DR project identifies best practices and supporting context for the use of a minimal abstract model to loosely connect a federation of Digital Repositories. Surpassing the apparent lack of cost effectiveness of the Spatial Data Infrastructures effort in developing "catalogue services" is achieved by trimming the use cases to the most common and relevant. The GENESI-DR scientific portal is, as such, the visible front-end of a dedicated infrastructure providing transparent access to information and allowing Earth Science communities to easily and quickly derive objective information and share knowledge based on all environmentally sensitive domains.
ABSTRACT GENESI-DR (Ground European Network for Earth Science Interoperations - Digital Repositor... more ABSTRACT GENESI-DR (Ground European Network for Earth Science Interoperations - Digital Repositories) is a European Commission (EC)-funded project, kicked-off early 2008 lead by ESA; partners include Space Agencies (DLR, ASI, CNES), both space and no-space data providers such as ENEA (I), Infoterra (UK), K-SAT (N), NILU (N), JRC (EU) and industry as Elsag Datamat (I), CS (F) and TERRADUE (I). GENESI-DR intends to meet the challenge of facilitating "time to science" from different Earth Science disciplines in discovery, access and use (combining, integrating, processing, ...) of historical and recent Earth-related data from space, airborne and in-situ sensors, which are archived in large distributed repositories. GENESI-DR provides a framework where data repositories can be easily integrated and users are given a single access point for discovery and access to heterogeneous data and processing resources. Processing services can be easily integrated as well so supporting the users in the analysis of the data. Coupled with high-performance and sizeable computing resources managed by Grid technologies, GENESI-DR provides indeed the necessary flexibility for building a virtual environment that gives transparent, fast, and easy access to data (even heterogeneous and dispersed among different archives), processing services, computing resources, and results. These characteristics make GENESI-DR an ideal platform for processing large amounts of heterogeneous data (e.g., satellite and in-situ data), developing services which require fast production and delivery of results, comparing approaches and fully validating algorithms. Security solutions adopted in GENESI-DR guarantee that only authorized users can access data, processing services and processing resources. GENESI-DR is designed to support the need for an effective exploitation of the large archives. Among the different applications already integrated in GENESI-DR, in this presentation we will describe some results related to Differential SAR Interferometry (DInSAR). This is an effective technique to detect and monitor ground displacements with centimetre accuracy. The recent development of advanced DInSAR techniques, aimed at the generation of deformation time series, has led to the need of suitable environments and approaches for an effective exploitation of the large archive of SAR data acquired by the ERS, ENVISAT and RADARSAT satellites. Accordingly, we discuss, from a data access and processing point of view, some results obtained merging the robustness of an advanced DInSAR approach (namely the Small Baseline Subset (SBAS) algorithm proposed and developed by Italian CNR - IREA) with the high computing capability provided by the distributed infrastructure available through GENESI-DR. A similar analysis is currently performed using Cloud Computing resources. As final remark, it is evident the importance that the presented distributed processing solution may have in scenarios as for the Supersite initiative, which is aimed at stimulating "an international and intergovernmental effort to monitor and study selected reference sites by establishing open access to relevant datasets according to GEO principles to foster the collaboration between all various partners and end-users".
Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), 2011
This paper presents a simple tool that, thanks to the precise geolocation information contained i... more This paper presents a simple tool that, thanks to the precise geolocation information contained in Envisat Advanced Synthetic Aperture Radar products alongside with their internal organization, allows a fully automatic and distributed orthorectification of ASAR Wide Swath Medium resolution (WSM) data and ASAR Image Mode Medium resolution (IMM) data. Such a tool has been developed and integrated on Grid Processing
ESA …, 2003
The rapid developments in distributed supercomputing and parallel computing in recent years have ... more The rapid developments in distributed supercomputing and parallel computing in recent years have led to the high-performance computing facilities of several independent scientific research organisations being joined up via high-speed networks to construct very-large-scale ...