The astrophysical ESFRI projects will generate rich and complex, multi-dimensional datasets, and the exploitation of this unique combination of astronomy "Big Data" requires a common data infrastructure for data discovery , access and interoperability. ASTERICS aims to maximise software re-use and technology co-development for the robust, scalable and flexible handling and exploitation of the huge data streams and distributed petascale database systems associated with the ESFRI facilities - identifying best practice, defining open standards, design patterns and benchmarks, generating prototypes, constructing use-cases, and optimising frameworks and software libraries in an open innovation environment. The Virtual Observatory (VO) has been incredibly successful in integrating distributed infrastructures into one single virtual astronomy facility - the diversity of the various multi-messenger ESFRI facilities represent the obvious next step forwards. By ensuring that the ESFRI telescope products are openly accessible via the VO framework. ASTERICS wants to adapt the VO framework and tools to the ESFRI project needs, gathering requirements from the community and making the data interoperable in a homogeneous environment, enabling discovery and re-usage by the entire astronomical community and accessibility via a set of common tools and standards.
Data
Articles
A fully human-readable code for HPC data formats applicable to numerous research domainsLAPP/CNRS wanted to realise a data format generator for High Performance Computing (HPC) from a simple configuration offering greater flexibility and a shorter development time, with respect to existing generators.Read more... | |
Helping enable the data reduction needs of the SKA with data parallelisation and scaling up of CASACASA (Common Astronomy Software Applications) allows easy distribution of processing on conventional HPC clusters through the use of a shared file system, and was able to scale CASA up to the limits of storage throughput required by SKA with “SWIFTCASA"Read more... | |
Meeting the challenges of astrophysical/cosmological experiments: INAF CTA develops Workflow management system APIThe following success story was initiated as the INAF CTA science gateway wished to provide an integrated web-based Workflow Management System (WMS) API for high energy astrophysics. Read more... | |
Tailoring Software and Technologies to manage Authentication and Authorisation (A&A) in an Astronomical Data Center and improving user experienceThe following success story was initiated as INAF strived to provide users and data centres with a robust Authentication and Authorization system. The system requirements necessary to tailor make software and technologies to manage A & ARead more... | |
Making Strides in Interoperability “STOA - A Workflow Management System for Radio Astronomy” STOA (Script Tracking for Observational Astronomy) is an advanced workflow management system developed at the University of Cambridge to enable us to scale up our analyses of interferometric maps to large archived data setsRead more... | |
Yabi - A Workflow Management System and Workflow Engine for Data Reduction PipelineYabi is an application stack that provide users with an intuitive, easy to use, abstraction of compute and data environments, being deployed across a diverse set of scientific disciplines and high performance computing environmentsRead more... | |
Camera image cleaning in CTA based on wavelet filteringCTA telescopes have cameras made of over a thousand photomultiplier pixels to capture Cherenkov light induced by gamma ray or cosmic ray particle showers in the atmosphere. To reconstruct shower images with the best precision, we used wavelet filtering.Read more... | |
Virtual ObservatoryThe Virtual Observatory (VO) allows researchers to easily use astronomical data from instruments around the world and to use the VO’s tools on this data. ASTERICS works on preparing ESFRI facilities’ data for the VO and on training scientists.Read more... | |
Open access librariesWe developed several Open Access libraries for astronomical and astrophysical data: CORELib, ROAst and BeeGFS on SOC.Read more... | |
Image domain griddingThe ionosphere disturbs the radio signals detected by radio telescopes and causes blurred images. We developed a new gridding procedure using parallel processing to correct for ionospheric effects.Read more... | |
Polynomial data compressionCompression of data can solve the technical constraints of the large amounts of data produced by research infrastructures. We have developed a new lossless data compression.Read more... | |
Software and data preservationIn astronomy and astroparticle physics, software and data need to be preserved over long periods. Solutions based on container images can be helpful in this.Read more... |
Events
DADI/OBELICS A&A face-to-face MeetingWithin the scope of WP4 (DADI) Task 4.3 and WP3 (OBELICS) Task 3.4.2 there will be a face-to-face meeting organized.Read more... | |
Third ASTERICS-OBELICS workshopNew paths in data analysis and open data provision in Astronomy and Astroparticle PhysicsRead more... | |
Second European Data Provider Forum and Training EventThis workshop is modelled after the first ASTERICS Data Provider Forum and Training Event held in 2016 — it will again convene researchers as well as technicians on the topic of on-line publishing of astronomical data and related services. Read more... | |
Fourth ASTERICS Technology ForumThe Forums enable technology discussion involving the framework developers and ESFRI project staff, to develop technical collaboration and exchange good practice - establishing a European strategy for IVOA and RDA activitiesRead more... | |
Third ASTERICS Virtual Observatory SchoolThe Virtual Observatory (VO) is opening up new ways of exploiting the huge amount of data provided by the ever-growing number of ground-based and space facilities, as well as by computer simulations. Read more... | |
Second ASTERICS – OBELICS Workshop"Astronomy & Astroparticle Physics assets in building the European Open Science Cloud"Read more... | |
First ASTERICS-OBELICS International SchoolAdvanced software programming for astrophysics and astroparticle physicsRead more... | |
Second ASTERICS-OBELICS International SchoolThe aim of the school is to provide theoretical and hands-on training on Python development. Read more... | |
First European Data Provider Forum and Training EventThe first event addressing both the ESFRIs and the wider community. Read more... | |
Second ASTERICS Technology Forum These meetings gathered the European teams involved in the development of the VO framework of standards and tools to disseminate information about technological activities and expertise, to build collaborations, to discuss future activities and to coordiRead more... | |
First ASTERICS Virtual Observatory SchoolFirst ASTERICS Virtual Observatory School was organised by INTA in Madrid. Participants came here to learn about scietific usage of the VO.Read more... | |
First ESFRI Forum and Training EventThe first networking event organised around the requirements of the DADI ESFRI projects.Read more... | |
First ASTERICS Technology ForumThe meeting was organised to allow sharing of information about the ASTERICS project and ASTERICS WP4, about the partners’ expertise, and about the Virtual Observatory (VO) framework and work currently on-going in the partners’ teams. Read more... |