STREAMLINE Final Event (Hybrid)

This STREAMLINE hybrid event will take place in the ESRF Auditorium (EPN Campus, Grenoble) and all external participants interested in joining the session should complete a registration via the dedicated form. Once registration is completed, a Zoom link will be sent for the remote connection.

We are looking forward to sharing the STREAMLINE project outcomes and achievements with the RI and scientific community!

14:00 – 14:30 | STREAMLINE project introduction and overview (Michael Krisch)

The European Synchrotron ESRF is the brightest synchrotron source in the world and the first fourth-generation light source.  With the implementation of the Extremely Brilliant Source (EBS), the ESRF source increased its performance by two orders of magnitudes. This translates into the fastest and most complex experiment, with high throughput, multimodal and multi-scale capabilities, and ultimate time and space resolution. These new features enable novel opportunities but also novel challenges, in particular for the amount of data generated and the data analysis. 

Conscious of the game-changing opportunity offered by the ESRF, the European Commission approved the funding of STREAMLINE, an initiative worth 5 million euros, to help the ESRF define a novel business model that could optimise the exploitation of the disruptive capabilities offered by the EBS.

14:30 – 15:00 | PUMA - A Data Mining Impact Dashboard for Research Facilities (Stephanie Malbet-Monaco & Renaud Duyme)

Tracking and understanding output of research infrastructures is critical to demonstrate impact and return on investment. Towards this, “PUMA” was initially developed as a publications matching software at the Institut Laue Langevin (ILL) under the EU grant FILL2030. Thanks to STREAMLINE, this tool has been integrated at the ESRF and further developed as a “Publications and User Experiments Metadata Analyser” (PUMA v2). It responds to the needs of the ESRF management to compile and extract metadata related to the ESRF activity that is reflected in over 40,000 refereed publications and over 50,000 submitted proposals.

PUMA provides facility and instrument activity dashboards, and an advanced search module for the facility’s proposals and publications corpuses. The PUMA instrument dashboard graphics include data about institutions and countries, and publications bibliometrics related to proposals and experiments performed at the facility. This data mining tool facilitates reporting for the ESRF management and supports strategic planning for the facility by providing a better understanding of the science produced at the facility.

The current development phase of PUMA (v3) is designed to guarantee the sustainability of this project via the creation of a more generic tool that can be plugged into the digital user office software and library databases of other facilities, allowing it to be exploited by other European research infrastructures in the years to come.

The main PUMA modules, that showcase the power of such a tool in the data mining process, will be presented along with the status and evolution plan regarding its opening to a larger community of user facilities.

https://streamline.esrf.fr/non-classe/puma-publications-matching-software/

15:00 – 15:30 | Revolutionising data processing with EWOKS and ICAT (Andy Götz)

The advent of ESRF-EBS has increased the data production at the ESRF by a factor of 10 and it is not over yet as the detectors become faster and data acquisition protocols more efficient. The increased data production is a challenge for the users who in many cases were already challenged to process the raw data before the ESRF-EBS.

STREAMLINE has contributed significantly to addressing this challenge by developing innovative solutions to automate data processing and view, publish and download the processed data in the ESRF data portal. EWOKS, a meta workflow system has been developed to automatically process data for all techniques and is currently deployed on more than 50% of ESRF-EBS beamlines.

In parallel the metadata catalogue at the core of the ESRF data portal, ICAT, has been extended to enable the management of processed data and provide a unified sample tracking for all techniques. This talk will present the key features of EWOKS + ICAT and highlight the impact they have had with the help of examples. The software has been developed under an open-source license and can be adopted by other facilities. The talk will conclude with a proposal for the post-STREAMLINE phase of data automation at the ESRF-EBS and collaboration with other sites.

15:30 – 16:00 | Coffee break

16:00 – 17:30 | Co-designed with industry: New high-throughput routine services (Ennio Capria & Thanos Papazoglou)

Amongst the ground-breaking developments issued by STREAMLINE, the development of more advanced routine services, based on mature methodologies with a quiet extended community of users, seems the most relevant for the industrial community.  This deployment of novel high-throughput routine services, by paving the way to statistical measurement of large data sets, represents a major advancement for the industrial development community. The novel services have been developed in the domain of:

• Powder diffraction, supporting the domain or phase identification and strain and stress determination;
• X-ray fluorescence for elemental analysis recognition;
• 3D imaging where the increased automation in the collection of tomographic data can be a game changer for non-destructive inspections and failure analysis.

Although these services require final tuning and have been improving daily, in the last 1.5 years several thousand real samples have been tested by industrial partners and users.

16:30 - 17:00| And NEXT UP we have….Novel Access to Large User Facilities (Joanne McCarthy)

Access modes to synchrotrons have not evolved with the speed of the light source technologies. STREAMLINE has enabled ESRF to jump forwards with the evaluation and modernisation of access models. This is important to fully exploit the facility and its instruments, allowing experiment support, experiment turnover and the number of users served by the facility to be increased.

The ESRF has implemented new access models that will facilitate access to the ESRF for researchers working in fields of important societal impact who are willing to collaborate to produce more impactful science. They facilitate access for user communities with similar synchrotron needs who agree to share beam time to efficiently use regular beam time slots for the projects they consider to be of the highest importance for the community. These “community proposals”, implemented in the form of HUB and BAG proposals, are intended to optimise the use of the new ESRF-EBS X-ray beams that will allow faster and shorter experiments due to their unprecedented intensity and coherence by:

• Reducing lengthy set-up and take-down overhead time per project by fully utilising the useful beamtime in between to measure data on a maximum number of samples and projects,
• Encouraging user communities to agree together on the most important projects and samples for that community, and to assign priorities for a particular beamtime slot,
• Ensuring regular access to ESRF beamtime to allow these priorities to be set and to allow a strategy for best use of the beamtime to be conceived within the community,
• Creating scientific synergy within the community to develop tools for data acquisition, analysis and interpretation.

The formalisation and streamlining of “rapid access” routes will also be discussed. Finally, the NEXT UP project to modernise the ESRF User Portal, allowing adapted and improved access requests and user operation procedures, will be briefly described.