Plenary - Data and Model Infrastructures for the Advancement of Space Weather Science and Services

Andre Csillaghy - Daniel Heynderickx - Bogdan Nicula
Wednesday 20/11, 09:00 - 10:30 and 11:00 - 12:30

The e-Infrastructures available today greatly facilitate access to distributed and heterogeneous resources. They provide services to access and process data independent of their origin and to perform complex model runs. In Europe, the EU has ESPAS, HELIO or CASSIS. ESA supports SSA, Vispanet and VSWMC. In the U.S., NASA has the VxOs and CCMC, NSF the VSTO, and NOAA has SPIDR. With these infrastructures available, it is time to think about their future: How to organize long term operations? How to share data and model outputs? How to provide (resources for) space weather services? Answers will allow extending the data and model coverage over the entire domain of solar system sciences. It is decreasingly about creating new services, it is increasingly about making existing services understand and enhance each other. This session initiates the move towards a common solar system information space. It solicits contributions on:
  1. Data policies: sustainability program to maintain infrastructures on the long term; policies on metadata formats and content, data re-use and publication;
  2. Interoperability and
  3. Standards: (meta-)data models, vocabularies, service implementation. It focuses on plans for infrastructure extensions to provide space weather nowcasting and forecasting services and for the integration of multidisciplinary services.

Oral contributions

Seq   Time   Title
 
1   09:00   ODI - Open Data Interface
Wintoft, Peter1; Heynderickx, Daniel2; Evans, Hugh3
1Swedish Institute of Space Physics, SWEDEN;
2DH Consultancy, BELGIUM;
3ESA/ESTEC, NETHERLANDS

The Open Data Interface (ODI) is a database system for storing space environment data and metadata in an SQL database. The system is compliant with the SPASE data model. Data can be ingested from text files and CDF/ISTP/PRBEM files. Currently there are more than 100 datasets in the database such as IMP8/GME, SREM, XMM/ERMD, GOES particle and radiation data, and indices such as Dst, Kp, and SSN. Adding new datasets is straightforward. Model and code have been developed to convert CDF metadata into SPASE metadata. The process proceeds in two steps where the metadata can be further edited before stored in the database. If the raw data to be ingested are CDF files these are automatically converted before the data are stored into ODI. For non-CDF files, like plain text files, a few lines of code need to be edited to correctly parse the raw data files. As ODI is based on SQL it is accessible to a large range of different software platforms. As part of the development, interfaces to IDL, PHP, Python, Matlab and Java have been developed, but the ODBC interface also can provide direct access from many other programs. Interfaces to existing platforms can therefore be set up and applications have been updated to connect to the ODI system like SAAPS, SEDAT, and SPENVIS.

 
2   09:15   Integration of new Space Weather Services into the SSA Data Centre: Regional Aurora Forecast and Ionospheric Monitoring
Beltrami, Pablo1; Keil, Ralf1; Martinez, Unai1; Navarro, Vicente2; Kauristie, Kirsti3; Yaya, Philippe4; Béniguel, Yannick5
1etamax space GmbH, GERMANY;
2ESA-ESAC, SPAIN;
3FMI, FINLAND;
4CLS, FRANCE;
5IEEA, FRANCE

The Space Weather (SWE) Data Centre being developed in the frame of ESA's SSA pro-gramme is intended to provide a central Service Oriented Architecture framework capable of integrating new space weather services and tools. In the frame of the project DC-IV, "Evolution of the Pilot Data Centres", two new precursor services are being developed and integrated:

  • The Regional Aurora Forecast (RAF) service. This service will provide maps depicting the current and forecasted current situation of an auroral occurrence in a given region together with visibility and cloudiness information.

  • The Ionospheric Scintillation Monitoring (ISM) service providing nowcasted and forecasted worldwide and regional maps of ionospheric scintillations together with indices and alerts.

    These services will make use of newly developed models and data assimilation techniques being developed within the project. They are implemented by the domain experts in the consortium and then integrated into the SSA data centre to make use of the available functionalities, such as data import and storage services and the SWE web portal. The main challenges of this task include:

    The services to be integrated have not been developed with a SOA approach in mind. In the frame of the project all aspects relevant to the SSAs SOA infrastructure need to be addressed before the integration into the overall system architecture.

  • Development of new user interfaces for the SWE web portal. The web portal will be extended to provide access to the functionalities provided by the new services. This will include both interfaces for external users and for the service administrators.

  • Integration of the services and its interfaces into the COSIF. The services will be integrated into the SSA COSIF framework at Redu, Belgium, validated and tested to ensure the quality of the results.

    In this presentation, an overview will be given on the new services being developed and on the approach being followed for their integration into the data centre. A description will be provided on how the available infrastructure of the SSA data centre can be used to implement a common platform for future developments.

  •  
    3   09:30   From the Sun to Earth (and beyond) - Cross-use of three FP7 Heliophysics Projects.
    Perez-Suarez, David1; Tanskanen, Eija1; Kallio, Esa1; Pierantoni, Gabriele2
    1Finnish Meteorological Institute, FINLAND;
    2Trinity College Dublin, IRELAND

    Three complementary projects have been funded under the EC's Seventh Framework Programme (FP7) during the last years, namely HELIO, IMPEx and ESPAS. This presentation demonstrates how to proceed on a use case of studying an event produced on the Sun and gather all the information available on its travel through the heliosphere - helped by HELIO-, the observations in the magnetosphere - with the tools provided by IMPEx - and finally its effects on Earth (eg, ionosphere) - capability offered by ESPAS. The projects aim to help the interaction between communities which have evolved independently over decades by creating a set of tools to find relevant datasets easily (and provide relevant metadata). The use of standards and workflow tools (eg., Taverna) simplifies this exercise by offering to the scientist a comprehensive view of the event under study.
    In addition, it will be shown here the progress made by the ER-flow project for the heliophysics community. ER-flow is a FP7 project that builds community focused portals that run complex workflows.

     
    4   09:45 Invited  Surfing the Heliosphere: Integrating Heterogenous Data for Visualization, Browsing and Discovery
    Jack, Ireland1; Stys, Jeffrey1; Hughitt, V. Keith2; Mueller, Daniel3
    1ADNET Systems, Inc. / NASA's GSFC, UNITED STATES;
    2University of Maryland, UNITED STATES;
    3ESA, UNITED STATES

    The Sun and heliosphere is a complex, connected system, observed by many different instruments. The data collected by these instruments is heterogenous, and can consist of images, time series, emission spectra, etc. Further, there are a number of feature and event catalogs, both manually and automatically populated, that describe discrete occurrences of physical phenomena, such as solar flares. These data have multiple uses, and multiple audiences who want to interrogate these data for different purposes.

    This talk will describe our efforts in designing and implementing the Helioviewer Project, an ESA/NASA funded project to give users everywhere the capability to explore the Sun and inner heliosphere and to give transparent access to the underlying data. We describe our experience in creating browsing, visualization and discovery tools that present different data types from different data sources. We discuss the challenges that have arisen in integrating important services such as the Heliophysics Event Knowledgebase and the Virtual Solar Observatory into Helioviewer Project tools. Finally, we advocate the notion that interoperability is the key to creating a service ecosystem that not only promotes all existing tools for solar and space weather science and services, but can also nurture new ones.

     
    5   10:00   SEISOP, a System enabling Space Weather Services for the SSA
    Angela, Rivera Campos; Esther, Parrilla-Endrino; Maria Jesús, Enríquez; Noelia, Sánchez; Sandra, Negrín
    Elecnor Deimos, SPAIN

    The Space Environment Information System to support Operations (SEISOP) is a data and knowledge system being developed by DEIMOS for the European Space Operations Center (ESOC) of the European Space Agency (ESA).

    The objective of the SEISOP project is to provide to the mission operators, project teams, spacecraft development engineers and scientists a set of services capable to supply, extracted knowledge related to the Space Environment and its effects in the spacecraft as well as plug-in interfaces for new models.

    This paper will present the innovate Service Oriented Architecture and technologies used to implement SEISOP and its deployment in the context of the European Situation Awareness Program (SSA) lead by ESA and will focus on the gathering and processing of data from different sources in order to make it available to users of the system in an standardized way.

     
    6   10:15   Swiff Approach to Basing Space Weather Forecasts on Fundamental Physics Models
    Lapenta, Giovanni1; Swiff Consortium, EC-FP7 Network2
    1KU Leuven, BELGIUM;
    2Swiff, BELGIUM

    Swiff is a project funded by the European Commission FP7 program. Swiff is chartered with the task of space weather forecasts on fundamental physics models. We will present three examples developed by Swiff partners:

    First, SEP are generated by macroscopic events such as flares and CMES that are typically modeled by fluid models that do not retain a full kinetic description of the particle life. Statistical or empirical models are then deployed to represent the generation of SEP from a certain event. The Swiff approach is to interlock directly kinetic and fluid simulations so that the particles and the fields are advanced self consistently. This is crucial because particle acceleration in shocks and reconnection regions are very sensitive to wave particle interactions that require a self-consistent treatment of fields and particles. The approach is used in Ref. 1.

    Second, global models of the Earth environment typically rely on fluid MHD and in the most advanced cases on hybrid (fluid electrons and kinetic ions). Swiff has developed a pioneering approach for a full kinetic approach: the implicit moment method [2,3] implemented in the code iPic3D [4]. We will report 2D and 3D models of the global magnetosphere based on a full kinetic model where both electrons and ions are kinetic and driven by solar wind drive as can be obtained either from models of the heliosphere (e.g. ENLIL) or direct data (e.g. ACE).

    Third, general space weather models require to couple many methods and codes. Swiff started a collaboration in particular with the Space Weather Modelling Framework (SWMF) based in Michigan and is working to import the iPic3D in the SWMF framework. A first demonstration of coupling the code BATS'R'US with iPic3D was demonstrated at the annual meeting at EGU in Vienna [5]. The approach demonstrated the ability to resolve fully kinetically regions of reconnections fully coupled within a larger fluid model.

    [1] Baumann, Gisela, and Ake Nordlund. "Particle-in-cell Simulation of Electron Acceleration in Solar Coronal Jets." The Astrophysical Journal Letters 759.1 (2012): L9.
    [2] Brackbill, J. U., and D. W. Forslund. "An implicit method for electromagnetic plasma simulation in two dimensions." Journal of Computational Physics 46.2 (1982): 271-308.
    [3] Lapenta, Giovanni. "Particle simulations of space weather." Journal of Computational Physics 231.3 (2012): 795-821.
    [4] Markidis, Stefano, and Giovanni Lapenta. "Multi-scale simulations of plasma with iPIC3D." Mathematics and Computers in Simulation 80.7 (2010): 1509-1519. [5] Toth, Gabor, et al. "Coupling the BATS-R-US global MHD code with the implicit particle-in-cell code iPIC3D." EGU General Assembly Conference Abstracts. Vol. 15. 2013.

     
    7   11:00   Accessing Near-Earth Space Data through the ESPAS e-Science System: Design and Demonstration of first Working Prototype
    Ventouras, Spiros1; Belehaki, Anna2; Hapgood, Mike1; Lebesis, Antonis3
    1RAL, UNITED KINGDOM;
    2National Observatory of Athens, GREECE;
    3ATHENA Research and Innocation Center, GREECE

    The aim of ESPAS platform is to integrate heterogeneous data from the earth's thermosphere, ionosphere, plasmasphere and magnetosphere. ESPAS supports the systematic exploration of multipoint measurements from the near-Earth space through homogenised access to multi-instrument data. It provides access to more than 40 datasets: Cluster, EISCAT, GIRO, DIAS, SWACI, CHAMP, SuperDARN, FPI, magnetometers INGV, SGO, DTU, IMAGE, TGO, IMAGE/RPI, ACE, SOHO, PROBA2, NOAA/POES, etc. The concept of extensibility to new data sets is an important element in the ESPAS architecture.
    Within the first year of the project, the main components of the system have been developed, namely, the data model, the XML schemas for metadata exchange format, the ontology, the wrapper installed at the data nodes so that the main platform harvest the metadata, the main platform built on the D-NET framework and the GUI with its designed workflows. The first working prototype supports the search for datasets among a selected number of databases (i.e., EDAM, DIAS, Cluster, SWACI data). The next immediate step would be the implementation of search for characteristics within the datasets. For the second release we are planning to deploy tools for conjunctions between ground-space and space-space and for coincidences. For the final phase of the project the ESPAS infrastructure will be extensively tested through the application of several use cases, designed to serve the needs of the wide interdisciplinary users and producers communities, such as the ionospheric, thermospheric, magnetospheric, space weather and space climate communities, the geophysics community, the space communications engineering, HF users, satellite operators, navigation and surveillance systems, and space agencies. The final ESPAS platform is expected to be delivered in 2015.

    The abstract is submitted on behalf of the ESPAS-FP7EU team (http://www.espas-fp7.eu): Mike Hapgood, Anna Belehaki, Spiros Ventouras, Natalia Manola, Antonis Lebesis, Bruno Zolesi, Tatjana Gerzen, Ingemar H&aumlggstrom, Anna Charisi, Ivan Galkin, Jurgen Watermann, Jesse Andries, Matthew Angling, Timo Asikainen, Alan Aylward, Henrike Barkmann, Peter Bergqvist, Andrew Bushell, Fabien Darrouzet, Dimitris Dialetis, Carl-Fredrik Enell, Daniel Heynderickx, Norbert Jakowski, Magnar Johnsen, Jean Lilensten, Ian McCrea, Kalevi Mursula, Bogdan Nicula, Michael Pezzopane, Viviane Pierrard, Bodo Reinisch, Bernd Ritschel, Luca Spogli, Iwona Stanislawska, Claudia Stolle, Eija Tanskanen, Ioanna Tsagouri, Esa Turunen, Thomas Ulich, Matthew Wild, Tim Yeoman

     
    8   11:20 Invited  The ESA Virtual Space Weather Modelling Centre - Phase 1B
    Poedts, Stefaan1; Lapenta, Giovanni1; Deconinck, Herman2; Lani, Andrea2; Fontaine, Bernard3; Depauw, Jan3; Diet, Fabian3; Diep, Ho Hgoc3; Mihalache, Nicolae3; Heynderickx, Daniel4; De Keyser, Johan5; Crosby, Norma5; Rodriguez, Luciano6; Van der Linden, Ronald6
    1KU Leuven/CmPA, BELGIUM;
    2VKI, BELGIUM;
    3Space Applications, BELGIUM;
    4DHConsultancy, BELGIUM;
    5BIRA-IASB, BELGIUM;
    6ROB, BELGIUM

    The ESA ITT project (AO/1-6738/11/NL/AT) - to develop Phase 1 of a Virtual Space Weather Modelling Centre - has the following objectives and scope:

    1. The construction of a long term (~10 yrs) plan for the future development of a European virtual space weather modelling centre consisting of a new 'open' and distributed framework for the coupling of physics based models for space weather phenomena;
    2. The assessment of model capabilities and the amount of work required to make them operational by integrating them in this framework and the identification of computing and networking requirements to do so.
    3. The design of a system to enable models and other components to be installed locally or geographically distributed and the creation of a validation plan including a system of metrics for testing results.

    The consortium that took up this challenge involves: 1)the Katholieke Universiteit Leuven (Prime Contractor, coordinator: Prof. S. Poedts); 2) the Belgian Institute for Space Aeronomy (BIRA-IASB); 3) the Royal Observatory of Belgium (ROB); 4) the Von Karman Institute (VKI); 5) DH Consultancy (DHC); 6) Space Applications Services (SAS). The project started on May 14 2012 and will take 24 months for completion. In November 2013, Phase 1B will be ongoing which means that the blueprint of the framework is ready, the implementation of the VSWMC Framework Prototype software has been finalized and the models are being adapted and packaged in such a way that they become usable in the Prototype VSWMC System. A status report will be given here.
     
    9   11:40   Why would a Modeller Take the trouble to Comply with a Shared Modelling Framework?
    De Keyser, Johan1; Gamby, Emmanuel1; Kruglanski, Michel1; Poedts, Stefaan2; Lapenta, Giovanni2; Lani, Andrea3; Deconinck, Herman3; Heynderickx, Daniël4
    1Belgian Institute for Space Aeronomy, BELGIUM;
    2KULeuven, BELGIUM;
    3Von Karman Institute, BELGIUM;
    4DHConsulting, BELGIUM

    ESA invests in model execution environments such as Vispanet, SPENVIS, and the VSWMC. In the U.S., NASA operates CCMC, but there are also collaborations based on the Space Weather Modelling Framework and on the Center for Integrated Space Weather Modelling Framework. But why would a modeller actually take the trouble to comply with such a common modelling framework? Indeed, this requires a considerable investment of time. In general, the model computations may also incur a computational overhead. We will therefore review a number of good reasons and benefits that could convince model developers to comply with a shared modelling framework, but this puts some requirements on the framework.

    A first objective is to minimise the effort for the modeller. The framework should operate based on a clear definition of the data structures to be read or written, or to be exchanged with other models, so that it is actually self-documenting. A minimum coding effort should be needed to comply with the framework. A development environment must be provided that includes testing and debugging facilities for contributed models, e.g. for monitoring the data flows.

    A second objective is to maximise the return to the modeller. A modelling framework can provide model performance metrics, so that the modeller himself no longer has to invest in implementing such an infrastructure. Using a common framework, a modeller can easily collaborate with others in a modular approach to multi-physics modelling. The framework can provide a flexible way of swapping models in a coupled model set, which would allow to evaluate model performance from the scientific point of view through comparative studies. This allows a modeller to easily compare and evaluate various versions and improvements to his model. Being able to incorporate ones model into a more complete description of the problem at hand will heighten the modellers awareness of the qualities and limitations of his model, which is likely to benefit space weather modelling in general and to bring the scientist closer to the end user application. In addition, the modeller will get useful feedback on possible improvements.

    Current efforts in the community, such as ESA's Virtual Space Weather Modelling Centre, envisage to provide this kind of support, at least in the long run.

     
    10   12:00   Debate: ''Will model and data infrastructures advance space weather science?”
    Csillaghy, Andre1; Heynderickx, Daniel2; Nicula, Bogdan3
    1FHNW, SWITZERLAND;
    2DH Consultancy, BELGIUM;
    3OMA, BELGIUM

    We will organise a debate on the future of the infrastructures supporting space weather science and services. The debate will consist of a 10 minutes presentation by the session conveners, followed by targeted questions to session speakers and to the public. This debate will last 30 minutes.

    Posters

    Seq   Title
     
    1   Space Weather at the UK Met Office: Operations & Development
    Bingham, Suzy; Jackson, David; Gibbs, Mark
    Met Office, UNITED KINGDOM

    The UK Met Office provides a space weather forecasting service which operates 24/7. Through working with a range of partners, including the US National Oceanic & Atmospheric Administration (NOAA), the British Geological Survey (BGS), the UK Space Agnecy & the British Antarctic Survey (BAS), the Met Office have developed this service to monitor solar activity. Described here is the Enlil model which has been implemented operationally at the Met Office & provides a back-up for the NOAA SWPC model. Also described are a number of models which will be implemented to provide futher information for the Met Office Hazard Centre forecasters. These models include the Multi-Instrument Data Analysis System (MIDAS) which performs 3D tomography of the ionosphere, & SPACECAST which forecasts the high energy electron flux in the radiation belts.

     
    3   The STAFF Viewer: A Powerful Tool for Space Weather Forecasters and Researchers
    Malisse, Vincent; Verbeeck, Cis
    Royal Observatory of Belgium, BELGIUM

    The Solar Timelines Viewer for AFFECTS (STAFF) is a dynamical online viewer that provides a whole range of timelines related to solar activity and space weather. It is currently being developed at the Royal Observatory of Belgium (ROB) as part of the FP7 project AFFECTS (Advanced Forecast For Ensuring Communications Through Space).

    The STAFF viewer and its database have been designed to allow the user to view and compare timelines from different data sources in any time interval, ranging from real time to the full archive of past data. STAFF is a web-based application based on JSP, HTML, CSS and JavaScript and is built on top of a PostgreSQL database.

    Since it is tailored to space weather operations, STAFF provides easy and dynamical access to realtime space weather timelines such as GOES X-ray curves, ACE data and geomagnetic indices. It also serves solar activity timelines such as the International Sunspot Number and the F10.7 radio flux. Furthermore, STAFF will provide in the near future some brand new proxies extracted automatically from coronal EUV images (AIA, SWAP, EIT), like the total flux observed in the telescope passband, active region area, and total EUV intensity within active regions. Finally, STAFF can show views of previous Carrington rotations and has a feature that allows grafting customized plots into other webpages.

    The STAFF database infrastructure is designed for quick access of timelines and allows for long term research on all datasets.

    We present the STAFF viewer and database, its principles and design, as well as its power and ease-of-use for the user.

     
    4   Making Solar FITS Files Interoperable
    Berghmans, David1; Andries, Jesse1; Nicula, Bogdan1; Gallagher, Peter2; Bentley, Bob3
    1Royal Observatory of Belgium, BELGIUM;
    2Trinity College Dublin, IRELAND;
    3MSSL/UCL, UNITED KINGDOM

    Astronomically images in general, and solar images in particular, are traditionally stored and distributed as FITS files. In its simplest version, a FITS file consists of a human-readable ASCII header of keyword-value pairs containing the metadata, followed by a binary part containing the actual data. In addition, a FITS file may contain several extensions, and each of these may contain a data object.

    Over the years, the FITS format has become very popular. Nevertheless in a world where interoperability is the norm, the FITS format has to face a few problems. One of them is that the keywords are limited to 8 characters and their meaning not always unique nor clear. Several attempts have been made to standardise the keywords, ranging from full FITS standard keywords, IAU approved keywords to more discipline specific keyword dictionaries. In addition, specific papers exist for describing world & celestial, spectral and time coordinates in FITS (http://fits.gsfc.nasa.gov/fits_wcs.html).

    The keyword description documents we are aware of are not machine readable. This is a strong limitation on interoperability as it means that essentially manual work has to be done when combining solar images from different sources (e.g. in versatile image viewers) or when porting the images to virtual observatory efforts with their own data model.

    In this paper we explore solutions to this problem by encapsulating the FITS file in a VOTable (XML format) with the metadata referring to IVOAA standards. We then propose a procedure to translate form this exploded view to any destination data model. As a real-life example we show the conversion of SWAP and LYRA FITS files to the ESPAS data model.

     
    5   The Need for a Standardized Data Format for Solar Radio Spectrograms
    Marqué, Christophe; Bourgoignie, Bram
    STCE - Royal Observatory of Belgium, BELGIUM

    Solar radio spectrometers are a key element for the monitoring of the solar activity, providing information on flare-accelerated particles and shock waves propagating in the corona or the interplanetary medium. For historical reasons, each observatory operating such instruments (ground-based or space-based) has developed his own data format, sometimes proprietary, sometimes derived from international data format (FITS, CDF...), but even in that case without much coordination, hampering therefore the possibility to easily combine these data together. We review here the current situation, discuss which information is needed for a better integration and propose some solutions.

     
    6   NMDB: An e-Infrastructure Funded by the European Union's Framework Programme
    Steigies, Christian
    Christian-Albrechts Universität zu Kiel, GERMANY

    The Real-time database for high-resolution neutron monitor measurements (NMDB) provides access to ground-based cosmic ray measurements from Neutron Monitors. As the project was funded only for two years, we have created a database that can be operated in the long term without incurring license fees. For this only an open source database comes into consideration. We chose MySQL as our database,
    since at the time of the creation of NMDB, MySQL provided the easiest solution to replicate the data to different servers, by which we can improve the accessibility of the data due to full NMDB mirrors at different institutes. Since 2007, there have been many changes in MySQL land: MySQL has been sold twice and there are some concerns that the development of MySQL may be stopped by its current owner.
    Fortunately there are several open source forks of MySQL, which guarantee the future of our database. In addition to this, current versions of MySQL (and MariaDB) include improvements which allow for a real multi-master setup.
    With this setup a NMDB 2.0 database with several distributed masters could be created, so that NMDB can continue to grow without overloading our database and providing even faster access for data providers and users.

     
    7   SEPServer - A new Tool for SEP Research
    Vainio, Rami1; Afanasiev, Alexander1; Agueda, Neus2; Aurass, Henry3; Battarbee, Markus4; Braune, Stephan3; Dröge, Wolfgang5; Hamadache, Clarisse6; Heber, Bernd7; Herbst, Konstantin7; Heynderickx, Daniel8; Kartavykh, Yulia5; Kempf, Andreas5; Kiener, Jürgen9; Kilian, Patrick5; Klein, Karl-Ludwig10; Kopp, Andreas7; Kouloumvakos, Athanasios11; Lange, Sebastian5; Maisala, Sami1; Malandraki, Olga12; Mishev, Alexander13; Nindos, Alexander11; Oittinen, Tero1; Papaioannou, Athanasios12; Pönni, Arttu1; Raukunen, Osku4; Riihonen, Esa4; Rodríguez-Gasén, Rosa14; Sanahuja, Blai2; Scherer, Renate7; Spanier, Felix5; Tatischeff, Vincent10; Usoskin, Ilya13; Valtonen, Eino4; Vilmer, Nicole10
    1University of Helsinki, FINLAND;
    2University of Barcelona, SPAIN;
    3Leibniz Institute für Astrophysik Potsdam, GERMANY;
    4University of Turku, FINLAND;
    5Julius Maximilians Universität Würzburg, GERMANY;
    6University of Paris Sud and CNRS-CSNSM, FRANCE;
    7Christian-Albrechts Universität zu Kiel, GERMANY;
    8DH Consultancy, Leuven, Belgium, BELGIUM;
    9CNRS-CSNSM, Orsay, FRANCE;
    10Paris Observatory and CNRS-LESIA, FRANCE;
    11University of Ioannina, GREECE;
    12National Observatory of Athens, GREECE;
    13University of Oulu, FINLAND;
    14CNRS-CSNSM and CNRS-LESIA, FRANCE

    The EU/FP7 project SEPServer has produced a new tool, which greatly facilitates the investigation of solar energetic particles (SEPs) and their origin: a server providing SEP data, related electromagnetic (EM) observations and analysis methods, comprehensive catalogues of the observed SEP events, and educational/outreach material on solar eruptions. The project has combined data and knowledge from eleven European partners and several collaborating parties from Europe and the US. The datasets provided by the consortium partners have been collected in a MySQL database on a server, which also hosts a web interface providing browsing, plotting and post-processing and analysis tools developed by the consortium, as well as the SEP event catalogues. SEPServer adds value to several space missions and Earth-based observations by facilitating the coordinated exploitation of and open access to SEP data and related EM observations, and promoting correct use of these data for the entire space research community.

    The server will be released to the public during the Tenth European Space Weather Week.

     
    8   Space Weather Data Services at Sodankylä Geophysical Observatory
    Enell, Carl-Fredrik1; Rideout, Bill2; Raita, Tero1; Häggström, Ingemar3; Kozlovsky, Alexander1; Ulich, Thomas1
    1Sodankylä Geophysical Observatory, FINLAND;
    2MIT Haystack Observatory, UNITED STATES;
    3EISCAT Scientific Association, SWEDEN

    Sodankylä Geophysical Observatory (SGO) is located in Finland 120 km north of the Arctic Circle. SGO, which celebrates its 100th anniversary this year, has some of the longest time series of geospace observations in existence; geomegnetic observations since 1914 and ionosoundings since 1957. For the first 48 years, SGO ionograms were stored on 35 mm film and scaled manually. Since 2005 a new digital chirp ionosonde is used but ionospheric parameters are still read manually.

    As part of the ESPAS project, SGO is committed to improve the online availability of these unique datasets. ESPAS data services at SGO will to a large extent be based on the MADRIGAL database, which is the de facto standard for incoherent scatter radar data. The SGO MADRIGAL service is deployed in collaboration between SGO and the radar groups at Millstone Hill and EISCAT. In this way ESPAS benefits from developments in the incoherent scatter radar community.

     
    9   KAIRA Space Weather Facility - First Results
    Ulich, Thomas1; McKay-Bukowski, Derek1; Vierinen, Juha2; Virtanen, Ilkka3; Kero, Antti1; Fallows, Richard4; Orispää, Mikko1; Postila, Markku1; Lehtinen, Markku1
    1Sodankylä Geophysical Observatory, FINLAND;
    2MIT Haystack Observatory, UNITED STATES;
    3Dept of Physics/University of Oulu, FINLAND;
    4ASTRON, NETHERLANDS

    Since August 2012, the KAIRA, the Kilpisj&aumlrvi Atmospheric Imaging Receiver Array, which is a facility for Space Weather and Astronomy Research, has been in operation. KAIRA is located at Kilpisj&aumlrvi, Northern Finland, about 85 km east of Tromso, Norway. Originally, KAIRA was built for prototyping work related to develop receiver technology for the EISCAT_3D Incoherent Scatter Radar, which is a large, phased-array 3D-imaging radar system for Northern Europe.

    KAIRA, however, is a highly versatile and interesting facility in its own right. It is a broad-band receiver operating between 10 MHz and 88 MHz (LBA) and 110 MHz and 270 MHz (HBA). It can be used, e.g., to monitor interplanetary as well as ionospheric scintillations, as an imaging riometer, as a receiver for passive radar applications using the signals of other transmitters in the area, or indeed as a receiver for the current EISCAT VHF incoherent scatter radar.

    Here we highlight a selection of the first results and tell about the facilities capabilities for space weather research.

     
    10   The Heliophysics Event Knowledge Base, and Beyond.
    Delouille, Veronique1; Hurlburt, Neal2; Timmons, Ryan2; Martens, Petrus3; Mampaey, Benjamin1; Davey, Alisdair4
    1STCE/Royal Observatory of Belgium, BELGIUM;
    2Lockheed Martin Advanced Technology Center, UNITED STATES;
    3Montana State University, UNITED STATES;
    4Harvard Smithsonian Center for Astrophysics, UNITED STATES

    The immense volume of data generated by the suite of instruments on the Solar Dynamics Observatory (SDO) requires new tools for efficient identifying and accessing of data.
    Cataloguing events and features is necessary in order to facilitate access to dataset of interest for the users. The Heliophysical Events Knowledge base (HEK) infrastructure was developed by LMSAL in order to fill in this need. The HEK gathers a set of feature-detection algorithms (some of which coming from the NASA-funded Feature Finding Team effort) in a common 'Event Detection System' which share a.o. a common vocabulary for the metadata. Web services and clients are provided for searching the metadata, reviewing the results, and efficiently accessing the data. For example, the HEK database can be queried from within IDL or Python, and selected datasets can be retrieved via the 'Virtual Solar Observatory' (VSO) infrastructure, for which an interface exists both in IDL and Python.

    Recently, these clients were also used to display HEK events within visualization software such as the Helioviewer system. This link between HEK database and visualization software can be further utilized in order to display 'Space Weather alerts', as it is foreseen in the Space Weather Helioviewer software currently under development at the Royal Observatory of Belgium.

     
    11   GIC Recordings at the North-West of Russia for EURISGIC Project: Data and Modeling
    Sakharov, Yaroslav1; Katkalov, Juri1; Selivanov, Vasili2; Viljanen, Ari3
    1Polar Geophysical Institute, RUSSIAN FEDERATION;
    2Kola Science Center RAS, RUSSIAN FEDERATION;
    3Finnish Meteorological Institute, FINLAND

    Geomagnetically induced currents in neutrals of the five transformer substations are used to investigate the effects of space weather on power grid in the framework of EURISGIC Project. Two years of continuous registration was given ample material to assess the dependence of GIC on the level of geomagnetic activity. Recorded GIC are compared with the results of model calculations. The research leading to these results has received funding from the European Community's Seventh Framework Program (FP7/2007-2013) under grant agreement no260330.

     
    12   TRANSMIT Data System: An infrastructure for the Advancement of Ionospheric Science and Services
    Plakidis, Eleftherios; Romano, Vincenzo; De Franceschi, Giorgiana
    Istituto Nazionale di Geofisica e Vulcanologia, ITALY

    At a COST 296 MIERS (Mitigation of Ionospheric Effects on Radio Systems) workshop held at the University of Nottingham in 2008, the establishment of a sophisticated Ionospheric Perturbation Detection and Monitoring (IPDM) network (http://ipdm.nottingham.ac.uk) was proposed by major European experts and encouraged by the Euroean Space Agency (ESA)as the way forward to deliver the state-of-the-art to protect the range of essential systems vulnerable to ionospheric threats. It was proposed the establishment of an operational European wide information service, capable of detecting and monitoring the whole spectrum of ionospheric perturbations and related scintillations (via geo-plasma warnings, now-casts and forecasts) for the wider European user community, including SME's, government offices, commercial and public users. Concurrent related research will help to develop effective techniques for mitigating ionospheric threats.

    TRANSMIT (Training Research and Applications Network to Support the Mitigation of Ionospheric Threats),an FP7 Marie Curie Initial Training Network, is the precursor for the establishment of the IPDM network and focuses on GNSS and business sectors reliant to it. The project (www.transmit-ionosphere.net) exploits the existing specialized European science base and take advantage of insight and full commitment from European GNSS industry and end-users in order to prove the IPDM network concept and setup its prototype. TRANSMIT prototype is based on a consortium that brings together some of the biggest GNSS Rx manufactures and precise positioning service providers, as well as leading research institutes and universities around the Europe, to provide the requirements, final validation and lead the system development, respectively. The dissemination of the developed capabilities will be achieved via the web-based prototype system, which will operate on a number of pre-selected scenarios regarding the state of the ionosphere, and not in real-time.
    In the recent TRANSMIT Newsletter (http://www.transmit-
    ionosphere.net/transmit/newsletters.aspx)important constraints that are expected to influence the development of the TRANSMIT prototype system were presented. These constraints are: 1) the need for various levels of asset management (data/information/knowledge), 2) the rapid change of the development environment, which is worse further by the immaturity of the research layer to quickly comprehend and respond to the business needs, 3) the "integration" in terms of data, policies and processes and 4) the "data budget" which resembles similar data management requirements as the ones in the so-called Big-data or e-science environments.

    This paper covers some of the main on going activities related to the development of the "Data System" (DS) that implements the various Data services required by the TRANSMIT prototype system. The preliminary infrastructure (hardware/software) to respond to the above mentioned constraints will be described and the results from the interfacing between the data and the application layers will be shown.

     
    13   Space Weather Helioviewer : Challenges of Visualizing Heterogeneous Solar Data
    Verstringe, Freek; Bourgoignie, Bram; Nicula, Bogdan; David, Berghmans; Marcqué, Christophe; Delouille, Véronique
    Royal observatory Belgium, BELGIUM

    Helioviewer aims to become the sidekick of virtual observatories and aggregators of solar observations by providing quicklook data, context data and model visualisation. The Space Weather Helioviewer (SWHV, ESTEC/ITT AO/1-7186) is an extension of the JHelioviewer application (http://jhelioviewer.org) with space weather relevant capabilities within a streamlined user interface. The Helioviewer project can be seen from two sides: On one hand, it involves the visualisation of the various datasets and their combination in new ways. On the other hand, it develops and implements standards and APIs in order to be able to quickly handle this data in new contexts without much overhead. The data itself is heterogeneous: it contains 1D data (timelines); 2D data (solar images and spectrograms); 3D data (multi-spacecraft imaging, magnetic field lines modeling), solar event detections (e.g. HEK) and space weather alerts. Therefore one of the main goals of the project is to present this quicklook data through a uniform and convenient API.

     
    14   Creating a Collaborative Research Environment for Space Weather
    Bentley, Robert1; Aboudarham, Jean2; Berghmans, David3
    1University College London, UNITED KINGDOM;
    2Observatory of Paris-Meudon, FRANCE;
    3Royal Observatory of Belgium, BELGIUM

    Understanding space weather phenomena requires access to many different types of information and tools. Advances in technology have resulted in a wealth of capabilities being easily accessible through the Internet; some of these can easily be used together but this is not the general case. We propose to try to work towards a more general research environment that incorporates as many of the existing tools as possible.

    In the HELIO project we have developed a comprehensive set of services that can be used to address science use cases in heliophysics including space weather effects on the Earth. The interfaces of the HELIO services are compliant with standards developed by the International Virtual Observatory Alliance (IVOA) although some extensions have been necessary because of differences in the types of query that need to be made.

    In the CASSIS project we have been examining ways of improving interoperability between services and data and metadata sets. The HELIO project is a good template to work from but clearly other ideas will need to be factored in if we try to incorporate

    We report on the experience we have gained in developing capabilities that are compliant with standards and the adjustments that have been necessary. We also describe the steps need to create a collaborative research environment for space weather.

     
    15   An Automated Solar Synoptic Analysis Software System
    Yoon, Kichang; Hong, Sunhak; Kim, Jae Hun; Kim, Young-Kyu
    Korean Space Weather Center of RRA, KOREA, REPUBLIC OF

    We have developed an automated software system of identifying solar active regions, filament channels, and coronal holes, those are three major solar sources causing the space weather. Space weather forecasters of NOAA Space Weather Prediction Center produce the solar synoptic drawings as a daily basis to predict solar activities, i.e., solar flares, filament eruptions, high speed solar wind streams, and co-rotating interaction regions as well as their possible effects to the Earth. As an attempt to emulate this process with a fully automated and consistent way, we developed a software system named ASSA(Automated Solar Synoptic Analysis). When identifying solar active regions, ASSA uses high-resolution SDO HMI intensitygram and magnetogram as inputs and providing McIntosh classification and Mt. Wilson magnetic classification of each active region by applying appropriate image processing techniques such as thresholding, morphology extraction, and region growing. At the same time, it also extracts morphological and physical properties of active regions in a quantitative way for the short-term prediction of flares and CMEs. When identifying filament channels and coronal holes, images of global H-alpha network and SDO AIA 193 are used for morphological identification and also SDO HMI magnetograms for quantitative verification. The output results of ASSA are routinely checked and validated against NOAA';s daily SRS(Solar Region Summary) and UCOHO(URSIgram code for coronal hole information). A couple of preliminary scientific results are to be presented using available output results. ASSA will be deployed at the Korean Space Weather Center and serve its customers in an operational status by the end of 2012.

     
    16   The Design of Value Added Services to Serve ESPAS Users
    Belehaki, Anna1; Gerzen, Tatjana2; Barkmann, Henrike2; Watermann , Jurgen3; Tsagouri, Ioanna1; Heynderickx, Daniel4; Bushell , Andrew5; Aylward, Alan6; Guio, Patrick6
    1National Observatory of Athens, GREECE;
    2German Aerospace Center, GERMANY;
    3jfwConsult, FRANCE;
    4DHConsultancy, BELGIUM;
    5Met Office, UNITED KINGDOM;
    6UCL, UNITED KINGDOM

    The primary objective of ESPAS is to support the access to observations from the near-Earth space environment. This is a region that extends from the Eart's atmosphere up to the inner magnetosphere. Observing instruments that are linked to ESPAS include ionosondes, incoherent scatter radars, magnetometers, GNSS receivers and a large number of space sensors and radars. The ESPAS platform supports the systematic exploration of multi-point measurements from near-Earth space through homogeneous access to diverse data, enhances researchers' capability to develop advanced models of the geospace, supports data assimilation and provides tools for validation of models. Although the system development is in its early phase, the consortium has already started to analyse indicative scientific problems, whose study will be possible through the use of ESPAS services. The scientific advances resulting from these studies will lead to the development of validated scientific models and consequently to reliable predictions and related products and value-added services that will meet the needs of scientists, operators, decision makers, system developers, etc. An important work done within the ESPAS project is the definition of several scientific scenarios called "use cases". The "use cases" express the user requirements on the ESPAS system, in other words they express "what" the system should be able to perform. These scenarios are exploring the required behaviour of ESPAS and form a solid basis for testing the system's behaviour as it responds to a request that originates from outside of the system. The following main groups of use cases are under analysis and first results will be reported in the ESWW10: a) Homogenised access to the main ESPAS data repositories b) coincidences and conjunctions between ground-space and space-space monitoring units c) tools to validate models d) on line implementation of models able to support space weather prediction services.

     
    17   SWEMEP: A Platform as a Service (PaaS) for Executing Space Weather Models in the Cloud
    Lawrence, Gareth1; Reid, Simon1; Novak, Daniel2; Parsons, Paul3; Navarro, Vicente4
    1RHEA System S.A., BELGIUM;
    2CGI, GERMANY;
    3The Server Labs, SPAIN;
    4ESA-ESAC, SPAIN

    Space Weather Software Models are used to support analysis and forecasting of space weather phenomena and the effects of these phenomena on spacecraft and other critical infrastructure. Exploitation depends on efficient ICT infrastructure for coupling models and supporting heterogeneous execution; software, hardware and networks capable of supporting challenging CPU and communication requirements.

    Recent developments in technology in cloud computing offer significant benefits such as flexibility and immediate scalability ("elasticity") that are particularly well suited to these challenges.

    We will present the concepts, architecture and technology choices as interim results of a study being conducted for ESA on this topic. The overall objective of the study is to assess needs and define a blueprint for an ESA-wide cloud solution, comprising two layers:

    - A common IaaS (Infrastructure as a Service) in which the service provided to users consists of access to virtual servers, likely to be deployed as a combination of private and public cloud services. The technical solution is complemented by strong focus on security and governance aspects.

    - A space weather Paas (Platform as a Service) built using IaaS services, which will provide developers with the building blocks and semantics for managing complex mathematical models and their data, the business logic to describe the processing sequence, handling scalability, fault tolerance, etc. in their applications.

     
    18   The COMESEP Alert System
    Crosby, Norma B.1; Veronig, Astrid2; Robbrecht, Eva3; Rodriguez, Luciano3; Vrsnak, Bojan4; Vennerstrom, Susanne5; Malandraki, Olga6; Dalla, Silvia7; Srivastava, Nandita8; Hesse, Michael9; Odstrcil, Dusan10
    1Belgian Institute for Space Aeronomy, BELGIUM;
    2University of Graz, AUSTRIA;
    3Royal Observatory of Belgium, BELGIUM;
    4Hvar Observatory, CROATIA;
    5Technical University of Denmark, DENMARK;
    6National Observatory of Athens, GREECE;
    7University of Central Lancashire, UNITED KINGDOM;
    8Udaipur Solar Observatory, INDIA;
    9NASA Goddard Space Flight Center, UNITED STATES;
    10George Mason University, Fairfax and NASA Goddard Space Flight Center, UNITED STATES

    Tools for forecasting geomagnetic storms and solar energetic particle (SEP) radiation storms have been developed under the three-year EU FP7 COMESEP (COronal Mass Ejections and Solar Energetic Particles) collaborative project. To enhance our understanding of the 3D kinematics and interplanetary propagation of coronal mass ejections (CMEs), the structure, propagation and evolution of CMEs have been investigated. In parallel, the sources and propagation of SEPs have been examined and modeled. During the third year of the COMESEP project the produced tools have been validated and implemented into an operational space weather alert system. The COMESEP alert system provides notifications for the space weather community. To achieve this the system relies on both models and data, the latter including near real-time data as well as historical data.
    Geomagnetic and SEP radiation storm alerts are based on the COMESEP definition of risk. The COMESEP alert system is being launched during ESWW10 and will be demonstrated at the Fair. For more information see the project website (http://www.comesep.eu/). This work has received funding from the European Commission FP7 Project COMESEP (263252).

     
    20   space weather monitoring and analysis system at moscow state university
    Kalegaev, Vladimir; Panasyuk, Mikhail; Barinova, Wera; Bobrovnikov, Sergey; Mukhametdinova, Ludmila; Myagkova, Irina
    Skobeltsyn Institute of Nuclear Physics, Moscow State University, RUSSIAN FEDERATION

    Space monitoring data center of Moscow State University provides operational information on radiation state of the near-Earth space. Complex, fully automated information system gives access to the actual data characterizing the level of solar activity, geomagnetic and radiation conditions of the magnetosphere and heliosphere via the Internet portal http://swx.sinp.msu.ru/ in the real time mode. The main components of the system are real-time data and the models of space environment. Operational data are coming from space experiments, both, Russian and foreign, on charged particle fluxes in energy channels from hundreds keV to hundreds MeV. The UV images of the Sun and solar wind parameters are also used in forecasting and now-casting. The models of the space environment working in an autonomous mode are used to generalize the information obtained from observations on the whole magnetosphere. Interactive applications and operational forecasting services are created on the base of these models. Velocities of high speed streams in solar wind on the Earth orbit are reconstructing with advance time of 3-4 days on the basis of automatic estimation of parameters of the coronal holes detected on the images of the Sun received from the SDO satellite. By means of neural network approach Dst-index online forecasting at 0.5-1.5 hours forward depending on solar wind and the interplanetary magnetic field, measured by ACE satellite is carrying out.

     
    21   Deployment architecture to support the IT capabilities of Brazilian Space Weather Program
    Sant'Anna, Nilson1; Takahashi, Hisao1; Denardini, Clezio1; Ivo, Andre2; Gomes, Victor2; Pereira, Fernando2; Moraes, Marco2
    1National Institute for Space Research (INPE), BRAZIL;
    2INDRA Company S.A. / National Institute for Space Research (INPE), BRAZIL

    The Brazilian Space weather information and prediction Center (EMBRACE) was held in 2008, and today we provide several near real-time information on the ionosphere, geomagnetic fields, cosmic rays over the south America and solar radio wave radiations, in addition to the solar and interplanetary ambient conditions from the other space weather centers. The ground based sensors and receivers generate data with different volumes and different frequencies ranging from a few seconds to a few hours. Furthermore, there is a need of receiving such data in real time to perform the monitoring 24 hours per day,7 days per week. In order to support such a demand five applications were developed for receiving, processing and visualization of data from the instruments spread out over Brazil. These applications use an architecture based on components that interact asynchronously. In order to meet the requirements of performance, availability and fault tolerance was developed for components in a high performance system. This architecture is based on the replication of the components used by the application and the distribution of each component in a dedicated server. Virtual machines are used to enable the creation of multiple copies of components with servers and databases. The TI infrastructure of the center currently has 16 servers, each one with 16 processors and 32 GB of RAM. Furthermore, there is used an 32 TB for storing the virtual machines, raw data and database. All servers have CentOS 6 and virtualization is through native Linux solution, called Kernel-based Virtual Machine (KVM). We will summarize the operations and applications developed for our Space weather center.