Home Page

Main.HomePage History

Hide minor edits - Show changes to markup

February 27, 2012, at 04:46 PM by 134.158.71.159 -
Changed line 45 from:

SONGS is funded for four years (2012-2015) by the The French National Research Agency (ANR) under contract no. ANR-11-INFRA-XXX.

to:

SONGS is funded for four years (2012-2015) by the The French National Research Agency (ANR) under contract no. ANR-11-INFRA-13.

December 19, 2011, at 06:55 PM by 134.158.71.159 -
Changed lines 11-13 from:

The SONGS project will be organized in eight work packages: one for each application domain and one for each pillar of the simulation methodology.

to:

The SONGS project will be organized in eight work packages: one for each application domain and one for each pillar of the simulation methodology.

December 19, 2011, at 06:54 PM by 134.158.71.159 -
Changed lines 3-5 from:

The goal of the SONGS project is to extend the applicability of the SimGrid simulation framework from Grids and Peer-to-Peer systems to Clouds and High Performance Computation systems. Each of these types of large-scale computing system will be addressed through a set of use cases and lead by researchers recognized as experts in this area.

to:

The goal of the SONGS project is to extend the applicability of the SimGrid simulation framework from Grids and Peer-to-Peer systems to Clouds and High Performance Computation systems. Each type of large-scale computing system will be addressed through a set of use cases and lead by researchers recognized as experts in this area.

December 19, 2011, at 04:19 PM by 134.158.71.159 -
Changed lines 45-47 from:

SONGS is funded for four years (2012-2015) by the The French National Research Agency (ANR) under contract no. ANR-11-INFRA-XXX.

to:

SONGS is funded for four years (2012-2015) by the The French National Research Agency (ANR) under contract no. ANR-11-INFRA-XXX.

December 19, 2011, at 04:17 PM by 134.158.71.159 -
Changed line 12 from:

The SONGS project will be thus be organized in eight work packages: one for each application domain and one for each pillar of the

to:

The SONGS project will be organized in eight work packages: one for each application domain and one for each pillar of the

Changed lines 35-36 from:

Partners

to:
December 19, 2011, at 04:02 PM by 134.158.71.159 -
Changed line 16 from:
to:
  • WP1 [Data]Grid
Changed line 18 from:
  • WP2? Peer-to-Peer and Volunteer Computing
to:
  • WP2 Peer-to-Peer and Volunteer Computing
Changed line 20 from:
to:
Changed line 22 from:
  • WP4? High Performance Computing
to:
  • WP4 High Performance Computing
Changed line 26 from:
  • WP5? Efficient Simulation Kernel
to:
  • WP5 Efficient Simulation Kernel
Changed line 28 from:
  • WP6? Concepts and Models
to:
  • WP6 Concepts and Models
Changed line 30 from:
  • WP7? Analysis and Visualization
to:
  • WP7 Analysis and Visualization
Changed line 32 from:
  • WP8? Support to Simulation Methodology
to:
  • WP8 Support to Simulation Methodology
Changed lines 37-44 from:
to:
December 19, 2011, at 03:59 PM by 134.158.71.159 -
Changed line 16 from:
to:
December 19, 2011, at 03:58 PM by 134.158.71.159 -
Deleted lines 7-8:
Changed lines 10-11 from:

Roadmap

to:

Roadmap

Changed line 15 from:

Application Domains

to:

Application Domains

Changed line 25 from:

Simulation Pillars

to:

Simulation Pillars

Changed lines 35-49 from:
to:

Partners

SONGS is funded for four years (2012-2015) by the The French National Research Agency (ANR) under contract no. ANR-11-INFRA-XXX.

December 19, 2011, at 03:55 PM by 134.158.71.159 -
Changed lines 12-13 from:

Roadmap

to:

Roadmap

Changed line 17 from:

Application Domains

to:

Application Domains

Changed line 27 from:

h3 simulation Pillars

to:

Simulation Pillars

December 19, 2011, at 03:53 PM by 134.158.71.159 -
Changed line 27 from:

simulation Pillars

to:

h3 simulation Pillars

December 19, 2011, at 03:53 PM by 134.158.71.159 -
Changed lines 12-14 from:

h2. Roadmap

to:

Roadmap

Changed line 17 from:

h3.Application Domains

to:

Application Domains

December 19, 2011, at 03:51 PM by 134.158.71.159 -
Changed lines 13-14 from:

Roadmap

to:

h2. Roadmap

Changed line 18 from:

Application Domains

to:

h3.Application Domains

December 19, 2011, at 03:50 PM by 134.158.71.159 -
Changed lines 8-10 from:

The SONGS project will be thus be organized in eight work packages: one for each application domain and one for each pillar of the simulation methodology.

to:
Deleted line 12:
Changed lines 15-21 from:

The planned work spans in several axis, splited in work packages:

  • Improving the models used in SimGrid: increasing their scalability (WP1?) and easing their instanciation (WP2?) ;
  • Providing associated tools for experimenters, such as result analysis assistants (WP3?) and test campaign managers (WP4?) ;
  • Increasing the simulator scalability by parallelization (WP5?) and optimization.

We aim at producing a scientific instrument directly usable by a large community. We work in close loop with end-users to ensure that the tool is well adapted to their need (WP6?).

to:

The SONGS project will be thus be organized in eight work packages: one for each application domain and one for each pillar of the simulation methodology.

Application Domains

  • WP1? \[Data\]Grid
    • Distributed Data mgnt for LHC and Hierarchical Storage System
  • WP2? Peer-to-Peer and Volunteer Computing
    • Replica Placement in VOD, Affinities in VC
  • WP3? Clouds
    • Study from client or provider POV, other metrics (energy)
  • WP4? High Performance Computing
    • Exascale, memory and energy models

simulation Pillars

  • WP5? Efficient Simulation Kernel
    • Optimization and standardization
  • WP6? Concepts and Models
    • Storage, memory, energy, HPN and volatility
  • WP7? Analysis and Visualization
    • Scalable visualization and trace comparison
  • WP8? Support to Simulation Methodology
    • DoE, campaign management, and Open Science
Added lines 40-42:
December 19, 2011, at 03:38 PM by 134.158.71.159 -
Changed lines 11-13 from:
to:
December 19, 2011, at 03:33 PM by 134.158.71.159 -
Changed lines 1-2 from:

The SONGS project is a platform project funded by the ANR and the follow-up of the USS SimGrid.

to:

The last decade has brought tremendous changes to the characteristics of large scale distributed computing platforms. Large grids processing terabytes of information a day and the peer-to-peer technology have become common even though understanding how to efficiently such platforms still raises many challenges. As demonstrated by the USS SimGrid project funded by the ANR in 2008, simulation has proved to be a very effective approach for studying such platforms. Although even more challenging, we think the issues raised by petaflop/exaflop computers and emerging cloud infrastructures can be addressed using similar simulation methodology.

The goal of the SONGS project is to extend the applicability of the SimGrid simulation framework from Grids and Peer-to-Peer systems to Clouds and High Performance Computation systems. Each of these types of large-scale computing system will be addressed through a set of use cases and lead by researchers recognized as experts in this area.

Any sound study of such systems through simulations relies on the following pillars of simulation methodology: Efficient simulation kernel; Sound and validated models; Simulation analysis tools; Campaign simulation management.

The SONGS project will be thus be organized in eight work packages: one for each application domain and one for each pillar of the simulation methodology.

Attach:gimmick.pdf

December 19, 2011, at 02:44 PM by 134.158.71.159 -
Changed line 3 from:
(if false)
to:
December 19, 2011, at 02:44 PM by 134.158.71.159 -
Changed lines 1-2 from:

The USS-SimGrid project aims at Ultra Scalable Simulations with SimGrid. This tool is leader in the simulation of HPC settings, and the main goal of this project is to allow its use in the simulation of desktop grids and peer-to-peer settings.

to:

The SONGS project is a platform project funded by the ANR and the follow-up of the USS SimGrid.

(if false)
March 27, 2011, at 11:10 PM by 88.167.96.167 -
Deleted line 14:
Changed lines 21-22 from:
to:
March 27, 2011, at 11:02 PM by 88.167.96.167 -
Changed line 15 from:
to:
July 18, 2009, at 04:44 PM by mquinson -
Changed lines 12-13 from:

Partner teams

to:

Partners

July 18, 2009, at 04:04 PM by 90.37.194.221 -
Changed lines 14-18 from:
to:
Changed line 20 from:
to:
July 18, 2009, at 03:46 PM by mquinson - Fix links to partners
Changed lines 14-22 from:
to:
July 18, 2009, at 03:45 PM by mquinson -
Added lines 3-4:

Roadmap

Changed lines 12-23 from:

USS-SimGrid is funded for three years (2009-2011) by the French National Research Agency (ANR) under contract no. ANR-08-SEGI-022.

to:

Partner teams

USS-SimGrid is funded for three years (2009-2011) by the The French National Research Agency (ANR) under contract no. ANR-08-SEGI-022.

July 18, 2009, at 03:39 PM by mquinson -
Changed lines 1-2 from:

The USS-SimGrid project aims at Ultra Scalable Simulations with SimGrid. This tool is one of the leader project in the simulation of HPC settings, and the main goal of this project is to allow its use in the simulation of desktop grids and peer-to-peer settings.

to:

The USS-SimGrid project aims at Ultra Scalable Simulations with SimGrid. This tool is leader in the simulation of HPC settings, and the main goal of this project is to allow its use in the simulation of desktop grids and peer-to-peer settings.

July 18, 2009, at 03:38 PM by mquinson - fix the fix of links
Changed line 5 from:
  • Providing associated tools for experimenters, such as result analysis assistants (WP3?) and test campaign managers ([Main/Work Packages#WP4 |WP4]]) ;
to:
  • Providing associated tools for experimenters, such as result analysis assistants (WP3?) and test campaign managers (WP4?) ;
July 18, 2009, at 03:37 PM by mquinson - fix links to work packages
Changed lines 4-9 from:
  • Improving the models used in SimGrid: increasing their scalability (WP1?) and easing their instanciation (WP2?) ;
  • Providing associated tools for experimenters, such as result analysis assistants (WP3?) and test campaign managers (WP4?) ;
  • Increasing the simulator scalability by parallelization (WP5?) and optimization.

We aim at producing a scientific instrument directly usable by a large community. We work in close loop with end-users to ensure that the tool is well adapted to their need (WP6?).

to:
  • Improving the models used in SimGrid: increasing their scalability (WP1?) and easing their instanciation (WP2?) ;
  • Providing associated tools for experimenters, such as result analysis assistants (WP3?) and test campaign managers ([Main/Work Packages#WP4 |WP4]]) ;
  • Increasing the simulator scalability by parallelization (WP5?) and optimization.

We aim at producing a scientific instrument directly usable by a large community. We work in close loop with end-users to ensure that the tool is well adapted to their need (WP6?).

July 18, 2009, at 03:35 PM by mquinson -
Changed line 4 from:
  • Improving the models used in SimGrid: increasing their scalability (WP1?) and easing their instanciation (WP2?) ;
to:
  • Improving the models used in SimGrid: increasing their scalability (WP1?) and easing their instanciation (WP2?) ;
July 18, 2009, at 02:53 PM by mquinson - Rewrite the main page
Changed lines 1-26 from:

Computer Science differs from other experimental sciences, such as biology of physics, in the way experimental results are presented in articles. In those other disciplines articles always begin with a detailed presentation of the methods employed to produce the results that often rely on previously described and acknowledged procedures. In computer science, and more particularly in the field of application simulation, only a short description of a (sometime unavailable) ad-hoc simulation framework is provided. This prevents reproducibility of published results and thus objective comparisons between new research results and the state of the art. To reduce this gap between computer science and other experimental sciences, there is need for powerful, validated, available and well advertised tools and methods. The general goal of this project is to provide such an application simulation framework that meets the needs of both the High Performance Computing and the Large Scale Distributed Computing communities. SimGrid is recognized inthe HPC community as one of the most prominent simulation environments as shown by its large community of users and the number of publications that use it. This project will allow to extend SimGrid to target the Large Scale Distributed Computing community, increase simulation realism, and provide useful tools for test campaign management.

Specific aims

The project tackles three main axes. The first axis aims at improving the models used in SimGrid. This axis consists of two main directions. The first direction aims at adding new models to the framework to increase its application area (WP1?). In particular, we aim at providing a simulation framework that provides several models, allowing the users to run simulations at various scales, using several models with different levels of accuracy. The second direction aims at establishing tools and methodologies to automatically instantiate the models in order to allow the users to run their simulation on realistic settings (WP2?). The second axis, which aims at improving the tools for the experimenters, also consists of two directions. The first direction aims at helping the experimenter gain insight on the simulation experimental results (WP3?). This will be done by instrumenting SimGrid and by developping sophisticated aggregation functions so that relevant information can then be displayed with generic visualization tools. Ultimately, platform-level information should be related to application-level information so as to explain performance anomalies. The second direction will provide tools to run and manage large campaigns of tests (WP4?). The third axis aims at increasing simulation scale by parallelizing the simulator (WP5?). Last, even though SimGrid was initially designed for studying scheduling algorithms on heterogeneous computing platforms, such as grids, it can be used in many other settings as well. In particular, we believe that it could be a very useful tool for researchers in the high performance computing community as it is possible to plug in precise models that could be specific to the hardware in use (e.g., Myrinet or Quadrics networks). SimGrid would enable them to have rough estimations of the kind of performance they could expect from a given architecture before buying or designing it. We also believe that SimGrid could be interesting for researchers from the distributed algorithm community. Indeed, the models underlying their simulators are generally very basic. Experimenting with more precise models could be very interesting for them. In particularly, phenomenons that are generally ignored could be taken into account (e.g., network contention or locality). Helping users from various communities to experiment with SimGrid and receiving feedback from them so as to improve the tool usability will be in the heart of all our work.

Originality and Novelty

This project is highly original since, to our best knowledge, this is the first attempt to design and build a framework for the simulation of applications targeting at the same time the parallel and HPC computing community as well as the very large scale distributed computation community. Another specificity of this project is the methodological effort to validate the simulation results, and to come up with standardized tools easing result reproducibility of scientific productions. This is why we plan to work at the same time on validated models and tools allowing the monitoring of existing platforms. It should allow the establishment of platform and workload archives which could be used as classical benchmarks by scientists. Our work on experimenter tools aims at easing the adoption of the framework by the community.

Targeted Result

By contrast with most application simulation frameworks, we do not aim at producing a tool usable mainly by its developer community. Instead, we aim at producing a scientific instrument directly usable by a large community of academic end-users. SimGrid is almost 10 years old, and this proposed project should pave the way for the next ten years by increasing the targeted audience as well as opening the developer community to new members.

Scientific and Technological Bottlenecks

The realization of such a scientific instrument clearly induces technological difficulties. First, since we target end-users, the tool stability and validity has to be carefully studied. Then, since we aim at simulation scale not achieved by any other software, the tool performance and scalability should be highly optimized. Moreover, the project is not only a scientific instrument, but also a scientific object on its own. Several work packages address well known scientific challenges, such as analytical models of the network in WP1, automatic topology mapping in WP2, inducing the cause of monitored effects in WP3, or efficient distribution of parameter sweep applications in WP4. Moreover, some of the technical challenges faced are so novel that they become scientific challenges. For example, the extreme parallelization of the simulator envisioned in WP5 will certainly require a scientific approach.

to:

The USS-SimGrid project aims at Ultra Scalable Simulations with SimGrid. This tool is one of the leader project in the simulation of HPC settings, and the main goal of this project is to allow its use in the simulation of desktop grids and peer-to-peer settings.

The planned work spans in several axis, splited in work packages:

  • Improving the models used in SimGrid: increasing their scalability (WP1?) and easing their instanciation (WP2?) ;
  • Providing associated tools for experimenters, such as result analysis assistants (WP3?) and test campaign managers (WP4?) ;
  • Increasing the simulator scalability by parallelization (WP5?) and optimization.

We aim at producing a scientific instrument directly usable by a large community. We work in close loop with end-users to ensure that the tool is well adapted to their need (WP6?).

USS-SimGrid is funded for three years (2009-2011) by the French National Research Agency (ANR) under contract no. ANR-08-SEGI-022.

January 06, 2009, at 09:39 AM by 134.158.71.65 -
Changed lines 9-11 from:

The project tackles three main axes. The first axis aims at improving the models used in SimGrid. This axis consists of two main directions. The first direction aims at adding new models to the framework to increase its application area (WP1). In particular, we aim at providing a simulation framework that provides several models, allowing the users to run simulations at various scales, using several models with different levels of accuracy. The second direction aims at establishing tools and methodologies to automatically instantiate the models in order to allow the users to run their simulation on realistic settings (WP2). The second axis, which aims at improving the tools for the experimenters, also consists of two directions. The first direction aims at helping the experimenter gain insight on the simulation experimental results (WP3). This will be done by instrumenting SimGrid and by developping sophisticated aggregation functions so that relevant information can then be displayed with generic visualization tools. Ultimately, platform-level information should be related to application-level information so as to explain performance anomalies. The second direction will provide tools to run and manage large campaigns of tests (WP4). The third axis aims at increasing simulation scale by parallelizing the simulator (WP5). Last, even though SimGrid was initially designed for studying scheduling algorithms on heterogeneous computing platforms, such as grids, it can be used in many other settings as well. In particular, we believe that it could be a very useful tool for researchers in the high performance computing community as it is possible to plug in precise models that could be specific to the hardware in use (e.g., Myrinet or Quadrics networks). SimGrid would enable them to have rough estimations of the kind of performance they could expect from a given architecture before buying or designing it. We also believe that SimGrid could be interesting for researchers from the distributed algorithm community. Indeed, the models underlying their simulators are generally very basic. Experimenting with more precise models could be very interesting for them. In particularly, phenomenons that are generally ignored could be taken into account (e.g., network contention or locality). Helping users from various communities to experiment with SimGrid

to:

The project tackles three main axes. The first axis aims at improving the models used in SimGrid. This axis consists of two main directions. The first direction aims at adding new models to the framework to increase its application area (WP1?). In particular, we aim at providing a simulation framework that provides several models, allowing the users to run simulations at various scales, using several models with different levels of accuracy. The second direction aims at establishing tools and methodologies to automatically instantiate the models in order to allow the users to run their simulation on realistic settings (WP2?). The second axis, which aims at improving the tools for the experimenters, also consists of two directions. The first direction aims at helping the experimenter gain insight on the simulation experimental results (WP3?). This will be done by instrumenting SimGrid and by developping sophisticated aggregation functions so that relevant information can then be displayed with generic visualization tools. Ultimately, platform-level information should be related to application-level information so as to explain performance anomalies. The second direction will provide tools to run and manage large campaigns of tests (WP4?). The third axis aims at increasing simulation scale by parallelizing the simulator (WP5?). Last, even though SimGrid was initially designed for studying scheduling algorithms on heterogeneous computing platforms, such as grids, it can be used in many other settings as well. In particular, we believe that it could be a very useful tool for researchers in the high performance computing community as it is possible to plug in precise models that could be specific to the hardware in use (e.g., Myrinet or Quadrics networks). SimGrid would enable them to have rough estimations of the kind of performance they could expect from a given architecture before buying or designing it. We also believe that SimGrid could be interesting for researchers from the distributed algorithm community. Indeed, the models underlying their simulators are generally very basic. Experimenting with more precise models could be very interesting for them. In particularly, phenomenons that are generally ignored could be taken into account (e.g., network contention or locality). Helping users from various communities to experiment with SimGrid

January 06, 2009, at 09:36 AM by 134.158.71.65 -
Changed lines 1-3 from:

Welcome to the USS SimGrid project.

More to come soon.

to:

Computer Science differs from other experimental sciences, such as biology of physics, in the way experimental results are presented in articles. In those other disciplines articles always begin with a detailed presentation of the methods employed to produce the results that often rely on previously described and acknowledged procedures. In computer science, and more particularly in the field of application simulation, only a short description of a (sometime unavailable) ad-hoc simulation framework is provided. This prevents reproducibility of published results and thus objective comparisons between new research results and the state of the art. To reduce this gap between computer science and other experimental sciences, there is need for powerful, validated, available and well advertised tools and methods. The general goal of this project is to provide such an application simulation framework that meets the needs of both the High Performance Computing and the Large Scale Distributed Computing communities. SimGrid is recognized inthe HPC community as one of the most prominent simulation environments as shown by its large community of users and the number of publications that use it. This project will allow to extend SimGrid to target the Large Scale Distributed Computing community, increase simulation realism, and provide useful tools for test campaign management.

Specific aims

The project tackles three main axes. The first axis aims at improving the models used in SimGrid. This axis consists of two main directions. The first direction aims at adding new models to the framework to increase its application area (WP1). In particular, we aim at providing a simulation framework that provides several models, allowing the users to run simulations at various scales, using several models with different levels of accuracy. The second direction aims at establishing tools and methodologies to automatically instantiate the models in order to allow the users to run their simulation on realistic settings (WP2). The second axis, which aims at improving the tools for the experimenters, also consists of two directions. The first direction aims at helping the experimenter gain insight on the simulation experimental results (WP3). This will be done by instrumenting SimGrid and by developping sophisticated aggregation functions so that relevant information can then be displayed with generic visualization tools. Ultimately, platform-level information should be related to application-level information so as to explain performance anomalies. The second direction will provide tools to run and manage large campaigns of tests (WP4). The third axis aims at increasing simulation scale by parallelizing the simulator (WP5). Last, even though SimGrid was initially designed for studying scheduling algorithms on heterogeneous computing platforms, such as grids, it can be used in many other settings as well. In particular, we believe that it could be a very useful tool for researchers in the high performance computing community as it is possible to plug in precise models that could be specific to the hardware in use (e.g., Myrinet or Quadrics networks). SimGrid would enable them to have rough estimations of the kind of performance they could expect from a given architecture before buying or designing it. We also believe that SimGrid could be interesting for researchers from the distributed algorithm community. Indeed, the models underlying their simulators are generally very basic. Experimenting with more precise models could be very interesting for them. In particularly, phenomenons that are generally ignored could be taken into account (e.g., network contention or locality). Helping users from various communities to experiment with SimGrid and receiving feedback from them so as to improve the tool usability will be in the heart of all our work.

Originality and Novelty

This project is highly original since, to our best knowledge, this is the first attempt to design and build a framework for the simulation of applications targeting at the same time the parallel and HPC computing community as well as the very large scale distributed computation community. Another specificity of this project is the methodological effort to validate the simulation results, and to come up with standardized tools easing result reproducibility of scientific productions. This is why we plan to work at the same time on validated models and tools allowing the monitoring of existing platforms. It should allow the establishment of platform and workload archives which could be used as classical benchmarks by scientists. Our work on experimenter tools aims at easing the adoption of the framework by the community.

Targeted Result

By contrast with most application simulation frameworks, we do not aim at producing a tool usable mainly by its developer community. Instead, we aim at producing a scientific instrument directly usable by a large community of academic end-users. SimGrid is almost 10 years old, and this proposed project should pave the way for the next ten years by increasing the targeted audience as well as opening the developer community to new members.

Scientific and Technological Bottlenecks

The realization of such a scientific instrument clearly induces technological difficulties. First, since we target end-users, the tool stability and validity has to be carefully studied. Then, since we aim at simulation scale not achieved by any other software, the tool performance and scalability should be highly optimized. Moreover, the project is not only a scientific instrument, but also a scientific object on its own. Several work packages address well known scientific challenges, such as analytical models of the network in WP1, automatic topology mapping in WP2, inducing the cause of monitored effects in WP3, or efficient distribution of parameter sweep applications in WP4. Moreover, some of the technical challenges faced are so novel that they become scientific challenges. For example, the extreme parallelization of the simulator envisioned in WP5 will certainly require a scientific approach.

January 05, 2009, at 03:05 PM by mquinson - Test edit rights.
Added lines 2-3:

More to come soon.

January 05, 2009, at 11:18 AM by 134.158.71.65 -
Changed line 1 from:

Welcome to the USS Simgrid project.

to:

Welcome to the USS SimGrid project.

January 05, 2009, at 10:42 AM by 134.158.71.65 -
Changed lines 1-12 from:

Welcome to PmWiki!

A local copy of PmWiki's documentation has been installed along with the software, and is available via the documentation index.

To continue setting up PmWiki, see initial setup tasks.

The basic editing page describes how to create pages in PmWiki. You can practice editing in the wiki sandbox.

More information about PmWiki is available from http://www.pmwiki.org .

to:

Welcome to the USS Simgrid project.

Options: