Difference between revisions of "NSF Frameworks"

From Nsnam
Jump to: navigation, search
(add info about prototype goals)
 
(6 intermediate revisions by the same user not shown)
Line 1: Line 1:
 
{{TOC}}
 
{{TOC}}
  
The U.S. National Science Foundation (NSF) is funding the University of Washington (Tom Henderson), Georgia Institute of Technology (George Riley), and Bucknell University (Felipe Perrone) to develop extensions to ns-3 to support the creation of more rigorous simulation studies and to support the ongoing maintenance of the ns-3 project.  The project is scheduled to run between 2010 and 2014.  Below are listed some near- and long-term plans in each area.
+
The U.S. National Science Foundation (NSF) has funded the University of Washington (Tom Henderson), Georgia Institute of Technology (George Riley), and [http://www.nsf.gov/awardsearch/showAward?AWD_ID=0958142 Bucknell University (Felipe Perrone)] to develop extensions to ns-3 to support the creation of more rigorous simulation studies and to support the ongoing maintenance of the ns-3 project.  The project ran from 2010 to 2015.  Below are the project outcomes.
  
= Overview =
+
== Overview ==
== Automation framework ==
+
  
This work is led by [http://www.eg.bucknell.edu/~perrone/Welcome.html Felipe Perrone].
+
The project performed work on three topics:  1) Automation framework, 2) Scenario Development, and 3) Maintenance.
 +
 
 +
=== Automation framework ===
 +
 
 +
This topic was led by [http://www.eg.bucknell.edu/~perrone/Welcome.html Felipe Perrone].
  
 
'''Project goal:'''  The automation framework will consist of user interfaces, description languages, and tools that will help
 
'''Project goal:'''  The automation framework will consist of user interfaces, description languages, and tools that will help
Line 12: Line 15:
 
offered will enable the user to define, deploy, and control ns-3 simulation experiments that are methodologically valid and easy to reproduce by third parties.  The framework will include tools for: model composition; structural validation of the model; configuration of model components; description, deployment, and control of experiments; output data processing and storage; and reporting of experimental setup. Although the framework will offer graphical user interfaces, more experienced users will be able to access automation functionality via the command-line.
 
offered will enable the user to define, deploy, and control ns-3 simulation experiments that are methodologically valid and easy to reproduce by third parties.  The framework will include tools for: model composition; structural validation of the model; configuration of model components; description, deployment, and control of experiments; output data processing and storage; and reporting of experimental setup. Although the framework will offer graphical user interfaces, more experienced users will be able to access automation functionality via the command-line.
  
Overall development roadmap is listed [http://redmine.eg.bucknell.edu/perrone/projects/framework/wiki here].
+
Additional information is located [http://redmine.eg.bucknell.edu/safe at a Bucknell Redmine site] and [http://redmine.eg.bucknell.edu/perrone/projects/framework/repository Bucknell code repository].  Code intended for transition to ns-3 is available in the [http://code.nsnam.org/safe/ns-3-safe SAFE repository] or other repositories under the username 'safe' at the ns-3 code server.
  
== Scenario generation ==
+
The topic had four subtasks; below are links to the output of each subtask.
  
This work is led by [http://www.ece.gatech.edu/faculty-staff/fac_profiles/bio.php?id=86 George Riley]
+
==== User interfaces ====
  
'''Project goal:'''  Random topology generation based on empirical observations of the Internet (e.g. BRITE), recreated topologies based on empirical data (e.g. Routeviews, Rocketfuel), and synthetic topology generation based on graph structures.
+
==== Experiment management ====
  
'''Near term plans:''' [http://www.cs.bu.edu/brite/ BRITE] integration with ns-3 scheduled for fall of 2010.
+
==== Simulation control ====
 +
 
 +
==== Output processing ====
 +
 
 +
==== Verifying completeness and consistency of models ====
 +
 
 +
==== Generation of simulator specific scripts ====
 +
 
 +
=== Scenario generation ===
 +
 
 +
This topic was led by [http://www.ece.gatech.edu/faculty-staff/fac_profiles/bio.php?id=86 George Riley]
 +
 
 +
'''Project goal:'''  Random topology generation based on empirical observations of the Internet (e.g. BRITE), recreated topologies based on empirical data (e.g. Routeviews, Rocketfuel), and synthetic topology generation based on graph structures.
  
== Educational framework ==
+
The topic had four subtasks; below are links to the outcomes of each subtask.
  
'''Project goal:'''  Develop an on-line library of educational programs and laboratory experiments, and the supporting web-based framework to solicit additional contributions from the educational community.
+
==== Artificially Created Topologies ====
  
'''Near term plans:''' George Riley and Josh Pelkey used ns-3 as courseware in a fall 2010 semester course at Georgia Tech.  Materials from this course will form our initial contributions to the educational program repository.
+
==== Random Topology Generation ====
  
Lalith Suresh's [[NS3_Lab_Assignments]] page.
+
==== Empirical Topology Generation ====
  
= Prototype =
+
==== Mobility Scenarios ====
  
The project is working on a prototype that will integrate initial pieces of the automation framework, including the following:
+
=== Maintenance ===
# a data collection framework to extract the data of interest, perhaps requiring some additions to how this data is accessed from the routing protocol implementations
+
# support to easily plot the data points using confidence intervals using a plotting program such as gnuplot or matplotlib
+
# ability to archive the complete state of the experiment so that it can be reproduced many years later
+
# a steady-state detector to look for reaching the time to start data collection (and data deletion prior to that time)
+
# a termination detector to terminate the program once the desired number of samples
+
# an experiment execution manager (outside of ns-3) to manage the serial or parallel execution of simulation runs to obtain data points for each configuration
+
# a basic wireless/mobility artificial scenario generator allowing the user to rerun the experiment with different numbers of nodes, node densities, and rate of link connectivity changes
+
  
A stretch goal is to allow users to plot characteristics of the scenario according to a "god-like" view of the topology, using certain assumptions, such as:
+
This topic was led by [http://www.ee.washington.edu/faculty/affiliate_henderson.html Tom Henderson].  Tom Henderson, John Abraham, Brian Swenson, and Daniel Lertpratchya collaborated to make ns-3 releases and maintain the ns-3 project infrastructure.
# true shortest paths available to each application packet originated over all scenarios
+
# counts on the number of link connectivity changes
+
  
Some elements of the above support are expected to be merged with ns-3, and some will live in an outside framework that can be downloaded as an extension via download.py or equivalent.
+
== Publications ==
  
A concrete example to work is based on the program examples/wireless/manet-routing-compare.cc, which is based on the scenario described in the 1998 Mobicom paper by Broch et al. "A Performance Comparison of Multi-Hop Wireless Ad Hoc Network Routing Protocols".  In particular, we would like the prototype to be able to generate plots such as figures 2 and 3 of that paper, and (for stretch goals) figure 1 and table V.
+
The following publications were partially funded by this project:
  
Code will be maintained at:
+
* Data Visualization for Network Simulations, Christopher S. Main, L. Felipe Perrone, and Greg L. Schrock, Winter Simulation Conference 2014. Savannah, GA.
* [http://code.nsnam.org/safe/ns-3-safe ns-3 safe repository]
+
* [http://redmine.eg.bucknell.edu/perrone/projects/framework/repository Bucknell SAFE repository]
+

Latest revision as of 00:17, 28 February 2015

Main Page - Current Development - Developer FAQ - Tools - Related Projects - Project Ideas - Summer Projects

Installation - Troubleshooting - User FAQ - HOWTOs - Samples - Models - Education - Contributed Code - Papers

The U.S. National Science Foundation (NSF) has funded the University of Washington (Tom Henderson), Georgia Institute of Technology (George Riley), and Bucknell University (Felipe Perrone) to develop extensions to ns-3 to support the creation of more rigorous simulation studies and to support the ongoing maintenance of the ns-3 project. The project ran from 2010 to 2015. Below are the project outcomes.

Overview

The project performed work on three topics: 1) Automation framework, 2) Scenario Development, and 3) Maintenance.

Automation framework

This topic was led by Felipe Perrone.

Project goal: The automation framework will consist of user interfaces, description languages, and tools that will help users of varying levels of expertise to produce more credible simulation experiments with ns-3. The functionality offered will enable the user to define, deploy, and control ns-3 simulation experiments that are methodologically valid and easy to reproduce by third parties. The framework will include tools for: model composition; structural validation of the model; configuration of model components; description, deployment, and control of experiments; output data processing and storage; and reporting of experimental setup. Although the framework will offer graphical user interfaces, more experienced users will be able to access automation functionality via the command-line.

Additional information is located at a Bucknell Redmine site and Bucknell code repository. Code intended for transition to ns-3 is available in the SAFE repository or other repositories under the username 'safe' at the ns-3 code server.

The topic had four subtasks; below are links to the output of each subtask.

User interfaces

Experiment management

Simulation control

Output processing

Verifying completeness and consistency of models

Generation of simulator specific scripts

Scenario generation

This topic was led by George Riley

Project goal: Random topology generation based on empirical observations of the Internet (e.g. BRITE), recreated topologies based on empirical data (e.g. Routeviews, Rocketfuel), and synthetic topology generation based on graph structures.

The topic had four subtasks; below are links to the outcomes of each subtask.

Artificially Created Topologies

Random Topology Generation

Empirical Topology Generation

Mobility Scenarios

Maintenance

This topic was led by Tom Henderson. Tom Henderson, John Abraham, Brian Swenson, and Daniel Lertpratchya collaborated to make ns-3 releases and maintain the ns-3 project infrastructure.

Publications

The following publications were partially funded by this project:

  • Data Visualization for Network Simulations, Christopher S. Main, L. Felipe Perrone, and Greg L. Schrock, Winter Simulation Conference 2014. Savannah, GA.