SimulationConfiguration - Revision history

Craigdo: /* The Plan (TM) */

2009-11-02T21:42:37Z

The Plan (TM)

← Older revision		Revision as of 21:42, 2 November 2009
Line 81:		Line 81:

	It would really be nice to be able to lean on open-source widely-used packages that already do similar things. There's just no way that the ns-3 project could hope to develop all of this stuff from scratch.		It would really be nice to be able to lean on open-source widely-used packages that already do similar things. There's just no way that the ns-3 project could hope to develop all of this stuff from scratch.

			Of course every developer has his or her own idea of the perfect language, and so these pieces are coded in different languages. Puppet is a Ruby app, bcfg2 uses python, Hadoop and SmartFrog are Java (and seem to be often used together). We may have to thing about some alternate language expertise ...

	It should be said, however, I really have no idea how stupid, naive or brilliant any of this is.		It should be said, however, I really have no idea how stupid, naive or brilliant any of this is.

Craigdo: /* The Plan (TM) */

2009-11-02T21:34:44Z

The Plan (TM)

← Older revision		Revision as of 21:34, 2 November 2009
Line 51:		Line 51:
	* Cfengine -- http://en.wikipedia.org/wiki/Cfengine		* Cfengine -- http://en.wikipedia.org/wiki/Cfengine
	* PCfengine -- https://info.enstb.org/projets/pcfengine/en/index.html		* PCfengine -- https://info.enstb.org/projets/pcfengine/en/index.html
	* ~~smartfrog~~ -- http://wiki.smartfrog.org/wiki/display/sf/SmartFrog+Home		* SmartFrog -- http://wiki.smartfrog.org/wiki/display/sf/SmartFrog+Home or

	There are others ...		There are others ...

Craigdo: /* The Plan (TM) */

2009-11-02T21:33:07Z

The Plan (TM)

← Older revision		Revision as of 21:33, 2 November 2009
Line 51:		Line 51:
	* Cfengine -- http://en.wikipedia.org/wiki/Cfengine		* Cfengine -- http://en.wikipedia.org/wiki/Cfengine
	* PCfengine -- https://info.enstb.org/projets/pcfengine/en/index.html		* PCfengine -- https://info.enstb.org/projets/pcfengine/en/index.html
			* smartfrog -- http://wiki.smartfrog.org/wiki/display/sf/SmartFrog+Home

	There are others ...		There are others ...

Craigdo: /* The Plan (TM) */

2009-11-02T20:40:21Z

The Plan (TM)

← Older revision		Revision as of 20:40, 2 November 2009
Line 59:		Line 59:

	Finally, I plan on playing with some of the existing general purpose distributed algorithm packages to see if they can be used to collect test results. I can picture that something like MapReduce could be used to automatically build networks of virtual machines and execute distributed simulations (Map) and then collect responses (Reduce).		Finally, I plan on playing with some of the existing general purpose distributed algorithm packages to see if they can be used to collect test results. I can picture that something like MapReduce could be used to automatically build networks of virtual machines and execute distributed simulations (Map) and then collect responses (Reduce).

	It would really be nice to be able to lean on open-source widely-used packages that already do similar things. There's just no way that the ns-3 project could hope to develop all of this stuff from scratch.


	* Hadoop -- http://hadoop.apache.org/mapreduce/ or http://hadoop.apache.org/common/docs/current/mapred_tutorial.html		* Hadoop -- http://hadoop.apache.org/mapreduce/ or http://hadoop.apache.org/common/docs/current/mapred_tutorial.html
Line 78:		Line 75:
	* Amazon Relational Database Serive -- http://aws.amazon.com/rds/		* Amazon Relational Database Serive -- http://aws.amazon.com/rds/

	Lots of organizations with similar problems seem to be using this kind of technology. It seems plausible that ns-3 could use ~~similar~~ technology to arrange simulations on large virtual machine clusters or on large testbeds. ~~Howver~~, I really have no idea how stupid, naive or brilliant any of this is ~~yet~~.		Lots of organizations with similar problems seem to be using this kind of technology.

			To paraphrase Richard Feynman: "similar problems have similar solutions". It seems plausible that ns-3 could use or extend existing technology to arrange simulations on large virtual machine clusters or on large testbeds; and collect resulting statistics.

			It would really be nice to be able to lean on open-source widely-used packages that already do similar things. There's just no way that the ns-3 project could hope to develop all of this stuff from scratch.

			It should be said, however, I really have no idea how stupid, naive or brilliant any of this is.

	----		----
	[[User:Craigdo\|Craigdo]] 18:24, 2 November 2009 (UTC)		[[User:Craigdo\|Craigdo]] 18:24, 2 November 2009 (UTC)

Craigdo: /* The Plan (TM) */

2009-11-02T20:37:36Z

The Plan (TM)

← Older revision		Revision as of 20:37, 2 November 2009
Line 59:		Line 59:

	Finally, I plan on playing with some of the existing general purpose distributed algorithm packages to see if they can be used to collect test results. I can picture that something like MapReduce could be used to automatically build networks of virtual machines and execute distributed simulations (Map) and then collect responses (Reduce).		Finally, I plan on playing with some of the existing general purpose distributed algorithm packages to see if they can be used to collect test results. I can picture that something like MapReduce could be used to automatically build networks of virtual machines and execute distributed simulations (Map) and then collect responses (Reduce).

			It would really be nice to be able to lean on open-source widely-used packages that already do similar things. There's just no way that the ns-3 project could hope to develop all of this stuff from scratch.


	* Hadoop -- http://hadoop.apache.org/mapreduce/ or http://hadoop.apache.org/common/docs/current/mapred_tutorial.html		* Hadoop -- http://hadoop.apache.org/mapreduce/ or http://hadoop.apache.org/common/docs/current/mapred_tutorial.html

Craigdo: /* Automagic Script Generation */

2009-11-02T20:36:22Z

Automagic Script Generation

← Older revision		Revision as of 20:36, 2 November 2009
Line 19:		Line 19:
	=== Automagic Script Generation ===		=== Automagic Script Generation ===

	One could conceive of automatically generating scripts from the CMDB. For example, if a particular environment needs a wireless network, it doesn't sound horribly difficult to generate some C++ code to instantiate NodeContainers, DeviceContainers, WifiNetDevices, etc., ~~frm~~ the configuration database and then create a real-time simulation that sits around waiting for something to happen (packets to arrive on devices). This code could be compiled and then distributed and run by a configuration management system (that is one of its primary jobs after all).		One could conceive of automatically generating scripts from the CMDB. For example, if a particular environment needs a wireless network, it doesn't sound horribly difficult to generate some C++ code to instantiate NodeContainers, DeviceContainers, WifiNetDevices, etc., from the configuration database and then create a real-time simulation that sits around waiting for something to happen (packets to arrive on devices). This code could be compiled and then distributed and run by a configuration management system (that is one of its primary jobs after all).

	=== ns-3 State Detection ===		=== ns-3 State Detection ===

Craigdo: /* Configuration Management Database */

2009-11-02T20:35:18Z

Configuration Management Database

← Older revision		Revision as of 20:35, 2 November 2009
Line 16:		Line 16:

	We also want to be able to allow GUI topology builders and simulation managers to exist on top of this tool. For example, it would be the best of all worlds if, in a GUI, one could create a node graphic using a mouse click and have a virutal machine created for the user that backs that graphic. Another click could create a wireless network. A few clicks could create a wifi network device on the node graphic which would, in turn create a new device on the just-created virtual machine and a bridge into the system running the ns-3 process. The association between the tap device, the bridge and the ns-3 device would be saved and could be looked up in a global configuration management database (CMDB).		We also want to be able to allow GUI topology builders and simulation managers to exist on top of this tool. For example, it would be the best of all worlds if, in a GUI, one could create a node graphic using a mouse click and have a virutal machine created for the user that backs that graphic. Another click could create a wireless network. A few clicks could create a wifi network device on the node graphic which would, in turn create a new device on the just-created virtual machine and a bridge into the system running the ns-3 process. The association between the tap device, the bridge and the ns-3 device would be saved and could be looked up in a global configuration management database (CMDB).

			=== Automagic Script Generation ===

			One could conceive of automatically generating scripts from the CMDB. For example, if a particular environment needs a wireless network, it doesn't sound horribly difficult to generate some C++ code to instantiate NodeContainers, DeviceContainers, WifiNetDevices, etc., frm the configuration database and then create a real-time simulation that sits around waiting for something to happen (packets to arrive on devices). This code could be compiled and then distributed and run by a configuration management system (that is one of its primary jobs after all).

	=== ns-3 State Detection ===		=== ns-3 State Detection ===

Craigdo: /* The Plan (TM) */

2009-11-02T20:29:31Z

The Plan (TM)

← Older revision		Revision as of 20:29, 2 November 2009
Line 58:		Line 58:
	* Hadoop -- http://hadoop.apache.org/mapreduce/ or http://hadoop.apache.org/common/docs/current/mapred_tutorial.html		* Hadoop -- http://hadoop.apache.org/mapreduce/ or http://hadoop.apache.org/common/docs/current/mapred_tutorial.html
	* MapReduce -- http://labs.google.com/papers/mapreduce-osdi04.pdf or http://en.wikipedia.org/wiki/MapReduce		* MapReduce -- http://labs.google.com/papers/mapreduce-osdi04.pdf or http://en.wikipedia.org/wiki/MapReduce
	* ~~Cloudrra~~ Hadoop -- http://www.cloudera.com/		* Cloudera Hadoop -- http://www.cloudera.com/

	Hadoop provides potentially useful things like a distributed file system.		Hadoop provides potentially useful things like a distributed file system.

	Hadoop DFS -- http://developer.yahoo.com/hadoop/tutorial/		* Hadoop DFS -- http://developer.yahoo.com/hadoop/tutorial/

	Amazon Web Services provides functions that span this whole space, from being able to define and control the instantiation of machine images to relational database services that might provide some insights.		Amazon Web Services provides functions that span this whole space, from being able to define and control the instantiation of machine images to relational database services that might provide some insights.

	I have no idea how stupid, naive or brilliant any of this is yet.		* AWS -- http://aws.amazon.com/
			* Amazon Simple Storage Service -- http://aws.amazon.com/s3/
			* Amazon Elastic MapReduce -- http://aws.amazon.com/elasticmapreduce/
			* Amazon Relational Database Serive -- http://aws.amazon.com/rds/

			Lots of organizations with similar problems seem to be using this kind of technology. It seems plausible that ns-3 could use similar technology to arrange simulations on large virtual machine clusters or on large testbeds. Howver, I really have no idea how stupid, naive or brilliant any of this is yet.

	----		----
	[[User:Craigdo\|Craigdo]] 18:24, 2 November 2009 (UTC)		[[User:Craigdo\|Craigdo]] 18:24, 2 November 2009 (UTC)

Craigdo: /* The Plan (TM) */

2009-11-02T20:24:13Z

The Plan (TM)

← Older revision		Revision as of 20:24, 2 November 2009
Line 52:		Line 52:
	The next step will be to see if any of the existing solutions can be used to do any kind of state management. It would seem reasonable to expect, since someone like Amazon or Expedia might have hundreds of servers and services to be managed, they would have some kind of automated serive management function. For example, when service X comes up on machine Y, have it join the load balancing pool and begin servicing customer requests.		The next step will be to see if any of the existing solutions can be used to do any kind of state management. It would seem reasonable to expect, since someone like Amazon or Expedia might have hundreds of servers and services to be managed, they would have some kind of automated serive management function. For example, when service X comes up on machine Y, have it join the load balancing pool and begin servicing customer requests.

			MapReduce implementations, for example, provide "named counters" that can be referred to globally.

	Finally, I plan on playing with some of the existing general purpose distributed algorithm packages to see if they can be used to collect test results. I can picture that something like MapReduce could be used to automatically build networks of virtual machines and execute distributed simulations (Map) and then collect responses (Reduce).		Finally, I plan on playing with some of the existing general purpose distributed algorithm packages to see if they can be used to collect test results. I can picture that something like MapReduce could be used to automatically build networks of virtual machines and execute distributed simulations (Map) and then collect responses (Reduce).
Line 57:		Line 58:
	* Hadoop -- http://hadoop.apache.org/mapreduce/ or http://hadoop.apache.org/common/docs/current/mapred_tutorial.html		* Hadoop -- http://hadoop.apache.org/mapreduce/ or http://hadoop.apache.org/common/docs/current/mapred_tutorial.html
	* MapReduce -- http://labs.google.com/papers/mapreduce-osdi04.pdf or http://en.wikipedia.org/wiki/MapReduce		* MapReduce -- http://labs.google.com/papers/mapreduce-osdi04.pdf or http://en.wikipedia.org/wiki/MapReduce
			* Cloudrra Hadoop -- http://www.cloudera.com/

			Hadoop provides potentially useful things like a distributed file system.

			Hadoop DFS -- http://developer.yahoo.com/hadoop/tutorial/

			Amazon Web Services provides functions that span this whole space, from being able to define and control the instantiation of machine images to relational database services that might provide some insights.

	I have no idea how stupid, naive or brilliant any of this is yet.		I have no idea how stupid, naive or brilliant any of this is yet.

Craigdo: /* The Plan (TM) */

2009-11-02T20:03:00Z

The Plan (TM)

← Older revision		Revision as of 20:03, 2 November 2009
Line 41:		Line 41:
	I am currently investigating the existing solutions. I plan on installing at least one virtualization solution and seeing how well some of the open source configuration managemenet solutions can play in that space. I will try and configure some simulations of various complexity and see if I can create tap bridges, etc., and get the pieces of a reasonably sized simulation put together automagically.		I am currently investigating the existing solutions. I plan on installing at least one virtualization solution and seeing how well some of the open source configuration managemenet solutions can play in that space. I will try and configure some simulations of various complexity and see if I can create tap bridges, etc., and get the pieces of a reasonably sized simulation put together automagically.

	The next step will be to see if any of the existing solutions can be used to do any kind of state management. It would seem reasonable to expect, since someone like Amazon or Expedia might have hundreds of servers and services to be managed, they would have some kind of automated serive management function. For example, when service X comes up on machine Y, have it join the load balancing pool and begin servicing customer requests.		See:

	* Puppet -- http://reductivelabs.com/trac/puppet/		* Puppet -- http://reductivelabs.com/trac/puppet/
Line 49:		Line 49:

	There are others ...		There are others ...

			The next step will be to see if any of the existing solutions can be used to do any kind of state management. It would seem reasonable to expect, since someone like Amazon or Expedia might have hundreds of servers and services to be managed, they would have some kind of automated serive management function. For example, when service X comes up on machine Y, have it join the load balancing pool and begin servicing customer requests.


	Finally, I plan on playing with some of the existing general purpose distributed algorithm packages to see if they can be used to collect test results. I can picture that something like MapReduce could be used to automatically build networks of virtual machines and execute distributed simulations (Map) and then collect responses (Reduce).		Finally, I plan on playing with some of the existing general purpose distributed algorithm packages to see if they can be used to collect test results. I can picture that something like MapReduce could be used to automatically build networks of virtual machines and execute distributed simulations (Map) and then collect responses (Reduce).