Re: Work with OpenDaylight for SC15 event?

Y. Richard Yang

Azher, all,

Thanks a lot for the nice demo and the discussions. It is very helpful!

The ALTO team had some more internal discussions, based on our discussions
last night. Here is an outline:

- Endhost: Each endhost will have a data directory, which hosts the files that it
  has, for example, file1, file2, file3, ...
- File tracker: There is a file tracker which keeps track of the files that each
  endhost has as a map: <endhost> -> <list of files>
- Scheduler: There is a scheduler which accepts transfer tasks and schedules
  the transfers
- ODL SDN controller

- Endhost: There is an agent running on each endhost to monitor the existing
  files and update the file tracker on the file index; The endhost tracker will also
  ping each other to get latency and report the results to the ALTO server in
  the SDN controller; The agent (or a remote command) can start a file transfer.

- File tracker: accepts 
  queries on files available at each endhost, and 
  posts to update the file index

- Scheduler: Schedule the transfers, where each transfer has the following
  attributes: client-endpoint, file-name, priority, deadline. In particular, the frontend
  (or API) has a form to allow others to submit transfer requests; The backend will
  query the network status and compute the scheduling of transfers.

Details of the scheduling backend to schedule a set of transfers. Assume that all
the transfers are given in a batch (T1, T2, ... TK) for the demo.
- Query File tracker to obtain the replicas of the each data in the batch
- Query ALTO to obtain the routing path for each T1(file).replica: path(T1(client),
- Query ALTO to obtain the path properties such as latency of the routing paths
- Conduct scheduling (i.e., replica selection and maximum flow based for deadline
and priority), based on estimating TCP throughput (based on TCP throughput
formula; the throughput of each flow is inverse proportional to its latency)
- Issue transfer commands to the endhosts. 

It looks like that some of your packages (e.g., MoniLisa) can be used for the
preceding. We are looking into.

On Tue, Nov 3, 2015 at 5:20 PM, Azher Mughal <azher@...> wrote:
Hi Richard,

Likewise. My id is "azheramin". I just added your skype id. Below is what we discussed and we will try to discuss more during the call. However Iosif is in a different timezone.

1. Based on the current north bound application we can try to access the copies of data using either the shortest, with most bandwidth or a combination of both.
2. During the call we will show the current visualization.
3. Richard's team can help in developing additional components to achieve the above (though time is short).

Please let us know who would else like to join this call today. We can go over it again tomorrow as well.


On 11/3/2015 1:39 PM, Y. Richard Yang wrote:
Hi Azher,

It was great talking to you on the phone. Let's use Skype to see your demo at 5:15 pm PT (8:15 pm ET).

My Skype ID is: yang.richard.yang

Please let me know your ID so that I can add you.


On Mon, Nov 2, 2015 at 4:27 PM, Y. Richard Yang <yry@...> wrote:
Hi Azher,

Ack. I will read up this evening and tomorrow morning and then talk to you soon on how to move forward.


On Mon, Nov 2, 2015 at 4:00 PM, Azher Mughal <azher@...> wrote:
I am still updating the website, so please don't trust the website much till the end of day :) 

This message has been scanned for viruses and
dangerous content by MailScanner, and is
believed to be clean.

| Y. Richard Yang <yry@...>   |
| Professor of Computer Science       |

Join to automatically receive all group messages.