San Fermin: Aggregating Large Data Sets using Dynamic Binomial Trees

Add to your list(s) Download to your calendar using vCal

• Justin Cappos, University of Arizona
• Thursday 21 June 2007, 16:30-17:30
• Lecture Theatre 2, Computer Laboratory, William Gates Builiding.

If you have a question about this talk, please contact Wenjun Hu.

Content aggregation is an important sub-problem in distributed monitoring, distributed database queries, and software debugging. In this problem there are a large number of systems that have information and the requester is not interested in the result from each individual machine, but rather the aggregated results from all machines. Current solutions to this problem have looked at the case where the aggregate data is small (typically only a few bytes) and typically aggregate data by running a multicast tree in reverse.

This talk describes a novel algorithm called San Fermin used to aggregate large data sets. San Fermin returns the answer from more nodes, computes the result faster, and has better scalability than existing solutions. Our evaluation explores different aggregation techniques using mathematical modeling, simulation, and deployment of a prototype on PlanetLab. Evaluation shows that San Fermin is scalable as either the number of nodes or the data size increases. San Fermin is also amazingly resilient to failures, so that when 10% of the nodes fail during aggregation it still returns the answer from over 97% of the nodes.

Bio:

Justin Cappos is currently working on his Ph. D. at the University of Arizona with John Hartman and Beichuan Zhang. His research is focused on improving the security and efficiency of real world networks of computer systems. He has lead a number of projects including Stork.

This talk is part of the Computer Laboratory Systems Research Group Seminar series.

This talk is included in these lists:

• All Talks (aka the CURE list)
• CL's SRG seminar
• Cambridge Centre for Data-Driven Discovery (C2D3)
• Cambridge talks
• Chris Davis' list
• Computer Laboratory Systems Research Group Seminar
• Department of Computer Science and Technology talks and seminars
• Interested Talks
• Lecture Theatre 2, Computer Laboratory, William Gates Builiding
• School of Technology
• Trust & Technology Initiative - interesting events
• bld31
• ndk22's list
• ob366-ai4er
• rp587

Note that ex-directory lists are not shown.