Matthew E. Taylor's Publications

Sorted by DateClassified by Publication TypeSorted by First Author Last NameClassified by Research Category

Beyond Runtimes and Optimality: Challenges and Opportunities in Evaluating Deployed Security Systems

Matthew E. Taylor, Chris Kiekintveld, Craig Western, and Milind Tambe. Beyond Runtimes and Optimality: Challenges and Opportunities in Evaluating Deployed Security Systems. In Proceedings of the AAMAS-09 Workshop on Agent Design: Advancing from Practice to Theory, May 2009.
ADAPT-2009

Download

[PDF]71.5kB  [postscript]52.1kB  

Abstract

As multi-agent research transitions into the real world, evaluation becomes an increasingly important challenge. One can run controlled and repeatable tests in a laboratory environment, but such tests may be difficult, or even impossible, once the system is deployed. Furthermore, traditional metrics used by computer scientists, such as runtime analysis, may be largely irrelevant.

BibTeX Entry

@inproceedings(ADAPT09-Taylor,
  author="Matthew E.\ Taylor and Chris Kiekintveld and Craig Western and Milind Tambe",
  title="Beyond Runtimes and Optimality: Challenges and Opportunities in Evaluating Deployed Security Systems",
  Booktitle="Proceedings of the AAMAS-09 Workshop on Agent Design: Advancing from Practice to Theory",
  month="May",
  year= "2009",
  wwwnote={<a
  href="http://nathanschurr.googlepages.com/motivation">ADAPT-2009</a>},
  abstract={ As multi-agent research transitions into the real world,
    evaluation becomes an increasingly important challenge. One can
    run controlled and repeatable tests in a laboratory environment,
    but such tests may be difficult, or even impossible, once the
    system is deployed. Furthermore, traditional metrics used by
    computer scientists, such as runtime analysis, may be largely
    irrelevant.},
)

Generated by bib2html.pl (written by Patrick Riley ) on Mon Apr 19, 2010 14:12:46