Search |  Contact |  SRI Home Do not follow this link, or your host will be blocked from this site. This is a spider trap. Do not follow this link, or your host will be blocked from this site. This is a spider trap. Do not follow this link, or your host will be blocked from this site. This is a spider trap.A A A A A A A A A A A A A A A A A A A A A A A A A A A A A A A A A A A A A A A A A A ASRI International.  333 Ravenswood Avenue.  Menlo Park, CA 94025-3493. SRI International is a nonprofit corporation.

AIC Seminar Series

A Quest to Understand and Accept Scientific Results

Paulo Pinheiro da SilvaUniversity of Texas at El Paso

Notice:  hosted by Alyssa Glass

Date:  2007-12-13 at 16:00

Location:  EJ228 (SRI E building)  (Directions)

   Abstract

Scientific applications are quickly becoming more sophisticated and capable of producing breakthrough results that some scientific communities have been requesting for many years. At the same time that scientific applications are becoming more capable of responding to scientists’ requests, application results are becoming more difficult for scientists to understand and accept. The complexity of the underlying technologies supporting sophisticated applications may explain why some scientists are reluctant to accept results from complex applications. For instance, scientific workflow specifications often used in support of cyber-infrastructure applications can be instantiated by hundreds or even thousands of web services accessing and processing data gathered by large scientific communities or streamed in by swarms of large-scale sensor networks. With this not-so-futuristic context in mind, we can say that when most current complex scientific applications return results, many scientists do not know what information sources were used, when the sources were updated, how reliable the source was, or what information was looked up versus derived. Many scientists also do not know how results were derived.

This talk is centered on a single scientific question in the context of geophysics, i.e., a scientist’s request, and on the problem a scientist may face when deciding whether to accept a map as a quality result for his/her request. The acceptance of maps as quality results becomes even more challenging when the scientist acquires multiple maps, not all of them similar, yet all of them are possible results for the scientific question. We first discuss the use of provenance and provenance visualization as key mechanisms for scientists to understand maps as scientific results. In particular, we present the Inference Web approach that aims to take opaque scientific results and make the results more transparent by providing infrastructure for presenting and managing explanations. To assess our provenance solution, we present a user study that statistically demonstrates the need for scientists to use provenance information to correctly identify and explain map imperfections, if any, and thus to determine map quality.

Later in the talk, we discuss the use of trust management as a way of reinforcing scientists’ decisions concerning acceptance of maps as quality results. A comprehensive representation of trust that includes the notions of distrust, ignorance and vagueness is used to encode trust relations between agents providing spatial information used to derive map results, e.g., people, organizations, sensor networks. A topic-driven, web-based information extraction approach has been used to learn trust relations about people and organizations in the geoscience community. With the combined use of provenance and the geoscience trust network, we compute a new layer on top of maps generated by cyber-infrastructure applications and demonstrate the potential benefits of using the new layer to support a quality decisions.

   Bio for Paulo Pinheiro da Silva

Paulo Pinheiro da Silva is an Assistant Professor of Computer Science and the leader of the Trust Laboratory at the University of Texas at El Paso (UTEP), Texas. At UTEP, Paulo is a co-PI of the Cyber-ShARE Center of Excellence for Cyber-Infrastructure Applications funded by the National Science Foundation, where he is actively involved in multi-disciplinary research between computer science, Earth sciences, and environmental sciences. Paulo is a co-leader of the Inference Web project, a collaborative research effort between Stanford University, Rensselaer Polytechnic Institute and UTEP that aims to provide infrastructure for explaining responses from software systems. Inference Web is sponsored by a number of DARPA and DTO projects. Paulo received his Bachelor’s degree in Mathematics and his M.Sc. degree in computer science both from the Federal University of Minas Gerais, Brazil, and his Ph.D. in computer science from Manchester University, United Kingdom. He was a Postdoctoral Fellow of the Knowledge Systems, Artificial Intelligence Laboratory at Stanford University for three and a half years.

   Note for Visitors to SRI

Please arrive at least 10 minutes early in order to sign in and be escorted to the conference room. SRI is located at 333 Ravenswood Avenue in Menlo Park. Visitors may park in the visitors lot in front of Building E, and should follow the instructions by the lobby phone to be escorted to the meeting room. Detailed directions to SRI, as well as maps, are available from the Visiting AIC web page.

SRI International
©2014 SRI International 333 Ravenswood Avenue, Menlo Park, CA 94025-3493
SRI International is an independent, nonprofit corporation. Privacy policy