[Journals]  [Conferences]  [Others]

Dissertation

Hughes, Stephen B. (2005) Assisted Viewpoint Interaction for 3D Visualizations. University of Pittsburgh, School of Information Sciences.

Journals

Lewis, M., J. Wang, and S. Hughes (2007) "USARsim: Simulation for the study of Human-Robot Interaction".  Journal of Cognitive Engineering and Decision Making. 1(1): 98-120.
The PackBots being used by the U.S. military in Afghanistan and the urban search and rescue (USAR) robots that worked the World Trade Center site are just two recent examples of mobile robots moving from the laboratory to the field.  What is significant about these new applications is that they invariably involve some form of human-robot interaction (HRI) rather than the full robot autonomy that has motivated most prior research.  Conducting HRI research can be extremely difficult because experimentation with physical robots is expensive and time consuming. Few roboticists have experience or interest in conducting human experimentation while researchers in human factors or human computer interaction often lack experience in programming robots or access to robotic platforms.  In this paper we describe a high fidelity open source simulation intended for HRI researchers of varying backgrounds and providing reference tasks and environments to facilitate collaboration and sharing of results.   The architecture and capabilities of the game engine-based USARsim simulation are described. Its use for HRI research is illustrated through case studies describing experiments in camera control for remote viewing and integrated display of attitude information.
Hughes, S. and M. Lewis. (2005) "Attentive Navigation for Viewpoint Control in Virtual Environments".  Human Factors. 47(3): 630-643.
Three-dimensional virtual environments and teleoperation activities depend on the ability to position an egocentric viewpoint at meaningful locations.  Evidence from foundational research has led to the development of control strategies that generally adopt an all-or-nothing approach to guiding the viewer to useful vistas.   This work examines Attentive Navigation, a technique for partially automating viewpoint control to promote a supportive, yet unscripted exploration of virtual environment.  A collection of three experiments was designed to assess the effectiveness of Attentive Navigation versus commonly used Free Navigation techniques.  Results show that this approach has promising consequences for improving object recognition, developing an understanding of the configuration of objects, and in searching for target objects. 
Hughes, S. and M. Lewis. (2005) "Task-Driven Camera Operations for Robotic Exploration"  IEEE Transactions on Systems, Man and Cybernetics - Part A: Systems and Humans  35(4): 513-522. 
Human judgment is an integral part of the teleoperation process that is often heavily influenced by a single video feed returned from the remote environment.  Poor camera placement, narrow field-of-view and other camera properties can significantly impair the operator’s perceptual link to the environment, inviting cognitive mistakes and general disorientation.  These faults may be enhanced or muted, depending on the camera mountings and control opportunities that are at the disposal of the operator.  These issues form the basis for two user studies that assess the effectiveness of existing and potential teleoperation controls.  Findings suggest that providing a camera that is controlled independently from the orientation of the vehicle may yield significant benefits. Moreover, there is evidence to support the use of separate cameras for different navigational subtasks.  Third, the use of multiple cameras can also be used to provide assistance without encroaching on the operator’s desired threshold for control.

Prasithsangaree, P., Manojlovich,  J., Hughes, S., and Lewis, M. (2004). "UTSAF: A Multi-Agent-Based Software Bridge for Interoperability between Distributed Military and Commercial Gaming Simulation", Simulation, 80(12), 647-657.
Rapid advances in consumer electronics have led to the anomaly that consumer off-the-shelf gaming hardware and software provide better interactive graphics than military and other specialized systems costing orders of magnitude more. UTSAF (Unreal Tournament Semi-Automated Force) is bridging software written to take advantage of the power of gaming systems by allowing them to participate in distributed simulations with military simulators. UTSAF illustrates the use of multiagent technology to flexibly interconnect otherwise incompatible systems. This article describes an architectural approach for rapidly constructing middleware by taking advantage of built-in capabilities for processing, communication, and interoperation that a multiagent infrastructure provides. Several software agents based on Reusable Environment for Task-Structured Intelligent Networked Agents (RETSINAs) are used to support interoperability between military simulation nodes based on distributed interactive simulation and Unreal game simulators. Using a multiagent system, UTSAF can be expanded to support several network environments and interact with other agent-based software.

Conference Presentations


2016

Hughes, S. Davenport, M and Ott, D. (2016) Collaboration Strategies for Drag-and-Drop Interaction with Multiple Devices. In C. Stephanidis (Ed.) HCI International 2016 (pp329-333). Sprinter Berlin Heidelburg.

Hughes, S. and East, J.P. (2016). Problem Centered Programming Instruction Problem List. 2016 CSTA Annual Conference, San Diego CA.


2015

Burda, A., Hughes, S., Bean, K., Dutta, M., Dykeman, C., Fischer, B., Foltz, Z., Holtkamp, L., Meyer, A., Reuter, J., Sexe, J., & Strausser, A. (2015) Effectiveness of the Name That! app in a person with aphasia. Annual Meeting of the American Speech-Language-Hearing Association, Chicago, IL. .

Hughes, S. and East, J.P. (2015). Focusing on Problem-Centered Programming Instruction. 2015 CSTA Annual Conference, Dallas TX.


2014

Hughes, S. and East, J.P. (2014). Just-In-Time Programming Knowledge: “Why Can’t You Write This Program?”. 2014 CSTA Annual Conference, St. Charles IL.

Hughes, S. and East, J.P. (2014). Thinking about Conditional Thinking. Proceedings of the 47th Annual Midwest Instruction and Computing Symposium, Verona, WI.


2013

Bardell, C, Hughes, S. and Schafer, J.B. (2013) Human Performance with Multiple Devices Influencing a Single Cursor. Human Factors and Ergonomics Society 57th Annual Meeting, San Diego, CA.

Burda, A., Hughes, S., Dutta, M., Foltz, Z., & Sexe, J. (2013). Semantic feature analysis application for aphasia therapy. Annual Meeting of the Canadian Association of Speech-Language Pathologists and Audiologists, Victoria, BC.

East, J.P. and Hughes, S. (2013). An Experience Report of Our Teaching Visual BASIC using a Problem-Oriented Approach. Proceedings of the 46th Annual Midwest Instruction and Computing Symposium, LaCrosse, WI.


2012

Hughes, S. (2012) Teaching Mobile Computing using Proof-of-Concept and Studio-Based Instruction. Proceedings of the 45th Annual Midwest Instruction and Computing Symposium, Cedar Falls, IA.

Schafer, J.B., and Hughes, S. (2012) Student-Owned Devices for Classroom-wide Communication and Collaboration. Proceedings of the 45th Annual Midwest Instruction and Computing Symposium, Cedar Falls, IA.

Hughes, S., B. Schafer, A. Mangel, and S. Fredericksen (2012) A Customizable Platform for Classroom Collaboration Using Mobile Devices. SigCSE 2012: the 43rd ACM Technical Symposium on Computer Science Education, Raleigh, NC.


2011

Harthoorn, K., & Hughes, S. (2011). Interface Design to Support Situation Awareness in Virtual Puppetry. In C. Stephanidis (Ed.), HCI International 2011 (pp. 112-115). Springer Berlin Heidelberg.


2006

Hughes, S.  (2006) Coordination Strategies for Assisted Viewpoint Interaction. Proceedings of the IEEE Symposium on 3D User Interfaces, Alexandria VA.


2005

Hughes, S. and M. Lewis (2005) Camera Orientation: An Opportunity for Human-Robot Collaborative Control.  Proceedings of the 2005 IEEE International Conference on Systems, Man, and Cybernetics, Waikaloa, HI          

Wang, J., Lewis, M., Hughes, S., Koes, M., and Carpin, S.(2005) Validating USARsim for use in HRI Research Human Factors and Ergonomics Society 49th Annual Meeting, Orlando FL: 457-461        


2004

Hughes, S. and M. Lewis (2004) Robotic Camera Control for Remote Exploration. Proceedings of ACM CHI: Conference on Human Factors in Computing Systems, Vienna Austria

Hughes, S. and M. Lewis (2004) Assisted Viewpoint Control for Tele-robotic Search.Human Factors and Ergonomics Society’s 48th Annual Meeting, New Orleans LA.

Wang, J., Lewis, M., and Hughes, S.  (2004) Gravity-Referenced Attitude Display for Teleoperation of Mobile Robots Human Factors and Ergonomics Society’s 48th Annual Meeting, New Orleans LA. 2662-2666.


2003

Hughes, S., Manojlovich, J. Lewis, M., and Gennari, J. (2003) Camera Control and Decoupled Motion for Teleoperation. Proceedings of the 2003 IEEE International Conference on Systems, Man, and Cybernetics, Washington, DC.   

Gennari, J., M. Harrington, S. Hughes, M. Manojlovich, M. Spring (2003)  Preparatory Observations on Ubiquitous Knowledge Environments: The Cyberinfrastructure Information Ether. NSF Post Digital Library Futures Workshop. Chatham, Massachusetts.

Manojlovich, J., Prasithsangaree, P., Hughes, S. Chen, J., and Lewis, M. (2003). UTSAF: Getting the Best of Consumer Graphics into Military Simulations. Proceedings of the 47th Annual Meeting of the Human Factors and Ergonomics Society, Denver, CO.


2002

Hughes, S. and M. Lewis (2002). “Attentive Interaction Techniques for Searching Virtual Environments.” Proceedings of the Human Factors and Ergonomics Society's 46th Annual Meeting, Baltimore MD. 2159-2163.

Hughes, S. and M. Lewis (2002). “Directing Attention in Open Scenes.” Proceedings of the Human Factors and Ergonomics Society's 46th Annual Meeting, Baltimore MD. 1609-1612.

Hughes, S., P. Brusilovsky, and M. Lewis. (2002)  Adaptive Navigation Support in 3D E-Commerce Activities Workshop on Recommendation and Personalization in eCommerce at the 2nd International Conference on Adaptive Hypermedia and Adaptive Web Based Systems, Malaga, Spain

Hughes, S.  Shared Viewpoint Control for Information Visualization. Workshop on Visual Computing, San Francisco 

Chang, S.K., W. Dai, S. Hughes, P. S. Lakkavaram and X. Li.  "Evolutionary Query Processing, Fusion and Visualization" Workshop on Visual Computing, San Francisco


Before 2002

Hughes, S. and M. Lewis (2000). “Attentive Camera Navigation in Virtual Environments.” Proceedings of the IEEE International Conference on Systems, Man & Cybernetics. 967-970.

Nuri, M., S. Hughes and M. Lewis (2000). Scriptor: Using deictics, dialog, and supervised learning to convey instructions. IEEE International Conference on Systems, Man and Cybernetics. Nashville, TN.

Hanson, A., E. Wernert, and S. Hughes. (1999). “Constrained Navigation Environments.” Scientific Visualization: Dagstuhl '97 Proceedings. H. Hagen, G. M. Nielson and F. Post, IEEE Computer Society Press. 95-104.

Hughes, S. (1995). “A New Upper Bound for Space Bounded Server Algorithms.” ACM Southeast Regional Conference. Clemson, SC.


Book Sections

Hughes, S. (2002). "Visual Basic" in Computer Sciences for Students. R. Flynn, MacMillan Reference/  The Gale Group. 4: 208-212. 

Trade Press

Hughes, S. (1999). Wanted: AS/400 User Designers. Midrange Computing. (16) 9
Hughes, S., E. Koopman, B. Tesman, and S. Prevost. (1994) "New Tools for Linear Algebra" Mathematica in Education. (3) 3.

Extended Abstracts

Hughes,  Karimi:   A Real-Time Wayfinding Technique using Path Vectors. Presented at GIScience 2000:
the First International Conference on Geographic Information Science 2000.
Hirtle, Hughes, Heo:  The Interaction of Images and Maps in the Development of Locational Aids Presented at  GIScience 2000: the First International Conference on Geographic Information Science 2000.