The SiMPE workshop series started in 2006 with the goal of enabling speech processing on mobile and embedded devices. The SiMPE 2012 workshop extended the notion of audio to non-speech "Sounds" and thus the expansion became "Speech and Sound". SiMPE 2010 and 2011 brought together researchers from the speech and the HCI communities. Speech User interaction in cars was a focus area in 2009. Multimodality got more attention in SiMPE 2008. In SiMPE 2007, the focus was on developing regions.

In this paper we introduce Acoustic Quick Response codes to facilitate sharing between Interactive Voice Response (IVR) service users. IVRs are telephone-based, and similar to the world wide web in many aspects, but currently lack support for content sharing. Our approach uses 'audio codes' to let people share their call positions, and allows callers to hold their normal (low-end) handsets together to synchronise. The technique uses remote generation and recognition of audio codes to ensure that sharing is possible on any type of phone without the need for textual literacy or an internet connection. We begin by exploring existing user needs for sharing, then evaluate the technical robustness of our audio-based design. We demonstrate the value of the approach for voice service users over several separate studies--including an eight-month extended field deployment--then conclude with a discussion of future possibilities for such scenarios.

Bugs are inevitable in software projects. Resolving bugs is the primary activity in software maintenance. Developers, who fix bugs through code changes, are naturally important participants in bug resolution. However, there are other participants in these projects who do not perform any code commits. They can be reporters reporting bugs; people having a deep technical know-how of the software and providing valuable insights on how to solve the bug; bug-tossers who re-assign the bugs to the right set of developers. Even though all of them act on the bugs by tossing and commenting, not all of them may be crucial for bug resolution. In this paper, we formally define essential non-committers and try to identify these bug resolution catalysts. We empirically study 98304 bug reports across 11 open source and 5 commercial software projects for validating the existence of such catalysts. We propose a network analysis based approach to construct a Minimal Essential Graph that identifies such people in a project. Finally, we suggest ways of leveraging this information for bug triaging and bug report summarization.

Word clouds are extensively used to present a summary of the prominent words in a document on the World Wide Web. Such clouds give the user an idea about the content of the document. In this paper we present a mechanism to create and render an audio cloud for audio content. Such audio clouds are expected to provide a similar summary of the audio documents. They have wide applicability in various domains, especially for low-literate users who currently do not use the Internet but interact with audio-based systems.

Much of the mobile work by HCI researchers explores a future world populated by high-end devices and relatively affluent users. This paper turns to consider the hundreds of millions of people for whom such sophistication will not be realised for many years to come. In developing world contexts, people will continue to rely on voice-primary interactions due to both literacy and economic reasons. Here, we motivate research into how to accommodate advanced mobile interface techniques while overcoming the handset, data-connection and user limitations. As a first step we introduce TapBack: back-of-device taps to control a dialled-up, telephone-network-based voice service. We show how these audio gestures might be recognised over a standard telephone connection, via users' existing low-end devices. Further, in a longitudinal deployment, the techniques were made available on a live voice service used by rural Indian farmers. Data from the study illustrates the desire by users to adopt the approach and its potential extensions.

"In all the wonderful worlds that writing opens, the spoken word still resides and lives. Written texts all have to be related somehow, directly or indirectly, to the world of sound, the natural habitat of language, to yield their meanings."

With the proliferation of pervasive devices and the increase in their processing capabilities, client-side speech processing has been emerging as a viable alternative. The SiMPE workshop series started in 2006 [5] with the goal of enabling speech processing on mobile and embedded devices to meet the challenges of pervasive environments (such as noise) and leveraging the context they offer (such as location). SiMPE 2010, the latest in the series brought together, very successfully, researchers from the speech and the HCI communities. We believe this is the beginning.

With the proliferation of pervasive devices and the increase in their processing capabilities, client-side speech processing has been emerging as a viable alternative. The SiMPE workshop series started in 2006 [5] with the goal of enabling speech processing on mobile and embedded devices to meet the challenges of pervasive environments (such as noise) and leveraging the context they offer (such as location).

Taxonomies, representing hierarchical data, are a key knowledge source in multiple disciplines. Information processing across taxonomies is not possible unless they are appropriately merged for commonalities and differences. For taxonomy merging, the first task is to identify common concepts between the taxonomies. Then, these common concepts along with their associated concepts in the two taxonomies need to be integrated. Doing this in a conflict-free manner is a challenging task and generally requires human intervention. In this paper, we explore the possibility of asymmetrically merging one taxonomy into another automatically. Given one or more source taxonomies and a destination taxonomy, modeled as directed acyclic graphs, we present intuitive algorithms that merge relevant portions of the source taxonomies into the destination taxonomy. We prove that our algorithms are conflict-free, information lossless, and scalable. We also define precision and recall measures for evaluating enriched taxonomies, such as TA, the result of merging two taxonomies, with TI, the ideal merger. Our experiments indicate the effectiveness of our approach.

In this paper we present a study comparing speech and dialed input voice user interfaces for farmers in Gujarat, India. We ran a controlled, between-subjects experiment with 45 participants. We found that the task completion rates were significantly higher with dialed input, particularly for subjects under age 30 and those with less than an eighth grade education. Additionally, participants using dialed input demonstrated a significantly greater performance improvement from the first to final task, and reported less difficulty providing input to the system.

83% of the world population does not have access to Internet. Therefore there is a need for a simple and affordable interaction technology that can enable easy content creation and dissemination for this population. In this paper, we present the design, development and usage pattern of a VoiKiosk system that provides a voice-based kiosk solution for people in rural areas. This system is accessible by phone and thus meets the affordability and low literacy requirements. We present usability results gathered from usage by more than 900 villagers during four month of the on-field deployment of the system. The on-field experiments suggest the importance of locally created content in their own language for this population. The system provides interesting insights about the manner in which this community can create and manage information. Based on the use of the system in the four months, the VoiKiosk also suggests a mechanism to enable social networking for the rural population.

Websites in World Wide Web are primarily meant for visual consumption. Moreover, the wide variety of visual controls available make it harder to interpret the websites with screen readers. This problem of accessing information and services on the web escalates even further for visually impaired in developing regions since most are either semi-literate/illiterate or cannot afford computers and high-end phones with screen reading capability.In this paper, we present an alternate platform -- the World Wide Telecom Web (WWTW). WWTW is already being successfully deployed as a network of VoiceSites that can be created and accessed by a voice interaction over an ordinary phone. WWTW presents a whole new set of opportunities for delivering information and services to the visually impaired. We present a preliminary user study that leads us towards the belief that the Telecom Web can be the mainstream Web for blind users.

Social Network Analysis has emerged as a key paradigm in modern sociology, technology, and information sciences. The paradigm stems from the view that the attributes of an individual in a network are less important than their ties (relationships) with other individuals in the network. Exploring the nature and strength of these ties can help understand the structure and dynamics of social networks and explain real-world phenomena, ranging from organizational efficiency to the spread of information and disease.

In the past, voice-based applications have been accessed using unintelligent telephone devices through Voice Browsers that reside on the server. The proliferation of pervasive devices and the increase in their processing capabilities, clientside speech processing has been emerging as a viable alternative. In SiMPE 2008, the third in the series, we will continue to explore the various possibilities and issues that arise while enabling speech processing on resource-constrained, possibly mobile devices.

In this paper we describe our experiences designing a voice interface in rural India. We outline our design process from initial contextual inquiry to a formal user evaluation, and use this discussion to motivate research guidelines for others designing voice interfaces in developing regions. Our three guidelines are to build around existing information systems, to iterate on the design through user testing, and to explore design alternatives through empirical analysis. We also share some practical lessons learned in designing, implementing, and evaluating information systems for developing regions in general.

Information Retrieval on the WWW is important because it is hard to find what one is looking for. There is a plethora of information available, and searching relevant information is a challenge. In the case of developing regions, we have the opposite problem: 1) Information availability of global markets is scarce. Most of the consumers and producers (of information as well as goods) are relegated to local markets in geographical vicinity. In order to reach wider markets, it is important for this local information to reach wider audiences. (Local information for global consumption LIG model). (2) At the same time, locally relevant information, such as delays in bus/train timings, mobile medical van schedule changes, electricity outage timings, is not easily available either. (Local information for local consumption LIL model). We introduce the term Information Uptrieval to address the reverse problem of acquiring, assimilating, aggregating and uploading global and local information that is relevant for developing regions to a platform that improves the reach of the information. While the WWW is an obvious example of one such platform, given the low internet penetration in such regions, we need to explore effective alternatives. Several innovative, but disconnected approaches have been attempted to address the information uptrieval problem, ranging from the use of DVDs (eSagu, http://www.esagu.in/esagu) through the use of wireless stations on motorcycles (First Mile Solutions, http://www.firstmilesolutions.com). Many of these have met with reasonable success in their pilot deployments.

As the number of telephony voice applications grow, there will be a need for a browser to surf the Web of interconnected voice applications (called as VoiceSites). These VoiceSites are accessed through a telephone over an audio channel. We present the concept and architecture of T-Web Browser, a World Wide Telecom Web browser that enables browsing the Web of voice applications through an ordinary phone. This browser will support rich browsing features such as history and bookmarking.

One of the several initiatives to bridge the digital divide in developing countries has been the deployment of information kiosks or knowledge centers in villages in rural parts of the country. These kiosks provide services ranging from email, chat and browsing to distance education programs, agricultural services and eGovernance services. A kiosk typically comprises of a computer with printer, web cam, multimedia system and Internet connectivity and is owned by a local entrepreneur. Moving away from the PC based kiosk model, we present an alternative platform to create and host such information kiosks in the telephony network. We call these as VoiKiosks and they are accessible through voice interaction over an ordinary phone call.

Various sectors in developing countries are typically dominated by the presence of a large number of small and microbusinesses that operate in an informal, unorganized manner. Many of these are single person run micro-businesses and cannot afford to buy and maintain their own IT infrastructure. For others, easy availability of cheap labour provides a convenient alternative even though it results in inefficiency, as little or no records are maintained, and only manual, paper-based processes are followed. This results in high response times for customers, no formal accountability and higher charges. For the businesses this translates to lower earnings and losses due to inefficiencies. In this paper, we look at few such micro-business segments and explore their current models of operation, while identifying existing inefficiencies and pain points. We build upon the findings and propose an approach for delivering benefits of IT solutions to such micro-business segments. Finally, we present technology that realizes the proposed approach in the specific context of two such segments.

With the ever-growing competition in telecommunications markets, operators have to increasingly rely on business intelligence to offer the right incentives to their customers. Existing approaches for telecom business intelligence have almost solely focused on the individual behavior of customers. In this paper, we use the call detail records of a mobile operator to construct call graphs, that is, graphs induced by people calling each other. We determine the structural properties of these graphs and also introduce the Treasure-Hunt model to describe the shape of mobile call graphs. Moreover, we determine how the structure of these call graphs evolve over time. Finally, since short messaging service (SMS) is becoming a preferred mode of communication among many sections of the society, we study the properties of the SMS graph. Our analysis indicates several interesting similarities and differences between the SMS graph and the corresponding call graph. We believe that our analysis techniques can allow telecom operators to better understand the social behavior of their customers and potentially provide major insights for designing effective incentives.

This paper presents the design and implementation of Heterogeneous Event Management Middleware (HEMM) that integrates events across multiple siloed workflow management systems (WFMS) in enterprises. Specifically, we address the issue where a high-level change (e.g. change in business policy or rolling out of a new service) necessitates external events (generated from other enterprise system) to be handled by running workflow (WF) instances in the WFMS. Current solutions either require a change in the workflow process definition or change in the workflow engine - both being cost intensive solutions from an enterprise 's point of view since they compromise on enterprise backend downtime. HEMM circumvents this by introducing an overlay on top of existing WFMS and abstracting out unforeseen event handling from workflows. At the same time, it employs event transformation to map events to appropriate event handlers of running workflow instances, enabling them to adapt to new events that their process definitions do not handle. We demonstrate our prototype implementation with the example of rolling out a bundled service that is prevalent in telecom industry.

WWW has made information accessible to computer users in various ways not imagined before. However; there is a huge pool ofpeople, especially in emerging economies, still untouched by this revolution and are either unaware of, or are unable or to join this bandwagon. Mobile phones are increasingly empowering the under-privileged to utilize data and services beyond the basic voice communication. However; factors such as high illiteracy rate, cost sensitivity, and user interface issues prevent these users from deriving benefits of available infrastructure and services. We have developed a novel system - VOISERV that enables ordinary telephone subscribers to create, deploy and offer their own customized voice-driven applications called Voic-eSites. The generated VoiceSites get hosted in the network for low cost of ownership and maintenance, and are integrated with advanced services available in the converged networks of today.

With ever growing competition in telecommunications markets, operators have to increasingly rely on business intelligence to offer the right incentives to their customers. Toward this end, existing approaches have almost solely focussed on the individual behaviour of customers. Call graphs, that is, graphs induced by people calling each other, can allow telecom operators to better understand the interaction behaviour of their customers, and potentially provide major insights for designing effective incentives.In this paper, we use the Call Detail Records of a mobile operator from four geographically disparate regions to construct call graphs, and analyse their structural properties. Our findings provide business insights and help devise strategies for Mobile Telecom operators. Another goal of this paper is to identify the shape of such graphs. In order to do so, we extend the well-known reachability analysis approach with some of our own techniques to reveal the shape of such massive graphs. Based on our analysis, we introduce the Treasure-Hunt model to describe the shape of mobile call graphs. The proposed techniques are general enough for analysing any large graph. Finally, how well the proposed model captures the shape of other mobile call graphs needs to be the subject of future studies.

A telecom operator ("service provider",SP) offers various services to subscribed customers by partnering with various third party providers ("content provider",CP). The SP acts as a liaison between subscribers and partners. One of the main functions of the SP, therefore, is to match the "demand" of the subscribers with the "supply" of the CPs. Such a matching is a prerequisite for efficient service selection while ensuring customer satisfaction, and is useful for optimisation, such as resource allocation and load balancing. The "demand" requirements and "supply" guarantees can be concretized using Service Level Agreements (SLAs). SLAs can be expressed formally using standards such as WSLA or WS-Agreement. We present a system that automates the task of finding a matching between these two sets, subscriber-SP and SP-CP, of SLAs. First, the SLAs are normalised to a common denominator, then composed if required, and finally the matching engine computes and outputs the map. The matching algorithm, which is of central importance, compares logical expressions involving predicates. The logical expressions are first converted into CNFform, and instead of naive O(m × n) comparisons, we develop a more efficient approach to solve the problem. As a proof-of-concept, we have implemented a prototype as an Eclipse plugin.

Traditionally, voice-based applications have been accessed using unintelligent telephone devices through Voice Browsers that reside on the server. The proliferation of pervasive devices and the increase in their processing capabilities, client-side speech processing is emerging as a viable alternative. This workshop will explore the various possibilities and issues that arise while enabling speech processing on resource-constrained, possibly mobile devices. The workshop will highlight the many open areas that require research attention, identify key problems that need to be addressed, and also discuss a few approaches for solving some of them - to build the next generation of conversational systems.

This paper presents an architecture to facilitate efficient evaluation and selection of 3rd party Web services for service providers. Most service provider architectures have primarily focused on providing Web service front ends to legacy systems, aggregating and delivering services via workflows. These architectures primarily considered static business contracts between the service provider and its (Web-service enabled) business partners. This approach makes these architectures inflexible to variations in business requirement, partners' performance and customer requirements. Our architecture provides a flexible means for service providers to optimize business performance. Based on the historical performance, extant context, and optimising business rules, the appropriate service is selected and invoked to serve a customer request. We have developed a prototype system ODSS-in-ENDS, that demonstrates this capability.

The provisioning of value-added-services (VAS) to mobile users is crucial for the proliferation and early adoption of converged voice and data networks, 3rdgeneration/beyond 3rdgeneration networks (3G/B3G). In this paper, we describe a VAS provisioning middleware framework for deployment in 3G mobile operator networks. Through this framework, we enable on-demand selection of 3rdparty services in 3G/B3G networks. The main contribution, in terms of novelty, is that the framework introduces a new service provisioning paradigm called on demand service selection. The service selection (a requested user task can be accomplished by many similar service offerings, therefore the need for selecting a particular service) is driven by the 3G operator business policies, user profile/preferences and runtime context information. Also, the framework adapts the service selection to changing business-technical performances of the 3rd party CP/SP, and specific user preferences and context

The proliferation of pervasive devices has stimulated the development of applications that support ubiquitous access via multiple modalities. Since the processing capabilities of pervasive devices differ vastly, device-specific application adaptation becomes essential. We address the problem of speech application adaptation by dialog call-flow reorganisation for pervasive devices with different memory constraints. Given an atomic dialog call-flow A and device memory size m, we present optimal deterministic algorithms, RESEQUENCE and BALANCE-TREE, which minimise the number of questions in the reorganised output call-flow A/sub m/. Algorithms MASQ and MATREE produce C/sub m/, minimally distant from input call-flow A/sub m/ while accommodating the memory constraint m. These two minimisation criteria are capable of capturing various usability requirements important in dialog call-flow design. The following observation forms the cornerstone of all the algorithms in this paper: Two grammars g/sub 1/ and g/sub 2/ comprising of |g/sub 1/| and |g/sub 2/| elements respectively can be merged into a single grammar g = g/sub 1/ /spl times/ g/sub 2/ having |g/sub 1/|/spl middot/|g/sub 2/| elements for the sequential case, and g = g/sub 1/ + g/sub 2/ having |g/sub 1/|+|g/sub 2/| elements for the tree case. Device-speciific considerations lead us to introduce the concept of an-characterisation of a call-flow, defined as the set of pairs {(m/sub i/,q/sub i/)| /spl isin/ N}, where q/sub i/ is the minimum number of questions required for memory size m/sub i/. Each call-flow has a unique, device-independent signature in its-characterisation - a measure of its adaptability. We present SAMVAAD, a system that implements these algorithms on call-flows authored in VXML containing SRGS grammars. The system was tested on an IBM voice browser using a sample airline reservation system call-flow reorganised for memories ranging from 64 MB to 210 KB. We ran an experiment with 14 users to obtain feedback on the usability of the adapted call-flows.

This paper introduces generalised disjunctive association rules such as "People who buy bread also buy butter jam", and "People who buy either raincoats or umbrellas also buy flashlights". A generalised disjunctive association rule allows the disjunction of conjuncts, "People who buy jackets also buy bow ties or neckties and tiepins". Such rules capture contextual inter-relationships among items.Given a context (antecedent), there may be a large number of generalised disjunctive association rules that satisfy the minsupp and minconf constraints. It is computationally expensive to find all such rules. We present algorithm thrifty traverse which borrows concepts such as subsumption from propositional logic to mine a subset of such rules in a computationally feasible way. We experimented with our algorithm on US census data as well as transaction data from a grocery superstore to demonstrate its computational feasibility, utility and scalability.