Data preparation is the first and a very important step towards any Large Language Model (LLM) development. This paper introduces an easy-to-use, extensible, and scale-flexible open-source data preparation toolkit called Data Prep Kit (DPK). DPK is architected and designed to enable users to scale their data preparation to their needs. With DPK they can prepare data on a local machine or effortlessly scale to run on a cluster with thousands of CPU Cores. DPK comes with a highly scalable, yet extensible set of modules that transform natural language and code data. If the user needs additional transforms, they can be easily developed using extensive DPK support for transform creation. These modules can be used independently or pipelined to perform a series of operations. In this paper, we describe DPK architecture and show its performance from a small scale to a very large number of CPUs. The modules from DPK have been used for the preparation of Granite Models [1] [2]. We believe DPK is a valuable contribution to the AI community to easily prepare data to enhance the performance of their LLM models or to fine-tune models with Retrieval-Augmented Generation (RAG).

Peer-to-peer (p2p) networks and Mobile ad hoc networks (MANET) have been widely studied. However, a real-world deployment for the masses has remained elusive. Ever-increasing density of mobile devices, especially in urban areas, has given rise to new applications of p2p communication. However, the modern smartphone platforms have limited support for such communications. Further, the issues of battery life, range, and trust remain unaddressed. A key question then is, what kinds of applications can the modern mobile platforms support and what challenges remain? This paper identifies a class of applications and presents a novel center-to-peer-to-peer (c2p2p) architecture called Mesh Network Alerts (MNA) to support them. We describe our experiences in deploying MNA as a real-world system to millions of users for relaying severe weather information along with the challenges faced, and the approaches for addressing them.

Java provides a synchronized construct for multi-core programming with many workloads. However, naïve use of the synchronized construct causes performance scalability problems due to lock contention. One of the sources of lock contentions is a synchronized collection class. There are known concurrency code patterns to alleviate lock contentions such as a Concurrent Collection (CC), Read-Write Lock (RWL), and Double-Checked Locking (DCL). To date, there is no algorithm to transform a program using DCL. This paper describes steps on how to rewrite synchronized blocks using DCL.

Emerging multi-core processors are able to accelerate medical imaging applications by exploiting the parallelism available in their algorithms. We have implemented a mutual-information-based 3D linear registration algorithm on the Cell Broadband Enginetrade processor. By exploiting the highly parallel architecture and its high memory bandwidth, our implementation with two CBE processors can register a pair of 256x256x30 3D images in one second. This implementation is significantly faster than a conventional one on a traditional microprocessor or even faster than a previously reported custom-hardware implementation. In addition to parallelizing the code for multiple cores and organizing the data structure for reducing the amount of the memory traffic, it is also critical to optimize the code for the SIMD pipeline structure. We note that code optimization for the SIMD pipeline alone results in a 4.2x-8.7x acceleration for the computation of small kernels. Further, SIMD optimization alone results in a 4.5x end-end application speedup.

In this paper, we address the design issues of a collaborative workspace system, called TeamSpace, that supports geographically distributed teams by managing shared work processes and maintaining shared artifacts in a project. TeamSpace attempts to integrate both synchronous and asynchronous types of team interaction into a task-oriented environment. Since meetings are an integral part of teamwork, our current work focuses on supporting virtual meetings as part of a larger collaborative work process. We present an initial TeamSpace prototype that supports asynchronous meeting management seamlessly integrated with capture and access of synchronous distributed meetings. The captured synchronous data is integrated with other related information in TeamSpace, enabling users to efficiently gain knowledge of both current and past team activities.

No abstract available.

Article Collaborative customer services using synchronous Web browser sharing Share on Authors: Makoto Kobayashi IBM Research, Tokyo Research Laboratory, 1623-14, Shimotsuruma, Yamato, Kanagawa 242-8502, Japan IBM Research, Tokyo Research Laboratory, 1623-14, Shimotsuruma, Yamato, Kanagawa 242-8502, JapanView Profile , Masahide Shinozaki IBM Research, Tokyo Research Laboratory, 1623-14, Shimotsuruma, Yamato, Kanagawa 242-8502, Japan IBM Research, Tokyo Research Laboratory, 1623-14, Shimotsuruma, Yamato, Kanagawa 242-8502, JapanView Profile , Takashi Sakairi IBM Research, Tokyo Research Laboratory, 1623-14, Shimotsuruma, Yamato, Kanagawa 242-8502, Japan IBM Research, Tokyo Research Laboratory, 1623-14, Shimotsuruma, Yamato, Kanagawa 242-8502, JapanView Profile , Maroun Touma IBM Thomas J. Watson Research Center, 30 Saw Mill River Rd., Hawthorne, NY IBM Thomas J. Watson Research Center, 30 Saw Mill River Rd., Hawthorne, NYView Profile , Shahrokh Daijavad IBM Thomas J. Watson Research Center, 30 Saw Mill River Rd., Hawthorne, NY IBM Thomas J. Watson Research Center, 30 Saw Mill River Rd., Hawthorne, NYView Profile , Catherine Wolf IBM Thomas J. Watson Research Center, 30 Saw Mill River Rd., Hawthorne, NY IBM Thomas J. Watson Research Center, 30 Saw Mill River Rd., Hawthorne, NYView Profile Authors Info & Claims CSCW '98: Proceedings of the 1998 ACM conference on Computer supported cooperative workNovember 1998 Pages 99–109https://doi.org/10.1145/289444.289484Published:01 November 1998 31citation820DownloadsMetricsTotal Citations31Total Downloads820Last 12 Months3Last 6 weeks1 Get Citation AlertsNew Citation Alert added!This alert has been successfully added and will be sent to:You will be notified whenever a record that you have chosen has been cited.To manage your alert preferences, click on the button below.Manage my AlertsNew Citation Alert!Please log in to your account Save to BinderSave to BinderCreate a New BinderNameCancelCreateExport CitationPublisher SiteGet Access

This paper describes an empirical study that compared three alternatives for voice communication in conjunction with Web page collaboration for customer service.Two of the technologies used a single phone line for both voice and data transmission.These technologies were intemet telephony and Simultaneous< Voice and Data (SVD), a protocol which allows the voice to be routed over the public telephone network, rather hart the inteme~The study found that SVD was superior to intemet telephony in terms of a number of behavioral and subjective measures of con\7ersational interaction.The study also found that task time using intemet telephony was 45% greater than with SVD, mtilng the former a costly rdtemative in terms of human time.

A realistic approach is introduced for the computation of the electromagnetic radiation interference (EMI) from printed circuit boards. The approach is suitable for large problems and real circuit boards can be investigated. Each trace and its source and loads are represented as electrical circuits and a conventional time-domain circuit simulation is used to find the currents. The field is then calculated by applying the free-space Green's function to all currents including the polarization currents. This is, to the authors' knowledge, the first CAD tool which can predict EMI from basic principles.>