Deduplication is the process of removing replicated data content from storage facilities like online databases, cloud datastore, local file systems, etc. It is commonly performed as part of data preprocessing to eliminate redundant data that requires extra storage spaces and computing power and is crucial for data storage management in cloud computing. Deduplication is essential for file backup systems since duplicated files will presumably consume more storage space, especially with a short backup period such as daily. A common technique in this field involves splitting files into chunks whose hashes can be compared using data structures or techniques like clustering. This paper explores the possibility of performing such file chunk deduplication leveraging an innovative reinforcement learning approach to achieve a high deduplication ratio. The proposed system is named SegDup, which achieves 13% higher deduplication ratio than Extreme Binning, a state-of-the art deduplication algorithm.

As society grows increasingly more online with each passing year, the problem of cyberbullying becomes more and more prominent, with such incidents having the capacity to negatively impact mental health in a major way, especially among children and teenagers. The proposed approach builds on our previous work that established multi-modal detection of cyberbullying on Twitter, and restructures the multi-modal approach by incorporating social media features such as time-related features and social network information. As a result, the new models reach a classification accuracy between 94.4% and 94.6%, from the previous accuracy of 93%. The proposed new approach affirms the use of context-based data in addition to more directly-related features when analyzing cyberbullying and other interactions with promising improvements. We believe that this work contributes significantly to the study of cyberbullying detection, which is an imminent problem with growing importance in the post-COVID society.

Given the great amounts of data being transmitted between devices in the 21st century, existing channels of wireless communication are getting congested. In the wireless space, the focus up to now has been on the microwave frequency range. An alternative for high-speed medium- and long-range communication is the millimeter wave spectrum, which is most effectively used through point-to-point links. In this paper, we develop and compare methods for verifying the Line of Sight (LOS) constraint between two points in a city. To be useful for online wireless network planning systems, the methods must be able to process terabytes of 3D city geolocation data and provide answers in milliseconds. We evaluate our methods using data for the city of San Jose, a major metropolitan area in Silicon Valley, California. Our results indicate that our Hierarchical Polygon Aggregation (HPA) method is able to achieve millisecond-level query times with very little loss of precision.

Despite clinical trials by pharmaceutical companies as well as current FDA reporting systems, there are still drug side effects that have not been caught. To find a larger sample of reports, a possible way is to mine online social media. With its current widespread use, social media such as Twitter has given rise to massive amounts of data, which can be used as reports for drug side effects. To process these large datasets, Apache Spark has become popular for fast, distributed batch processing. In this work, we have improved on previous pipelines in sentimental analysis-based mining, processing, and extracting tweets with drug-caused side effects. We have also added a new ensemble classifier using a combination of sentiment analysis features to increase the accuracy of identifying drug-caused side effects. In addition, the frequency count for the side effects is also provided. Furthermore, we have also implemented the same pipeline in Apache Spark to improve the speed of processing of tweets by 2.5 times, as well as to support the process of large tweet datasets. As the frequency count of drug side effects opens a wide door for further analysis, we present a preliminary study on this issue, including the side effects of simultaneously using two drugs, and the potential danger of using less-common combination of drugs. We believe the pipeline design and the results present in this work would have great implication on studying drug side effects and on big data analysis in general.

Extensive clinical trials are required before a drug is placed on the market; yet it is difficult to discover all the side effects for any approved drugs. The United States Food and Drug Administration actively monitors approved medications to identify adverse events. The FDA Adverse Event Reporting System contains a database of adverse drug events (ADE) reported by the healthcare providers and consumers. The pervasive online social networks, such as Twitter, can provide additional information ADE. Concurrently, advancements in social media technology have resulted in the booming of massive public data; the availability of these huge datasets offers numerous research opportunities for extracting ADEs. Towards this purpose, in this paper a simple, effective computation pipeline is proposed, which uses simple drug-related classification and sentiment analysis to extract ADEs on Twitter. The pipeline is described in detail, and is implemented into an automatic process. Experiments are carried out based on 4-months of Twitter data collected. Comparing with an existing pipeline, the new design is able to successfully capture 5 times more valid ADEs, among them 20% are new ADEs. The proposed method may be applied to other areas such as food, beverages, and other daily consumer products for identifying side effects and user opinions.

As social media has become increasingly popular in the modern world, people are using these platforms to express their opinions about products, businesses, and services. The need for categorizing these consumer reviews has been prominent. One effective solution is sentiment analysis (SA), which has been an active research topic. The goal of SA is to automatically extracting and classifying user opinions. Pervious research works however have not shown satisfied results. In this paper, a multilayer architecture is proposed to increase the performance of multiclass classification. The framework includes data-preprocessing, feature extraction and selection, and classifier building. The framework is a two-layer classification, choosing from Naïve Bayes, Support Vector Machine, Random Forest, and Logistic Regression as base models, and using a voting scheme to obtain the final predicted class. The proposed model is applied to more than 1.3 million restaurant reviews from the Yelp Challenge dataset. We have achieved a high accuracy of 86% for cross validation, and using real-world online review data as test data, we have achieved an accuracy of 80%. The results show that the proposed framework has greatly improved classification accuracy while comparing with those using single-layer architectures. We believe that the proposed method may be applied to, and would have significant contributions to other areas of opinion mining.