Online market platforms serve as a central hub for sharing and deploying AI models among researchers, developers, and companies. In this context, watermarking techniques are essential to protect intellectual property (IP), preventing unauthorized use and duplication of large language models (LLMs). Two key challenges arise: (i) These platforms host diverse LLMs, yet current watermarking techniques are only tailored to specific models, such as fine-tuned or quantized LLMs. (ii) Efficient watermarking is critical. However, traditional methods require substantial data and costly hardware, which limits their feasibility. In this paper, we propose an efficient white-box LLM watermarking technique called ELLMark. This method treats LLMs as multi-layered matrices while embedding watermarks only relies on modifying the model's weights. To preserve LLMs' performance, it filters weights by correlations with the activation magnitudes and downstream tasks, then modifies weights as minimal as possible via histogram modulation. Notably, all phases are training-free with low hardware resources, making it efficient for online platforms. We conduct extensive experiments to evaluate the effectiveness of ELLMark on LLaMA-3, OPT, and Phi-3 LLMs. The results demonstrate that it achieves 100% success in watermark detection while preserving model performance. Moreover, the preprocessing, encoding, and decoding processes remain efficient, taking less than 7 minutes, 12 minutes, and 18 seconds, respectively, for models with 80B parameters. Lastly, it exhibits robustness against parameter overwriting, re-watermarking, forging, fine-tuning, and pruning attacks.

Vertical Federated Learning (VFL) effectively addresses the issue of data isolation, which makes data mining secure. Most VFL implementations rely on a single server or third party for training, which will be terminated if the server or third party fails. In addition, the model accuracy trained by VFL depends on the quality of the client’s local features; nevertheless, the client’s local feature quality is difficult to verify. There exists a chance that the features owned by the client are irrelevant to the model or the intermediate results submitted by the client are inaccurate, such that the model’s accuracy will be seriously affected. In order to solve the single point failure and model accuracy issues in VFL, this paper first proposes a Blockchain – based Decentralized VFL (BDVFL) training model. With the integration of blockchain and the VFL training process, the nodes within the blockchain are categorized into non-training and training nodes. Our method focuses on the scenario in which all training nodes possess labeled data and actively engage in the training procedure of VFL. To be specific, first, each client utilizes local features and initial models to carry out forward activation and generate intermediate results. Second, we randomly choose a training node and combine it with the intermediate results from all clients to formulate the loss function. Finally, each client updates the local model by using the gradient. To protect the raw features, a blinding factor is utilized for safeguarding the intermediate results submitted by the client, such that the training nodes cannot infer the local features from intermediate results. To mitigate the interference of irrelevant training outcomes from clients on the model’s accuracy, we propose a verifiable aggregation method to assess the validity of the intermediate results submitted by the clients. We have conducted both theoretical and experimental analysis, and the results demonstrate the effectiveness of the proposed method.

Encrypted traffic classification requires discriminative and robust traffic representation captured from content-invisible and imbalanced traffic data for accurate classification, which is challenging but indispensable to achieve network security and network management. The major limitation of existing solutions is that they highly rely on the deep features, which are overly dependent on data size and hard to generalize on unseen data. How to leverage the open-domain unlabeled traffic data to learn representation with strong generalization ability remains a key challenge. In this paper, we propose a new traffic representation model called Encrypted Traffic Bidirectional Encoder Representations from Transformer (ET-BERT), which pre-trains deep contextualized datagram-level representation from large-scale unlabeled data. The pre-trained model can be fine-tuned on a small number of task-specific labeled data and achieves state-of-the-art performance across five encrypted traffic classification tasks, remarkably pushing the F1 of ISCX-VPN-Service to 98.9% (5.2%↑), Cross-Platform (Android) to 92.5% (5.4%↑), CSTNET-TLS 1.3 to 97.4% (10.0%↑). Notably, we provide explanation of the empirically powerful pre-training model by analyzing the randomness of ciphers. It gives us insights in understanding the boundary of classification ability over encrypted traffic. The code is available at: https://github.com/linwhitehat/ET-BERT.