Large Language Models (LLMs) excel in various domains but pose inherent privacy risks.Existing methods to evaluate privacy leakage in LLMs often use memorized prefixes or simple instructions to extract data, both of which well-alignment models can easily block.Meanwhile, Jailbreak attacks bypass LLM safety mechanisms to generate harmful content, but their role in privacy scenarios remains underexplored.In this paper, we examine the effectiveness of jailbreak attacks in extracting sensitive information, bridging privacy leakage and jailbreak attacks in LLMs.Moreover, we propose PIG, a novel framework targeting Personally Identifiable Information (PII) and addressing the limitations of current jailbreak methods.Specifically, PIG identifies PII entities and their types in privacy queries, uses in-context learning to build a privacy context, and iteratively updates it with three gradient-based strategies to elicit target PII.We evaluate PIG and existing jailbreak methods using two privacy-related datasets.Experiments on four white-box and two blackbox LLMs show that PIG outperforms baseline methods and achieves state-of-the-art (SoTA) results.The results underscore significant privacy risks in LLMs, emphasizing the need for stronger safeguards.

The rise of Large Language Models (LLMs) has heightened concerns about the misuse of AI-generated text, making watermarking a promising solution.Mainstream watermarking schemes for LLMs fall into two categories: logits-based and sampling-based.However, current schemes entail trade-offs among robustness, text quality, and security.To mitigate this, we integrate logits-based and sampling-based schemes, harnessing their respective strengths to achieve synergy.In this paper, we propose a versatile symbiotic watermarking framework with three strategies: serial, parallel, and hybrid.The hybrid framework adaptively embeds watermarks using token entropy and semantic entropy, optimizing the balance between detectability, robustness, text quality, and security.Furthermore, we validate our approach through comprehensive experiments on various datasets and models.Experimental results indicate that our method outperforms existing baselines and achieves state-of-the-art (SOTA) performance.We believe this framework provides novel insights into diverse watermarking paradigms.Our code is available at https://github.com/redwyd/SymMark.