SOURCE-LINKED INTELLIGENCE

Auditing and Mitigating Privacy Leakage in Cloud-Edge Collaborative Decoding

arXiv · AI, language, vision and robotics · article · Aug 29, 2026 · UTC

Applications such as personalized assistance and proprietary document analysis require large language models (LLMs) to generate outputs from private data. Yet powerful LLMs typically cannot be deployed on the resource-constrained devices where private data resides, and uploading private data to cloud-hosted LLMs exposes sensitive information. Recent work addresses this tension with a cloud-edge collaborative decoding paradigm, where private data are kept on the edge with a small language model (SLM) producing next-token distributions, which are fused with predictions from a cloud LLM operating

Read original source ↗ Open in workspace

recordType

paper

region

Global