BasedAI: A decentralized P2P network for Zero Knowledge Large Language Models (ZK-LLMs)

arXiv:2403.01008v1 Announce Type: new
Abstract: BasedAI is a distributed network of machines which introduces decentralized infrastructure capable of integrating Fully Homomorphic Encryption (FHE) with any large language model (LLM) connected to its network. The proposed framework embeds a default mechanism, called "Cerberus Squeezing", into the mining process which enables the transformation of a standard LLMs into encrypted zero-knowledge LLMs, or "ZK-LLMs", leveraging insights from generative adversarial networks for data privacy. This novel quantization mechanism empowers BasedAI miners to process and …

arxiv called cerberus connected cs.cr cs.ir decentralized default distributed distributed network encryption fhe framework fully homomorphic encryption homomorphic encryption infrastructure knowledge language language models large large language model llm llms machines mechanism mining network p2p process zero knowledge