Nov. 17, 2023, 1:48 a.m. |


ePrint Report: Secure Transformer Inference

Mu Yuan, Lan Zhang, Xiang-Yang Li

We present a three-party protocol that can protect both Transformer parameters and user data during the inference phase. For each feedforward inference process, our protocol only introduces permutation computation of input and output data on the user side. Our protocol, Secure Transformer Inference Protocol (STIP), can be applied to real-world services like ChatGPT.

computation data eprint report input lan party process protect protocol report user data

Security Specialist

@ Protect Democracy | Remote, US

Sr Staff Software Engineer (L7- Network Security)

@ Palo Alto Networks | Santa Clara, CA, United States

Cyber Threat Analyst, Senior

@ ManTech | 221BQ - Cstmr Site,Springfield,VA

Security Architect

@ Netcompany | Birmingham, United Kingdom

Sr. Security Architect

@ Datavant | Remote, United States

Cybersecurity Services Sales Executive

@ Rockwell Automation | United States of America Milwaukee (South 2nd Street)