WhisperLeak is dead.

Open-source Rust proxy available now.

Constant-time · constant-size · dummy packets

Eliminates timing + length side channels in 7 days.

$cargo install isostream-proxy

Eliminate Side Channels.

An interactive look at data from our 600-prompt experiment.

TOPIC LEAKED

Apache 2.0 Licensed

100% OpenAI Streaming Compatible

Drop-in replacement with full support for OpenAI's streaming API.

<120ms Added Latency

Minimal performance impact, tested on 70B models for smooth operation.

Helm Chart & Docker

Easy deployment in any environment with standardized containers and charts.

Runs Anywhere

Fully compatible with Linux, macOS, and Windows Subsystem for Linux (WSL).

Remote attestation (NVIDIA CC, Nitro, Azure, SEV-SNP)

[████████▒▒]

85%

Client SDK + “IsoStream Secured” badge

[███████▒▒▒]

70%

TEE-Shielded Model Partitioning (TSDP)

[████▒▒▒▒▒▒]

40%

One-click Kubernetes operator

[██▒▒▒▒▒▒▒▒]

20%

Enterprise

Need attestation, audited builds, TSDP, SLA, or just want this to exist full-time?

The core proxy will stay free and open-source forever.

Everything that makes enterprises sleep at night is being built right now.

isostream/>