Soft Prompts are a Convex Set

Mechanistic interpretability project from the Mechanistic Interpretability Hackathon that studies properties of soft-tuning or prompt-tuning and empirically shows that task tokens can form a convex set.

Endorsements support MentaLeap.

No endorsements yet.

Discussion

Start Date

-

End Date

-

Expected Duration

-

Funding Raised to Date

-