Heretic removes restrictions from language models (heretic-project.org)
26 points by Bluestein 6 hours ago
Tepix 6 minutes ago
Keep a close eye on abliterated and "heretic" open weight models. They will be outlawed first.
phoronixrly 7 minutes ago
Can the load-bearing gaps that are worth being flagged for pinning down be abliterated out of a model?
N_Lens 6 hours ago
Looks like a well engineered, automated abliteration pipeline. The claims seem a bit overstated though, since the metrics mentioned are cherrypicking refusal count and KL divergence, both of which make the outcome seem the most dramatic.
tacomagick 2 hours ago
I personally never saw much of a quality drop from models put through Heretic if that amounts to anything. They have been working quite well on small local models so far.