Policies & licensing
Reverse engineering intelligence with interpretability.
at Aquin Labs, We're reverse engineering and interpreting to help build better ML across foundation models for physics, life sciences, industrial, scientific discovery, clinical, and safety-critical.
Backed by
awesome programs.
Working with labs and research partners.
We solve hard problems.
AQIT (Aquin Interpretability Tooling)
aquinf03/AQITdocsapplied researchWe built mechanistic interpretability tooling that runs on a local GPU. Load an LLM or embedding model, then inspect, simulate a train, diff checkpoints, steer, watch a live run, and eval. SAE capture, train, and align; weight and residue diffs; red-team and custom evals.
IDE for Machine Learning
A workspace for training and reading models on a GPU you control, with the same precision as writing code. Load an LLM or embedding model, then inspect, simulate, compare checkpoints, and eval as the run unfolds.
Layer 12 residual
Loaded pythia-70m and pulled the residual at layer 12. The map is viridis, origin lower.
- Head 3 and 7 are the bright sinks.
- Feature
F4412at 0.84 is European capitals. F118(0.61) is proper nouns sitting under the same stripe.
ashm@Ashs-MacBook-Air nns % $ aqit load pythia-70m loading weights … ok device mps layers=12 d_model=512 $ aqit inspect --layer 12 residual [seq=48, 512] F4412 0.84 european capitals F118 0.61 proper nouns F902 0.44 country names $ python scripts/plot_attn.py imshow cmap=viridis origin=lower wrote figs/attn_l12.png ashm@Ashs-MacBook-Air nns % █
develop + research with precision
build models with same precision as writing code.
build models with intent by locating, debugging, simulating and improving.
Work with us
Interpretability tooling, custom SAE databases, mechanistic audits, circuit reports, and hands-on research, experiments, and studies for teams of all sizes. Reach us at aquin@aquin.app
Not sure if Aquin is right for you?
Policies & licensing
