Reverse engineering intelligence with interpretability.
We're building aq, a development environment & framework to help build safer and better ML by reverse engineering and interpreting foundation models across physics, life sciences, industrial, scientific discovery, clinical, and safety-critical.
Backed by
awesome programs.
What labs build with aq
What researchers are solving with aq
IDE for Machine Learning
A workspace for training and reading models on a GPU you control, with the same precision as writing code. Load an LLM or embedding model, then inspect, simulate, compare checkpoints, and eval as the run unfolds.
Layer 12 residual
Loaded pythia-70m and pulled the residual at layer 12. The map is viridis, origin lower.
- Head 3 and 7 are the bright sinks.
- Feature
F4412at 0.84 is European capitals. F118(0.61) is proper nouns sitting under the same stripe.
ashm@Ashs-MacBook-Air nns % $ aqit load pythia-70m loading weights … ok device mps layers=12 d_model=512 $ aqit inspect --layer 12 residual [seq=48, 512] F4412 0.84 european capitals F118 0.61 proper nouns F902 0.44 country names $ python scripts/plot_attn.py imshow cmap=viridis origin=lower wrote figs/attn_l12.png ashm@Ashs-MacBook-Air nns % █
build models with same precision and intent as writing code.
Not sure if Aquin is right for you?
Policies & licensing
