You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Migrated from: goodfire-ai/spd-gf#45 Original author:@danbraunai
We'd like to be able to test SPD on tracr models. I'm not sure exactly which model we want, which type of tracer model we want, possibly multiple, but it would certainly be nice. The first step would just be to set up a new experiment, you can call it TRACER, and it should be able to handle any tracer model that we put in there.
Note that I believe some people have built on top of Tracer to make the weight matrices look more realistic. We probably wouldn't want to do this for the MVP. But it's worth keeping in mind.
I also recommend looking at InterpBench, as there may be models with ground truth that we could use from there.
Migrated from: goodfire-ai/spd-gf#45
Original author: @danbraunai
We'd like to be able to test SPD on tracr models. I'm not sure exactly which model we want, which type of tracer model we want, possibly multiple, but it would certainly be nice. The first step would just be to set up a new experiment, you can call it TRACER, and it should be able to handle any tracer model that we put in there.
Note that I believe some people have built on top of Tracer to make the weight matrices look more realistic. We probably wouldn't want to do this for the MVP. But it's worth keeping in mind.
I also recommend looking at InterpBench, as there may be models with ground truth that we could use from there.