Work with us
Work with us
We work with students, early-career researchers, and established scholars. If any of this interests you, write to either of us and tell us a little about yourself and what you would like to work on.
Who we work with
Students and early-career researchers
Prospective graduate students can apply to the philosophy PhD programs at UNC and Carnegie Mellon. Applications for fall 2027 admission are open until December 15 at UNC and January 8 at Carnegie Mellon. Researchers elsewhere can work with us through the fellowships and programs we mentor in, listed below.
Established researchers
We want to work with established researchers whose work bears on ours. That can be a joint paper or a longer project.
Mentoring
Aydin Mohseni
- Advises students at Carnegie Mellon
- Mentors through SPAR
- Teaches graduate and undergraduate courses on decision theory, game theory, and AI
Current and past students and mentees are listed on the People page.
Example questions
Some questions from our current work, by research area.
Agency
- Under what assumptions about a system’s goals and its environment does power-seeking follow from pursuing almost any goal, and which of those assumptions, dropped, make it fail?
- If we cut the channels two copies of a model use to communicate, can they still coordinate? Causal and evidential decision theories predict different answers.
- What would show that a system treats an outcome as within its control, and can we read that off its beliefs and desires?
Interpretability
- A model seems to fail an eval for a dangerous capability. If we think the model can tell it is being tested, how reliable is the eval?
- How must some internal structure of an LLM relate to its behavior for that structure to play a certain functional role?
- How do we ensure that the features we think we find in an LLM correspond to how the LLM thinks about things, as opposed to reflecting categories we project onto the LLM?
Value
- Reinforcement learning from human feedback (RLHF) and model constitutions already settle whose feedback counts and how conflicts are resolved. Which aggregation rules do they assume, and how should those rules be compared?
- How should AI systems make decisions on our behalf when they are uncertain of our preferences?
- How should an AI system aggregate several dimensions of value when they are difficult to compare?
Alignment
- When do capabilities help offset the cost of misalignment, and when do they increase the cost of misalignment?
- It is difficult to specify exactly what we care about, so we often use proxies. These tend to work only under certain conditions. How far outside those conditions can a system optimize a proxy before the person it acts for is worse off?
- How can we choose whether or not to deploy a system, given that we are uncertain how it will behave and what problems it will face?
Contact