Reimplementing the Inference Algorithms in Stan

I’ve wanted to rewrite the inference algorithms in Stan for many years. It’s one of those things that was never urgent enough to warrant the effort, but entering 2022, I have some spare time that I will dedicate to this project. (Also, publicly writing this down will force me to work on it.)

Photo by Alexander Andrews on Unsplash

Why would I want to do this?
The code is hard to read, understand, and modify. Don’t get me wrong: it works and is fairly optimized. But in software development — especially open-source development — it’s worth the effort to enable existing and future contributions to the code base. This part of the Stan code base has been pretty stagnant.

I would love to get to a place where the algorithm API could be redesigned safely and sanely. Or add more features like checkpointing and updating the warmup phase. Or making it easier to add and remove different inference algorithms.

Some of the benefits of doing this:

What next?
The work will be done in this repository: https://github.com/syclik/stan-algorithms

Implementing algorithms, especially when there’s a dependence on a random number generator, is hard. I’ll start by creating a test suite, instantiating the existing Stan algorithms code, and working on making little reproducible code tests that will allow me to work in fast iterations. Debugging and tracing through C++ code isn’t the easiest, but I’ve done it before and know what I’m looking for.

I’ll post updates as I make progress.

Do you want to help?
If this is of interest to you, please reach out. I’m happy to collaborate! You’ll need to know C++, but not necessarily the algorithms by heart. We’ll break that down as we go along.

--

--

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store
Daniel Lee

Ramblings of a statistician, dj, basketball theorist. Stan developer (mc-stan.org). Former CTO at Generable.