Using Codex for education at Dagster Labs

For the complete documentation index, see llms.txt. Markdown versions of documentation pages are available by appending .md to the page URL.

At Dagster Labs, we produce a lot of technical educational content for data engineers, machine learning engineers, and analysts to better understand how to use Dagster, an open source workflow orchestration framework. Because our users come from varied technical backgrounds, we’ve found it essential to meet each persona at the right technical depth.

In this post, I’ll share how we use OpenAI’s Codex to accelerate documentation, translate content across mediums, and even measure how complete our docs are.

The power of CONTRIBUTING.md files

To make it easier for our community members and internal engineers to contribute documentation, we overhauled our CONTRIBUTING.md file. To our surprise, we had inadvertently significantly improved the utility of Codex. It turns out there is serious value in clearly outlining the hierarchy, structure, and best practices for writing documentation in your code base. Both for humans and robots.