While I was part of Purdue’s The Data Mine, I built tdmscrape to avoid formatting each project notebook by hand. It was my first Go project. It preserves the assignment’s questions and subquestions from The Examples Book and adds empty code cells and response areas. Here’s a picture!

Data Mine Scraper architectureA Go CLI scrapes assignment HTML and collects notebook details, then combines them into Markdown cells and uses Pandoc to create a Jupyter notebook.

tdmscrape

Query user for: name + project details
Bubble Tea

Parse HTML response & generate Markdown

Pandoc
.md → .ipynb

Jupyter notebook

Flowchart of Logic in the scraping tool