Skip to content
dgDavid Gray
All work

ID3 mushroom classification

A from-scratch ID3 decision tree that predicts whether a mushroom is edible or poisonous from its attributes.

Type
School
Year
2020
Built with
Python · Decision trees · Information gain

A colleague and I implemented the ID3 algorithm from scratch, then trained it on mushroom attributes to classify each specimen as edible or poisonous.

Building a decision tree by hand — computing entropy and information gain at each split rather than calling a library — is the fastest way I know to understand why trees overfit, and why the split that looks most informative on training data is so often the one that betrays you.

Details and results are in the research report.

Let's talk

Have something hard that has to work?

Contract work, a full-time role, or a problem you want a second opinion on — I read every message and reply to the ones that aren't a template.

Email me

Usually replies within a day or two · St. Louis, Missouri