When is Scrap Just Too Small?

In the heat of the moment, every scrap of wood seems like it could be useful. Now it’s time for some spring cleaning. What are your guidelines for what gets tossed?