Keep as many books as you can afford/reasonably store. One thing I loved about homeschooling was having so many fascinating books at my fingertips, and I could pick another one whenever I got bored.
I think that did as much for my homeschooling as any formal homeschooling we did.
Also, never underestimate the value of butcher paper as a teaching tool. Timelines, human bodies, art--anything.