Thousands of VERY tiny bugs on wooden bedside table and all over books?

They're probably termites. I'm pretty sure they don't sell anything in store that 100% gets rid of them, so you should call an exterminator.