That is correct slayer spellbook will not effect wither.
Seems to be ongoing arguement on whether SDI effects wither but from what ive seen if I equip a Scrappers (+SDI standard on this book) I always see an increase in my wither damage, thats the book i equip when wither storming