So long as there's nothing directly magical about the book itself, it certainly should be. In the end, that call is down to @DragonParadox but spellbooks aren't magical that way, imo.
I can confirm that yes a spellbook is not intrinsically magical, though they certainly can be enchanted.