Thomas Jefferson literally sliced up a bible to produce a version of the Jesus narrative without all the miracles! The founders were busily questioning their own traditions at the time.

https://en.wikipedia.org/wiki/Jefferson_Bible?wprov=sfla1

Theodore Roosevelt was sworn in without a Bible:

https://guides.loc.gov/presidential-inaugurations/1897-1925#...