Not a house, but we have family farmland in IL that was bought in 20 acre sections in the 1850s-60s and has Abraham Lincoln's stamp on the deed. He was IL governor at the time before becoming president.
I also found an old baseball and kids writing homework dated 1858 in the wall of a house that I remodeled.... The house was in the historic district and had beautiful lines and woodwork, but had been converted into a multi family with apartments. We were converting the attic into a loft apartment. The rafters were hand hewn with an adz, which I thought was pretty neat. I was tearing out the old wooden window sill when i found the baseball and paper. It was in essence a writing assignment, where the boy (signed William) had written something like "I walk my dog." But multiple times. We thought it was pretty neat and set it off to the side with plans to donate it to the local museum. However, our helper that was carrying out all the debris from the demolition accidentally threw it in the trash!
I have lived in a few other historic home and the only other notable thing is that they are very drafty and expensive to heat and cool.