I finally got a toe hold into his ansestery. His great-grand father (fathers, mothers, father) was a slave merchant. so maybe he wasn't pulling my leg, after all.
But then, he also said we were related to jefferson davis, and I haven't found anything to substaniate that at all. Unless it goes in side ways, via a marrage, that i haven't found yet.