Well it turns out that the much talked about ancestor of actor Ben Affleck that was a supposed slave owner, didn't own any slaves after all. The Daily Beast reports that Benjamin L. Cole was actually a trustee who would hold slaves until younger relatives became of age to take them. He was not allowed to profit from them whatsoever. Nonetheless, he supported the industry and was still no angel…Eleven other ancestors of Affleck's did own slaves however.