Both families owned slaves but the way I see it, atleast the Grays didn't resort to selling moonshine to the Lemoyne Raiders for the local mafia, kidnapping a child, or locking their children in outhouses to hide them.
Sean burned their crops and murdered a bunch of the guards at Caliga Hall, the slave thing is obviously inexcusable but they were justified in executing him like they did
@GoldenPegasus5 I still think in their prime days they were even more ruthless than braithwaites although braithwaites kidnapped Jack. Grays probably do that good guy act because in the past they probably exploited so many slaves