Roby is the home of Steve Carriker, a Democratic former member of both houses of the Texas State Legislature.
In 1885, shortly after Fisher County was organized, a dispute arose between business partners from Mississippi and a town called Fisher. Both wanted their land to host the courthouse. The partners were M.L. and D.C. Roby, and the town of Fisher is now called North Roby.