His wife Mary Gurley was the daughter of Peter Gurley of St. Vincent.[2] Their sons Peter Baillie, Hugh Duncan Baillie and James Evan Baillie all became members of parliament. Baillie's brother James Baillie was also an MP and West Indies merchant.
: