George was born in Barney's River to James Cavanagh and Marion Leadbetter.He apprenticed with Donald Ross of New Glasgow as a joiner then moved to New York City in 1862 likely to find work as the city was actively building.He was very active in the unions and in 1873 was elected officer of the Working Men's Central Council. He was already President of the Almagamated Carpenters.

In 1889 he led the Labour Day Parade in New York City, 20,000 people marched.