James Baker had premises at 36 and 37 Dudley Street, and also in Walsall Street, Wolverhampton, which became too small for the rapidly expanding business. They needed a larger factory where they could employ around 500 people. James and Elizabeth Baker acquired land alongside Cleveland Road and Vicarage Road on which to build a new factory. The foundation stone for the building was laid by Elizabeth Baker on the 30th June, 1868.

Mr. and Mrs. Baker lived in the house in Cleveland Road. The factory was extended to Powlett Street in 1898 by which time they produced around 341,000 pairs of boots and shoes annually. After James’ death, the business was run by two of their sons, T. G. and W. P. Baker.

The business started out by producing hard-wearing industrial footwear, but later moved to the production of ladies' and gentleman’s boots and shoes. The factory closed in the early 1970s after being taken over and has since been occupied by several businesses. It was Grade II listed on the 31st March, 1995 and by 2008 was greatly restored. The site is now used by a wide range of businesses and includes a number of open plan office suites.