Started in 1866, the pennitentary was one of the first two public buildings constructed in the new state of West Virginia. The first building was 'Weston', an insane ayslum.