The intersection looked very different in 1936. This is an awesome photo that we dug up at the Library of Congress.
Historic American Buildings Survey E. H. Pickering, Photographer September 1936 – Lee & South Charles Street (Brick Row Houses), Baltimore
Source: Library of Congress