The name is popularly tied to a cook called Joe in the early 20th century, but nobody really knows. Loose meat sandwiches were common across the Midwest.
Joe remains a mystery.