This is (most) of the anachronistic music featured in the game Bioshock Infinite.
In chronological order of release date.
Note: Some videos are from other uploaders due to copyright concerns. They sound exactly the same as within the game. The only missing song is by Al Jolson, Billy Rose, and Dave Dreyer - Me and My Shadow (1927).