Per Rhu_Ru, here's a collection of thousands of 78rpm records and cylinder recordings released in the early 20th century. Could be a deep rabbit hole.
On that topic, what are some of your favorite old-timey recordings? I'm guessing CH has a few in mind. Can't say I have a lot myself, though I was always partial to Mississippi John Hurt.