Nineteenth-century writers were an intriguing mix of curiosity and prejudice; modern writers are equally prejudiced, but not in a good way