"Ruffian" was an insult.
History
By 1587, Francis Drake was known to Philip II of Spain as "Elizabeth's ruffian pirate", having harried and pillaged Spanish ships bringing back treasures from the Americas. (AUDIO: The Flames of Cadiz [+]Loading...["The Flames of Cadiz (audio story)"])
In the latter half of the 20th century, Panda told Soo to "these uncultured ruffians to their own devices" while proposing to take her to a restaurant in Paris '62, referencing Sooty, Sweep, Matthew Corbett, and Iris Wildthyme. (PROSE: It's Raining Gin [+]Loading...{"page":"135","1":"It's Raining Gin (short story)"})