Analysis of Detective Fiction

Detective fiction is a curiously self-referential genre. Other genres may discuss themselves, for all I know, but this does seem to be a very common theme in detective stories. Sherlock Holmes talked about C. Auguste Dupin, Dorothy L. Sayers talked about the plot to one of the Father Brown stories in Busman’s Honeymoon, and both Agatha Christie and Sayers introduced successful female mystery writers as important characters into their stories. Moreover, more than one popular mystery writer wrote a list of rules for detective fiction, and The Detection Club had this initiation oath:

Do you promise that your detectives shall well and truly detect the crimes presented to them using those wits which it may please you to bestow upon them and not placing reliance on nor making use of Divine Revelation, Feminine Intuition, Mumbo Jumbo, Jiggery-Pokery, Coincidence, or Act of God?

It makes sense that a genre so thoroughly about analyzing people and situations should consider itself; indeed it does this both of curiosity and necessity. The necessity arises from the sort of game which is typical of mysteries, where the author “wins” if the reader does not guess the villain, but does blame himself and not the author once the detective’s reasoning is revealed. Once a trick has been used, readers are on the lookout for it and will probably spot it again. Conversely, because they are on the lookout for it, that expectation can be used to hoodwink the reader. Since both authors and readers play this game, both must analyze the stories written so far.

Especially in their early days, detective fiction did not garner a great deal of respect, even sometimes from its authors. Sir Arthur Conan Doyle actually killed his detective off in order get more time to write historical novels, and SS Van Dine lamented once his real name was revealed that he would never be taken seriously again. Charges that murder mysteries are unserious literature, or make sport of death, or a host of other complaints abound, though people who love mysteries abound more.

A Franciscan brother who is a philosophy professor and fan of murder mysteries (and spy thrillers) told me the following theory: in a murder, intelligence has been used for a wrong end, damaging the natural order of things. The murderer benefited unjustly from his crime, and since no man is an Island, all of society shares in this unjust benefit. (It also shares in the unjust harm of losing the victim, but that can’t be repaired.) The detective, through a right use of reason, untangles the web which was tangled by the murderer, and restores the right order of things. Once the murderer is brought to justice, the unjust benefit is removed and neither the murderer nor society by extension enjoys unjust benefit any longer. Murder mysteries are, therefore, symbolic of our redemption from sin.

I rather like this theory as it explains several things. First, it explains why it is acceptable when the detective catches the murderer but lets him escape when the murderer was doing no more than justice. A good example of this is Murder on the Orient Express. I think it was especially well done in that Poirot propounds two theories, one the misdirection which was intended and the other the true solution, and leaves it to the train manager to decide which to present to the police. In this way reason is used to pursue truth, and judgment is left to mercy. When Sherlock Holmes lets Ryder go free in The Blue Carbuncle, it lacks a little of this perfection because Holmes allows mercy to overrule truth, though I think it is made up for when Holmes points out that he is not retained by the police to remedy their deficiencies. Both because it is a good line, and because it does locate Homles’ mercy in the context of a fallen world that is not always strong enough to handle the truth well. The detective exists to restore the natural order, but in a fallen world that restoration must, perforce, be incomplete.

The other thing which this theory explains is why I so greatly dislike hardboiled detective fiction like The Maltese Falcon and The Big Sleep. (The Thin Man wasn’t as bad, but it wasn’t as hard boiled, either.) Chinatown (the movie with Jack Nicholson) was similarly awful. The detective does nothing to restore the right order injured by a misuse of intelligence. He just gets by, often by misusing his intelligence, and leaves the world as badly off has he found it, if typically not particularly worse, either. (Please note that all of the stories I mentioned were very skillfully told; they are very well done versions of what they are supposed to be. My objection is not to their execution but to their goal; to what they are supposed to be should not be done.)

I think that this theory of my friend is largely correct, and that it also explains why it is that those of us who love detective fiction love it so very much.

The Butler Did It?

By an unimportant series of coincidences, I was looking up the origins of the phrase “The butler did it.” The top two relevant results I got were for a trope on tvtropes.com and an article on Mental Floss. The tvtropes article links a Straight Dope on the same subject. All three note that examples of a murder mystery in which the butler was the murderer are rare, but what’s curious is that all three mention a list of rules for murder fiction which SS Van Dine (the pen name of the author who wrote the Philo Vance mysteries) wrote for American Magazine. Though I do have a sneaking suspicion that the two more recent ones may be based on the Straight Dope answer, it is odd that all three cite these rules of detective fiction as if they are authoritative either to what makes a good detective story or to what common tastes were.

Murder Mysteries have been popular for more than a hundred years now, and the idea that there are rules that everyone follows, or that all fans of the genre follows, is absurd. There have been commonalities to detective fiction, to be sure. Giving the readers enough clues to figure out who did it is very common, and very popular, but by no means universal among enjoyable detective fiction. Paranormal, supernatural, and other sorts of detective fiction have been popular. Solutions which could not possibly have been guessed by the reader can be enjoyable as the gradual revealing of an answer. I don’t tend to go for those myself, but pretending that one author’s preference in the 1920s is somehow normative doesn’t accomplish anything.

Within the context of mysteries which aim to be solvable by the reader, most rules (such as Knox’s 10 commandments) aim to give guidance to mystery writers for thinking about the construction of their mysteries. The rules are not meant in an absolute sense, but rather to give sign posts where extra thought is probably required. If the butler, rather than one of the guests, is the murderer, the writer will need to include him as a character enough that the reader thinks that it’s within the spirit of the story to consider the butler.

Now, some might object that it is snobbish to think that the butler is not a possible suspect because he’s just a servant, and indeed it would be, but all problems come with unstated rules, and solving them relies on knowing what these unstated rules are. Consider the classic illustration for teaching people to think outside of the box: Four dots, arranged like the corners of a square, with the instructions to “connect these four dots using only three straight lines without lifting your pen, ending where you started”. The classic solution is to use three lines forming a right triangle where one side goes through two vertices and the other two sides go through one vertex each. This is supposed to surprise people and teach them to “think outside the box” because the rules never said that the end of the lines have to be on one of the four dots. “Don’t limit yourself!” The self-help guru says cheerfully.

The problem with this conclusion is that these sorts of problems are trivial if we’re not helping the person who stated the problem by figuring out what the rules they didn’t state are. No thought would be involved if I just picked up a paint brush and connected all four lines with one thick line. I could even hold my pen against the paper the whole time. Some versions of this mention to not fold the paper; but I haven’t see any rules against cutting and taping the paper. The rules never specified a euclidean geometry; one could easily draw a square then define a geometry in which there were only three straight lines. One could draw new dots and point out that the rules did specify which four dots were the four it was talking about. I could draw three unconnected lines with a pencil while never lifting a pen. etc.

The people who hold this question up as a major revelation are actually practicing a cheap parlor trick. They are really just asking you to try to read their mind and magically know which implied rule they are suspending without telling you. If you were to draw three straight lines plus one curved line, they would balk, rather than applauding you for your willingness to think outside the box in the way that they wanted you to.

The same problem can apply to the butler as the culprit. It would be too easy to assume that the servants are off limits as suspects simply because they all have the opportunity to commit the murder without being noticed, and since detective fiction so often focuses so heavily on alibis, figuring out who had the opportunity is often a large part of the puzzle. Hence this complaint in the tvtropes article:

The butler is the avatar of the most unlikely suspect that, of course, turns out to be guilty because the author wasn’t creative enough to come up with a better way to surprise the reader.

This is a problem only if the butler is the least likely suspect because no time was spent on the butler. Authors who don’t figure out the mystery ahead of the detective, and so who come to the reveal and then have to solve the puzzle for themselves, as it was written so far in order to come up with the ending can run into this. The butler is a good candidate both because he would be surprising since he wasn’t a real character up to this point, and because the servants all have means and opportunity for murder in a great house. This is cheating according to the rules the author implied; to do a good job making the butler the culprit, the author would have had to include the butler as a character in a way that made it clear he wasn’t off limits.

I suspect that this is primarily a problem in mysteries where the author doesn’t know who the culprit is, because it’s all too easy as the evidence is being discovered and alibis are being produced to have accidentally ruled out all of the actual suspects by the end. If that happens, the author will need to introduce a previous non-character who hasn’t been ruled out simply because the author hadn’t thought of the character as a suspect before. I can’t see how such a story can be well crafted; if the author doesn’t know what’s going on, it seems far too likely the story will be inconsistent and not hang together well, though for any technique there is probably someone who can pull it off decently.

But for an example of art criticism which simply wants there to be rules in order to make the task of art criticism easier, consider this from the Mental Floss article:

While The Door was a hit for Rinehart and her sons, who released it through a publishing house they’d just started up, her pinning the crime on the butler has gone down in history as a serious misstep…That The Door was a commercial success while flaunting a hallmark of what some considered lousy mystery writing made it an easy target for jokes. Stories and books like “What, No Butler?” and The Butler Did It soon turned murderous manservants into shorthand for a cheap ending.

Of course this attempt to invoke normative rules of fiction makes heavy use of the passive voice. “Has gone down in history as a serious misstep,” and “flaunting a hallmark of what some considered lousy mystery writing” buys authority with anonymity. There are indeed things which do not need to be attributed—that people will talk about the weather in default of another topic in common does not need to be established with evidence—but common opinion of literary techniques certainly doesn’t fall into that category.

This attempt to have rules of fiction, or more properly rules of art criticism, is not really about the fiction. It is about the desire for stability and intelligibility by a person not willing to do the work of understanding, or without the courage of owning up to their own prejudices and so attempting to displace those preferences onto everyone else.

Incidentally, I looked up the two works cited. “What, No Butler?” seems to be a short story by Damon Runyon. I can’t find much information about it; according to Wikipedia it was in a book called Runyon on Broadway. It was performed on radio in 1946 and that performance is available on youtube. I don’t know when it was originally published. The story does have humor in it, but to call it satire seems like quite a stretch. Early in the story, the character Broadway (who I believe is a theater critic) says authoritatively upon finding out that a man was murdered that the butler did it. When he’s told that the victim didn’t have a butler, he insists that they have to find the butler, because in every play he sees with a murder in it, the butler did it. No one pays attention and he is dismissed because this is stupid advice. In the end we learn that the murderer was a neighbor of the victim, who heard that the victim was rich and so he broke in to the apartment with a duplicated key and killed the victim when he was caught in the act. When asked why he would stoop to robbery, he explained that he was out of work and wasn’t likely to get it again soon. He had served some of the best families in New York, and couldn’t accept just any old employer, because he was an excellent butler. Very clearly, in context, this was not a criticism of the butler as a culprit, but playing with the audience’s expectations to set up a joke.

In 1957 P.G. Wodehouse published a book called Something Fishy. When Simon & Schuster published it in America they used the title,  The Butler Did It. Wikipedia gave this plot summary:

The plot concerns a tontine formed by a group of wealthy men weeks before the 1929 stock market crash, and a butler named Keggs who, having overheard the planning of the scheme, years later decides to try to make money out of his knowledge.

(Tontines are in themselves an interesting read. It’s easy to see why they would show up frequently in older detective literature.)

According to the further description of the plot, Keggs is long retired by the time the book takes place. His being a butler is incidental to the story, so far as I can tell, and doesn’t seem like it can be taken as any sort of criticism of detective fiction where the butler is the murderer. This seems doubly true given that The Butler Did It was not the original title, and was only changed because it would resonate better with Americans.

And now that I mention that, it occurs to me that all of the discussion of butlers, from Rhinehart’s story to the supposed criticism of it is all American. Aside from Poe’s character of Dupin starting the genre of detective fiction, much of the most influential detective fiction is British. Now I wonder whether “the butler did it” is a primarily American phenomenon. In any event it does seem to be a very curious example of a saying without much basis, used at least as often to joke about the saying as even to say anything about detective stories.

If I had to guess, I suspect that it originated with someone who was complaining that detective fiction is very formulaic. If so, it is ironic that they picked to exemplify this putative formula a feature which is extremely uncommon in detective fiction.

Having said that, it occurs to me that this idea could even have originated to mean nearly the opposite. It could have started as a parody of the sort of person who doesn’t know how detective fiction goes, and who leaps to the butler as the obvious suspect because he had the means an opportunity for the murder. It would make a more effective criticism of a naive reader than of murder mysteries. “Pffh. He’s the sort of guy who decides ten pages in that the butler did it!” As it stands, I see no more evidence for any other theory of where the phrase came from.

 

Intelligent Murder Mystery Suspects

I’ve recently watched the episodes in the thirteenth and final series of Agatha Christie’s Poirot, starring David Suchet. It included Curtain, which of course must be the last episode, but it had several episodes which differed very greatly from their source material. In particular, The Big Four and The Labours of Hercules.

The former was described by the screenwriter as an unadaptable mess, which it certainly seems to be looking at the plot summary. It is basically a spy thriller with dozens of characters set throughout Europe, which is not very viable for a TV show, even if it is nearly two hours long. The one which really interests me, though, is The Labours of Hercules. The original is a collection of twelve unrelated short stories, which the screenwriter turned into a single long-form mystery by taking one of the stories as the central one and using several of the other stories as the red herrings which one expects in a Christie novel. At this point, I should warn you that this post will include spoilers. You have been warned.

Given what a challenging prospect that is, the writer did a good job, but there were problems in the story which I do not think were avoidable for structural reasons. As everyone knows, a murder mystery must have suspects, with the plural being imperative. Every man having free will, anyone who was anywhere near the victim is a suspect, which is why an isolated setting—a mansion, a private island, etc.—is so interesting. Unless the author is cheating, the suspect list is known at the outset. When doing this, the author must be very careful to make all of the suspects believable suspects. That’s a universal criteria, but a murder in the middle of a city means that we see a great deal less of the suspects, so each one has far greater scope for unseen action, including accomplices we don’t know about yet, than people in an isolated setting.

The episode, The Labours of Hercules, was set in a hotel on the top of a mountain in Switzerland, with the funicular train that is their only link to the outside world having been shut down by an avalanche. Short of a ship in the middle of the Atlantic ocean or an aeroplane in the sky, it’s about as isolated as it is possible to get.

The central mystery, though Poirot stumbles onto it almost by accident, is the identity of a psychopathic killer and thief called Marrascaud. The mystery was set up in the beginning where Marrascaud managed to kill several people and steal several valuable items—one of them a large painting—from a crowded building, with disguised policemen and Poirot himself protecting them. From this we know that Marrascaud is a genius on a level with Poirot, and this forms the central problem once we get to the hotel.

As has been observed in countless murder mysteries, the best place to hide a leaf is in a forest; to hide a genius one must really put them amongst other geniuses, but the characters at the hotel were taken from other stories and thus had qualities appropriate to those stories, none of which involved unique genius. In this case, the beautiful daughter of Poirot’s former love interest who is fascinated with criminology stands out almost like a sore thumb; the only other person who comes close is the Countess Rossakoff, her mother, but it was very clearly established in the previous episode where we met the Countess that the character is not a murderer. Marrascaud kills for the pleasure of it, brutally, which is not something one degenerates to in old age. It is true that one can be cruel vicariously, through underlings, in old age, but it does not make sense as a personality change to go from an honorable thief to a psychopath who delights in killing.

An interest in criminology is also something of a red flag in a suspect. Though everything has by this time been used as a false flag in detective fiction, none the less the similarity of the violent nature of both crime and law enforcement is unavoidable. As the saying goes, the main thing which distinguishes a sheep dog from a wolf is who it bites. None of the other guests seemed sufficiently… canine.

I think that this is the reason why Conan Doyle put Moriarty as the mastermind, behind the scenes. The proxy of an evil genius need only be of ordinary intelligence, which makes it far easier for him to blend in. Indeed, executing a plan which requires greater intelligence than he himself possesses serves as a form of camouflage for the immediate villain. Still, as bumbling accomplices have long shown, it is best to choose someone intelligent enough to understand the plan once it has been created; an accomplice who can understand only his part and not what it fits into will make mistakes that will prove the undoing of both.

I think that fact is why some villains have tried to manipulate their accomplice into helping without realizing it; if done well the mistakes of the unwitting accomplice actually hide the involvement of the mastermind. I suspect that this is the ideal strategy for the criminal mastermind; it is the safest type of plan if a brilliant detective shows up. If done extremely skillfully, it is possible to conceal that there even is a brilliant plan at work; the brilliance can be disguised as coincidence.

Of course, mysteries can go the other way—the more realistic way—where the detective must make sense of genuine coincidences. The problem with writing this sort of mystery is that it is extremely difficult to pull off without the detective himself getting lucky. And while a comedic detective—Inspector Clouseau, for example, or taking the idea of a detective very loosely, Maxwell Smart—can stumble onto all of his solutions, it’s not entertaining if a serious detective does that. Though, I should mention that this is why Jessica Fletcher almost invariably figures out the solution of most episodes by chance. In order to make Murder, She Wrote accessible to a general audience, the writers would tend to throw in enough clues that one should be able to figure out the solution before Jessica does. Since Jessica does have to figure out the mystery, something must make her realize the solution, and because we the audience are supposed to already get it, it can’t be the last piece of critical evidence, but nor can it be slam-dunk evidence, because then you couldn’t feel smart during the reveal. So it’s usually something silly somebody says, and then Jessica says, “Wait, say that again? Of course! That’s it!” That’s not literally every episode, but it is basically a structural requirement imposed by the show’s relationship with its audience.

The solution to the mystery depending on figuring out coincidence without the detective merely getting lucky is typically easiest to pull off through exhaustive leg-work—checking every chemist’s shop in a 30 mile radius, that sort of thing. This is why that sort of mystery is most common when the detective is a public detective (i.e. a member of the police) rather than a private detective, or at least when the police and the detective are working together, rather than separately. And even then, Sherlock Holmes had his Baker Street irregulars.

The other approach, which is a compromise that keeps things closer to a  detective the reader can relate to, is for the detective to have something to go upon which through intelligence, knowledge, and wisdom allows him to rank coincidental possibilities according to an order they are likely to have happened, and to be right according to a Poisson distribution (basically, they usually get an answer by their third try to verify a coincidence, sometimes it takes a lot of tries, and because no one has infinite effort to give, sometimes they don’t get an answer). Fundamentally this is still the detective getting lucky, but it is a way for the detective to earn his luck. Since the detective doesn’t create the clues but only discovers them, that’s the best he can do in any case.