In 2017-19, about 18 of my research articles were retracted. These retractions offer some useful lessons to scholars, and they also offer some useful next steps to those who want to publish in the social sciences. Two of these steps include 1) Choose a publishable topic, and 2) have a rough mental roadmap of what the finished paper might look. That is, what’s the positioning, the study, and the possible contribution.
The topics I’ve described here offer one set of roadmaps that could be useful. First, they were of interest to journals in medicine, behavioral economics, marketing, nutrition, psychology, health, and consumer behavior. Second, they each show what a finished paper might look like. They show the positioning, relevant background research, methodological tips, and key implications.
Table 1 and Appendix A lay out an estimate of how much effort it might take to do studies on these topics, and I’ve also estimated what I think the practical impact each research project might have. These are my own subjective estimates, but you might find them a useful starting point if you’re looking for a tie-breaker between two different topics.
I would strongly encourage anyone who’s interested in publishing in these areas to closely follow principles of open science, from preregistration of hypotheses and analytic strategies to open materials and open data. Making specific hypotheses and testing them by following open science principles will be the best next way forward. A good introduction to these principles, along with hands-on advice, is this: Klein, O., Hardwicke, T. E., Aust, F., Breuer, J., Danielsson, H., Hofelich Mohr, A., … Frank, M. C. (2018). A practical guide for transparency in psychological science. Collabra: Psychology, 4(1), 20. DOI: http://doi.org/10.1525/collabra.158
Academia can be a tremendously rewarding career both you and for the people who benefit from you research. Best wishes in moving topics like these forward, and best wishes on a great career.
• Non-native English speakers and shy students have a hard time participating in large classes. Class Previews help them. An hour before each class, I hold a Class Preview that tells people the discussion questions I’ll be asking that day, and then we discuss them ahead of time. Anyone’s welcome to show up.
• For large classes, try to have TA office hours every day (or M-Th)
• Try to be super specific about what you expect for an A assignment, and what your policy is on late assignments and missed classes.
• Rather than having both the final exam and their project due at the end of the semester, I frontload the course with the most work and move their project up to the half-way point.
• Letting students drop their lowest scoring assignment reduces their anxiety and the pressure they feel.
• By having students turn in two copies of their project (one to grade and one to file), it helps ensure the same projects don’t show up year after year.
• I have a screen-down, no-laptop policy. If people say they are taking notes, I ask them to send me the notes after class to see if what I’m teaching is coming across like I hope.
• Class insight cards can give class contribution points to well-prepared, but shy students.
• Extra credit opportunities are great. They help reduce student anxiety.
• If your course is cross-listed with both undergrads and grads, the graduate students will need to do something more (usually about 20-25% more). I also have four specialized class sessions (and a dinner) only for them.
• I try to organize the course into very discrete sections. This way I can frequently review each section in class before I start a new one. This way it very discretely shows how the parts of the course build on each other.
• The Final Project was renamed “Integrative Assignment” and moved to the middle of the semester. They have to work a lot harder early on in the course, but the quality goes up, and their Finals Week stress level goes down.
• You can get the most from a guest speaker’s visit if – before class -- you require students to read something written and published about the guest speaker. (It also makes the guest speaker more of a celebrity). On the day they speak, I will usually show a short Youtube clip of them before introducing them.
• I want the last class session of the semester to be valuable. After they turn in their exam and their course evaluations, I give them the option to leave. For those who stay, I tell them stories of two big lessons I learned in life (the hard way), and how they can deal with challenges in the future. It’s an unusual way to end the class, but it always ends it on a high and memorable note.
Good luck writing a great syllabus, having a great course, and having a triple-great semester.
I went to a super small college in a super small town, and I clearly remember my advisor having me and my college sweetheart over to his home for ice cream on the day I finished my senior project. That reconfirmed to me that I wanted to be a professor. When I was in my master’s program, three of my professors each had us over to their homes for dinner on the last day of the classes. I still remember where I sat and what we talked about.
Over the past 30 years I’ve had way over 200 dinners or parties at my home with graduate students, visiting scholars, summer interns, teaching assistants (TAs), advisees, lab teammates, and so on. The last class session of every graduate class is a dinner, we have welcoming parties for any new person in the Lab (and going away parties when they leave), we celebrate every time we get a major grant by having a party, and when I have a speaker or colleague in from out of town we’ll usually also invite a student or two for dinner with them.
These dinners and parties were always lots of fun. They created of team committment, a lot of good “buzz” (people really wanted to be TAs), people felt very quickly accepted and valued, lab members felt appreciated, and so on.
Looking back, I also think a lot of things could have gone wrong that fortunately didn’t. There was sometimes lots of wine, they’d sometimes last really late, and they were sometimes pretty loud. Sometimes people brought musical instruments and we jammed, sometimes people turned the stereo up to 11, and sometimes neighbors complained. Most of my colleagues tend to not have students over to their homes, partly because of what they imagine could go wrong. They're partly right, but that's largely a shame. There's a solution.
Over the years as I started seeing how different things could spin off the tracks, I gradually started coming up with little rules of thumb I’d use to try and keep things in check. About 10 years ago, I finally honed in on some guidelines that have luckily worked for me. For new summer interns or graduate students, I’ll do them all. For long-term employees or post-docs, I'm more liberal:
 Put a start and ending time on the invitation (like 6:00 to 9:00)
 Have lots of interesting nonalcoholic things to drink
 If there's going to be alcohol, only serve wine
 Only offer the equivalent of 1 glass per person.
(People will often bring other wine or beer, but this usually keeps things in hand)
 Keep everybody on the main floor or on the back deck (and close other doors)
 If there are still females around after 9:00, make sure my wife stays up until they leave
 At 9:00, turn the music off and don’t open any more wine
Now, I used to have none of these rules. I remember when I was a single 30-year old MBA professor, and I was having 26-year old Dartmouth MBA students over to my apartment for end-of-semester dinner parties, there’s a number of things that could have gone wrong. Fortunately they didn't, but these guidelines would have good idea.
My best memories as a student were when professors had me over to their homes. I admired them, and I wanted to be like them. Being invited over, made me feel like part of an inner academic circle. It might not mean anything to some students, but it might also be remembered by others 40 years later.
Tomorrow I retire from Cornell; it will be two days after I turned 59. My Mom and Dad both retired from their union jobs within days of their birthdays, and I never remember them saying much about their jobs after that day. Someone else took my Dad’s place on the production line, and someone else took my Mom’s place filing papers.
But academia is different. It’s one profession you never really have to retire from. A lot of us have a lot to say, and we’re passionate about saying it even when we’re officially through with our job. Many academics imagine themselves retiring in their early 70s, and even them maybe only transitioning to half-time until they befuddle us by changing the lock on our office.
Even retirement parties are somewhat pro forma. If you feel you have a calling for academia, you don’t feel any different the day after you retire. I just had my retirement party last month and it seemed like a birthday party, except that people gave speeches and gave me a nice, cherry wood captain’s chair with the Cornell logo on the front and a thoughtful personalized little metal plaque on the back of it.
In 30 years of academia, I only once went to a retirement party that didn’t just seem like was another birthday party for the person who was retiring but who was going to be at work again tomorrow at they exact same time they always are. But seeing this one retirement party had a striking effect on me. It happened about 15 years ago, and I was asked to be one of two faculty speakers at the annual Spring meeting of the university’s Business Advisory Committee; it was also doubling as a retirement party for an amazing man.
He was one of the most notable economists at the University. He occupied a rare niche at the intersection of economics, real estate, finance, and law. He was widely published, widely influential, and even his economist colleagues spoke of him in awe. This year was his retirement year, and his speech would perhaps be his Last Waltz in front of a group like this. We got to know each other throughout the day and up through the closing reception.
On the rainy long ride home, we sat next to each other in the back of the dark and quiet chartered bus. I asked him which of his many accomplishments he most proud of, and which had the most impact. At one point, however, I asked a question that was not met with the same warmth and candor. I asked, "In light of all of the remarkable things you’ve accomplished so far in your career, what’s your biggest professional regret?"
Then he eventually said, "I don’t have any regrets. If I had to do it again, I would do everything pretty much the same way." After another long pause he then recanted a bit and said something like this:
I said, “Would it be easier for people to see your big picture if you were to write a book that pulled all of this together? That way, everything would be in one place and you could connect all the dots.” He chuckled and immediately dismissed this, “I don’t know about marketing, but in economics they don’t reward books.”
After 45 years of research, here was a great man who was retiring with one needless regret. Yet, what he let get in his way was how he would be rewarded or whether a colleague might think he was simplifying his research for the amateurs. It seemed to me that writing a book would have been a potentially transforming project.
The metaphor that is relevant for us is not the metaphor of writing a book. The appropriate metaphor is for any project that might ratchet up our level of impact. It is any project that may not be rewarded with the respect of the “professor next door,” but it is that which we think is critically important. In fact, it might be even be actively derided. That’s what happened to a number of metaphorical books. It happened to Carl Sagan’s award-winning Cosmos series on PBS, to Gary Becker’s famous Business Week columns, to Steven Levitt’s “Freakonomics” to Paul Krugman’s New York Times columns, to Richard Posner’s Federal Judge appointment, and to Stephen Ambrose’s National World War II Museum.
The notion of an "unwritten book" can be a powerful and useful metaphor for us. For many of us, there is at least one metaphorical book that would take our ideas to a new level of influence. It might be starting a website and blog, presenting research in front of a House subcommittee in order to propose a law, making class modules for science teachers, writing a review article in a related field, starting a company, or starting a new class and turning the notes into a book. What’s interesting is that most of these “unwritten books” probably wouldn’t have to wait. They were something that could have been started much earlier if we would have removed our self-limiting barriers.
I remember another topic that I discussed with that eminent economics professor on the long ride back home. It was how quickly he said that his research years had passed.
He said that after he graduated with his PhD, he blinked and had tenure; he blinked again and he had an endowed chair; he blinked again and he was riding with me on what he called “his retirement bus.” The idea of starting a career of activism research when “the time is right” could disappear in a blink of an eye.
Time to start the next chapter.
There once was a legendary, larger-than-life professor. If Marvel’s 137th movie of this year is named UltraProf, it would be based on John Shank. He taught a dry subject (think Accounting), but his charisma and his orchestration of his class made each class session seem like 60-person David Mamet plays. Every class had passion, drama, and some surprising reveal at the end that people still talked about ten years later. Here’s a quote:
As a teacher John was at home at any level, and always brilliant. I could offer the testimonials of others, however, what brought his classroom performance home to me— and it was a performance in the truest sense of the word—was watching him at an Accounting Round Table at Pitt’s business school. He held 50 top financial officers in the palm of his hand while he presented his material. They were busy individuals with many things on their minds and schedules, but not a one left until John had answered their last question. I can assure you that their staying until the end was not out of courtesy (Bernberg 2008).
Although the opposite is true, some believed he was only about style. This is because he wore Brooks Brothers braces, walked with a MVP swagger, drove a Dartmouth green sports car, and he had a runway model wife who was like some VP of Finance somewhere. His office was professionally-decorated with French draperies, super-thick Dartmouth green carpeting, and a massive 18th century French desk which sat in the middle of the room so his desk chair could face the doorway. Even his two huge perfectly groomed dogs were effortlessly well-mannered. On Saturdays he’d come to work, and they’d sit on either side of his desk and face the door. They were like lions on either side of a throne, and he was like Odin . . . or John Wick. His dogs keep eternal vigilance. My dog wets on me and then licks my face.
This was 1992. Because he had about the highest MBA teacher ratings at Dartmouth's Tuck School and I had about the lowest ratings, he let me sit in on his classes so I could suck less . . . so I could learn better teaching strategies and classroom management skills. One Saturday during a Tuck alumni reunion, I stopped by his office and told him I had overheard some alumni who were still talking about what they had learned in a class they had taken with him 10 years earlier.
He looked up over the top of his half-glasses, and said, “That’s what they’re supposed to do. It means I’ve done my job.”
He said his goal isn’t to teach students to get a great first job (or to, analogously, get a high score on the GRE or MCAT), his goal is to teach them to succeed for wherever they will be in 10 or 20 years. Although he got outstanding teaching ratings, he brushed them off by saying that teacher ratings mainly measured the moment – they mainly measured the warm feelings a student had at the time. Ratings might capture style (which he was very good at), but they may not always measure long-term substance.
Last week, the school year ended. A lot of amazing teachers will take their course evaluation ratings and use them to improve their classes for next year. John’s view was that we need to also focus on the long-term impact of our courses.
I regret that I never had the presence of mind to ask him how he did it -- how he knew what long-term impact to aim at. Since he was on boards and did a lot of consulting with upper management, I suspect he taught his courses like he was teaching board members and upper management. That is, when he was teaching, he treated them like they were high level managers. That’s one way to do it.
A second way to try and teach for long-term impact might be to ask. After they graduate, it will be more apparent to them whether your course helped them live a better life (more useful, meaningful, successful, or whatever), and how your course might be improved. It’s easier to get this feedback than you might think. You’ve probably saved your class lists (somewhere) from 5 years ago. You might have their emails, or the alumni office will have both their emails and their snail mail addresses. You can simply ask them.
Ten or fifteen years after I left Dartmouth I was in Boston, and I rented a car to drive up to visit John. I wanted to thank him for being so generous, and I wanted to prove to myself that his office, desk, and dogs were as amazing as I remembered them. There was a different name on his door. I was too late.
I love the idea of trying to teach for a long-term impact. It’s like trying to create long-term memories. I sometimes think I can remember everything John said to me because he was always so intentional with every conversation. Just like he was with his classes.
At the next reunion, if his former student’s aren’t talking about what they learned 30 years ago, they’ll be talking about how hard he tried. That itself was a great lesson.
How to graduate, get a job, get tenure, solve problems, and make fewer mistakes.