9: What reviewers of your paper first look at

Always wanted to know where reviewers first look at when reviewing a journal paper?  In our courses, we have been asked this question many times. Here we will dive into the issue to shed some light on it and help you on your first leg of the peer-review process.  

Reviewers, like many of us, are busy people. They are academics employed at institutes and universities that have a lot of regular duties. Some of them are frequently asked by journals to review papers, but they might not always be able to spend a lot of time reviewing each individual paper. 

Within the peer-review process, reviewers play an essential role in getting your paper published. They might come very quickly to an opinion of your manuscript, based on their first impression about your paper, its topic and the relevance. Once they built up this first impression, they will further judge your work with this opinion in mind, and may seek confirmation in the rest of it.  

As it is foundational for how your paper is seen, let’s get a quick overview of how this first impression is created. Here, we’ll detail for you the top five aspects reviewers first look at before reading your entire paper. Crucially, we also explain to you why reviewers are so likely to look at these, what they try to get out of it, and what you can do to make sure reviewers get a good impression of your paper. 

We recommend that you keep these five aspects in mind when drafting your next paper, to make sure you meet the reviewers’ expectations. It will definitely increase the chances of your paper passing peer-review and getting published! 

1) Paper abstract

Naturally, your abstract is the first part that most reviewers see. They will get an email from the journal with an invite to consider reviewing your paper. To make the decision of whether to review your paper or not, the reviewers will receive your abstract to read. Once they have accepted the task of reviewing your paper, they get access to the full manuscript, but the abstract is still the first part of the paper that they will read. 

Crucially, the 150-300 words of your abstract gives reviewers the first impression of your paper. They look for answers to the following questions: 

  • What is the topic of the paper? 
  • Why is it relevant?
  • What is the research aim of the paper? 
  • Which method or approach has been applied?
  • What have the authors found or achieved? 
  • What is the main message and the main benefit derived from this paper? 

For further details on how to write a paper abstract that fulfils the reviewers’ expectations, have a look at our contribution “How to write a paper abstract” including its checklist available for download. 

2) Paper objectives

If your abstract is not specific enough or if reviewers need more detail to fully understand what your research objective of the paper is, they will definitely look at your introduction at least briefly. They hardly look at the whole introduction at this stage, but probably just search the last paragraph that promises them a statement like “The aim of our paper is …” to give them a clear idea of which research question you address. 

At this stage, they are foremost trying to judge the novelty and the relevance of your work. Imagine a reviewer looking at a paper and reading through this section only to find out that the question the paper deals with has been addressed in several papers before. Of course, this reviewer will hardly assume that your paper can add anything new to the field and might judge its relevance as low. 

A reviewer might look for answers to the following questions: 

  • What is the exact research question that this paper addresses?
  • What is the relevance of this question?
  • What could be a potential gain from knowing the answer to this question?

So make sure that you present a specific research objective at the end of your introduction to convince the reviewer of your work’s novelty and relevance. 

3) Conclusion section

The third most relevant section of your paper for reviewers to look at is towards the end: the conclusion. The conclusion is the part of the paper where the author summarises the advancement of knowledge that emerged from the paper. 

A reviewer might look for answers to the following questions here: 

  • What can I learn from this paper?
  • What is the take-home message related to the presented research objective?
  • How does this paper bring us ahead?
  • Does the paper consistently lead to the conclusions presented here?

In other words, the reviewer wants to see what the main message is that your paper presents. If there would be no message, no gain from the paper, why would somebody be interested to read it?

We recommend to always present a conclusion with a clear message and not just a repetition of the entire paper. The conclusion can be short and does not have to include an astonishing breakthrough, but there needs to be something memorable at the end! 

4) Length of the paper

A reviewer might be curious about your work, might love the topic, but also has many other duties, and therefore time is of the essence. In simple terms, that could mean a long paper takes a long time to read and understand. A short paper is read and reviewed much quicker and would be less work. 

Unsurprisingly, reviewers also look at the length of your paper. They do that for self- interest but also for the reader’s interest. A long manuscript needs to promise and deliver relevant content throughout, otherwise it will get judged as lengthy and wordy. 

When writing your paper, don’t give the full report of everything you have done and found. It would be good to focus on the really important information and stick to the journal’s word limit. 

5) References section

The last aspect on our list of things to quickly check is your list of references. No, reviewers don’t do this to make sure they find their own name cited (although some might probably appreciate it). Reviewers look through the references to get an idea about the state-of-the-art that your work reflects. They want to know whether you are up-to-date with the field. 

They might look at the age of references, sources used, relevant authors listed or other indicators that could tell them quickly in which context your work was done. 

When you write your paper, don’t overload it with references to impress reviewers – they might not see the relevance of so many sources for your paper and journals don’t like endless list of references either – focus on using relevant references. 

Conclusion

Reviewing is a process where the reviewers gradually build a professional opinion of your paper. Some reviewers spend more time on this task, others less. As most reviewers do not necessarily review papers for fun, but rather see it as their duty to keep up quality control in academia, many reviewers will take shortcuts through your paper to help form their opinion. The five aspects listed above are certainly among the top aspects that reviewers look at. They are also not the only aspects reviewers look at, but scoring well on these enhances your chances of getting published substantially!  

Relevant resources:  

Blog post #1: How to write a paper abstract
Expert guide: 5 strategies to avoid initial paper rejection

More information: 

Want to receive more information on how to publish your research? Sign up to our newsletter and be regularly informed about new postings and free resources. 

© 2019 tressacademic.com

Photographs by Mike Haupt at unsplash.com and FreedomTumZ on bigstockphoto.com

#PublishingPapers, #PeerReview, #JournalPaper  

Address Book Address Card adjust align-center align-justify align-left align-right Allergies ambulance American Sign Language Interpreting Anchor Angle Double Down Angle Double Left Angle Double Right Angle Double Up angle-down angle-left angle-right angle-up Archive Alternate Arrow Circle Down Alternate Arrow Circle Left Alternate Arrow Circle Right Alternate Arrow Circle Up Arrow Circle Down Arrow Circle Left Arrow Circle Right Arrow Circle Up arrow-down arrow-left arrow-right arrow-up Alternate Arrows Alternate Arrows Horizontal Alternate Arrows Vertical Assistive Listening Systems asterisk At Audio Description backward Balance Scale ban Band-Aid barcode Bars Baseball Ball Basketball Ball Bath Battery Empty Battery Full Battery 1/2 Full Battery 1/4 Full Battery 3/4 Full Bed beer bell Bell Slash Bicycle Binoculars Birthday Cake Blind bold Lightning Bolt Bomb book bookmark Bowling Ball Box Box Open Boxes Braille Briefcase Medical Briefcase Bug Building bullhorn Bullseye Burn Bus Calculator Calendar Alternate Calendar Calendar Check Calendar Minus Calendar Plus Calendar Times camera Retro Camera Capsules Car Caret Down Caret Left Caret Right Caret Square Down Caret Square Left Caret Square Right Caret Square Up Caret Up Shopping Cart Arrow Down Add to Shopping Cart certificate Area Chart Bar Chart Line Chart Pie Chart Check Check Circle Check Square Chess Chess Bishop Chess Board Chess King Chess Knight Chess Pawn Chess Queen Chess Rook Chevron Circle Down Chevron Circle Left Chevron Circle Right Chevron Circle Up chevron-down chevron-left chevron-right chevron-up Child Circle Circle Notched Clipboard Clipboard Check Clipboard List Clock Clone Closed Captioning Cloud Cloud Download Alternate Cloud Upload Alternate Code Code Branch Coffee cog cogs Columns comment Alternate Comment Comment Dots Comment Slash comments Compass Compress Copy Copyright Couch Credit Card crop Crosshairs Cube Cubes Cut Database Deaf Desktop Diagnoses DNA Dollar Sign Dolly Dolly Flatbed Dot Circle Dove Download Edit eject Horizontal Ellipsis Vertical Ellipsis Envelope Envelope Open Envelope Square eraser Euro Sign Alternate Exchange exclamation Exclamation Circle Exclamation Triangle Expand Alternate Expand Arrows Alternate External Link Alternate External Link Square Eye Eye Dropper Eye Slash fast-backward fast-forward Fax Female fighter-jet File Alternate File Archive File Audio File Code File Excel File Image File Medical File Medical File Alternate PDF File Powerpoint File Video File Word File Film Filter fire fire-extinguisher First Aid flag flag-checkered Flask Folder Folder Open font Font Awesome Full Logo Football Ball forward Frown Futbol Gamepad Gavel Gem Genderless gift Martini Glass Globe Golf Ball Graduation Cap H Square Hand Holding Hand Holding Heart Hand Holding US Dollar Lizard (Hand) Paper (Hand) Peace (Hand) Hand Pointing Down Hand Pointing Left Hand Pointing Right Hand Pointing Up Pointer (Hand) Rock (Hand) Scissors (Hand) Spock (Hand) Hands Helping Hands Handshake Hashtag HDD heading headphones Heart Heartbeat History Hockey Puck home hospital Hospital Alternate Hospital Symbol Hourglass Hourglass End Hourglass Half Hourglass Start I Beam Cursor Identification Badge Identification Card Identification Card Alternate Image Images inbox Indent Industry Info Info Circle italic key Keyboard Language Laptop leaf Lemon Level Down Alternate Level Up Alternate Life Ring Lightbulb Link Turkish Lira Sign List List Alternate list-ol list-ul location-arrow lock Lock Open Alternate Long Arrow Down Alternate Long Arrow Left Alternate Long Arrow Right Alternate Long Arrow Up Low Vision magic magnet Male Map map-marker Map Marker Alternate Map Pin Map Signs Mars Mars Double Mars Stroke Mars Stroke Horizontal Mars Stroke Vertical medkit Meh Mercury Microchip microphone Microphone Slash minus Minus Circle Minus Square Mobile Phone Alternate Mobile Money Bill Alternate Moon Motorcycle Mouse Pointer Music Neuter Newspaper Medical Notes Object Group Object Ungroup Outdent Paint Brush Pallet Paper Plane Paperclip Parachute Box paragraph Paste pause Pause Circle Paw Pen Square Alternate Pencil People Carry Percent Phone Phone Slash Phone Square Phone Volume Piggy Bank Pills plane play Play Circle Plug plus Plus Circle Plus Square Podcast Poo Portrait Pound Sign Power Off Prescription Bottle Alternate Prescription Bottle print Procedures Puzzle Piece qrcode Question Question Circle Quidditch quote-left quote-right random Recycle Redo Alternate Redo Registered Trademark Reply reply-all Retweet Ribbon road rocket rss RSS Square Ruble Sign Indian Rupee Sign Save Search Search Minus Search Plus Seedling Server Share Alternate Share Alternate Share Square Share Square Shekel Sign Alternate Shield Ship Shipping Fast Shopping Bag Shopping Basket shopping-cart Shower Sign Alternate Sign In Sign Language Alternate Sign Out signal Sitemap Horizontal Sliders Smile Smoking Snowflake Sort Sort Alpha Down Sort Alpha Up Sort Amount Down Sort Amount Up Sort Down (Descending) Sort Numeric Down Sort Numeric Up Sort Up (Ascending) Space Shuttle Spinner Square Square Full Star star-half step-backward step-forward Stethoscope Sticky Note stop Stop Circle Stopwatch Street View Strikethrough subscript Subway Suitcase Sun superscript Sync Alternate Sync Syringe table Table Tennis tablet Alternate Tablet Tablets Alternate Tachometer tag tags Tape Tasks Taxi Terminal text-height text-width th th-large th-list Thermometer Thermometer Empty Thermometer Full Thermometer 1/2 Full Thermometer 1/4 Full Thermometer 3/4 Full thumbs-down thumbs-up Thumbtack Alternate Ticket Times Times Circle tint Toggle Off Toggle On Trademark Train Transgender Alternate Transgender Trash Alternate Trash Tree trophy truck Truck Loading Truck Moving TTY Television Umbrella Underline Undo Alternate Undo Universal Access University unlink unlock Alternate Unlock Upload User Alternate User User Alt-slash User Astronaut User Check User Circle User Clock User Cog User Edit User Friends User Graduate User Lock user-md User Minus User Ninja Add User User Secret User Shield User Slash User Tag User Tie Remove User Users Users Cog Utensil Spoon Utensils Venus Venus Double Venus Mars Vial Vials Video Video Slash Volleyball Ball volume-down volume-off volume-up Warehouse Weight Wheelchair WiFi Window Close Window Maximize Window Minimize Window Restore Wine Glass Won Sign Wrench X-Ray Yen Sign