All wines are sampled blind and in a standardized setting
All wines that I review for Wine Enthusiast are sampled blind in a standardized setting (location, time, serving temperature, and stemware). I am in all cases unaware of the producer, appellation, vintage, and price when sampling and reviewing wines. Doing so is an attempt to remove biases that such awareness can cause, both positive and negative.
While I regularly taste wines with winemakers at home and at wineries, these notes are strictly informational. All scores come from bottles sampled blind, in a standardized setting.
There is no screening of samples prior to evaluation
All wines that are part of my beat (currently Washington and Idaho) that are submitted for review are subsequently tasted and reviewed by me personally. No one else screens or reviews my wines under any circumstances.
Unlike some publications or reviewers, there is no screening process for wines prior to being submitted or reviewed at Wine Enthusiast. I am looking at everything that comes through, rather than a subset.
The benefit of this is that it allows me to taste broadly across wines that are part of my beat, providing both myself and consumers with a clearer picture of what is going on in the area. The benefit for wineries is that it eliminates gatekeepers when submitting wines.
Scores for all wines submitted for review are subsequently published*
The benefit for consumers of not screening wines prior to review is that it allows them to see almost all of the scores given to the wines that I taste. If a wine is submitted to me for review, a score is subsequently published for that wine.
When wines are screened, the scores by definition represent a subset of the wines submitted. This means, for the consumer, when you don't see a review for a particular wine, you never know, was it not submitted? Was it submitted and screened out by someone before getting to the reviewer? Could the winery just not get their foot in the door to get someone to even screen the wine?
If a wine was submitted to me for review at Wine Enthusiast, I will taste the wine, and you will subsequently see a score published. There are only two exceptions. The first is if the wine was rated less than 80 points. We consider these wines to not be commercially acceptable. The second is if only one bottle of a wine was submitted and it was determined to be contaminated by TCA (cork taint). These two reasons are why there is an asterisk (*) above.
The process
Receiving submissions
Submitted wines are received by a professional wine storage facility where they are immediately placed under temperature control. I pick boxes up from this facility typically weekly and subsequently transport them home. Boxes are subsequently left in place for a minimum of one week to recover from shipment, whereupon they are opened and organized by variety/style.
Sets arranged by variety/style
The capsules are stripped from the wines, and the wines are placed in opaque bags prior to evaluation to obscure identifying information. Wines for review are sampled in small sets of four to twelve. Sets are arranged by variety or wine type, such as a Bordeaux-style blend or Cabernet Sauvignon. I do not sort wines by and an unaware of when tasting producer, vintage, appellation, or price, again to remove the possibility of bias that this awareness might bring.
Serving temperature
Serving temperature makes a critical difference in the presentation of a wine. For this reason, all wines for review are tasted at a consistent temperature: 62-66 degrees Fahrenheit for red wines, 50-55 degrees Fahrenheit for white wines. Wine temperature and ambient temperature are recorded.
Small sets and no mass tastings
I keep the number of wines I taste on any given day small, typically from a minimum of eight - the most common number of wines I sample per day - to a maximum of 20, with the latter being rare and typically only done for white wines. I avoid tasting larger numbers per day as I believe doing so is not fair to the wines or their producers.
Tasting large numbers of wines per day can lead to a variety of issues, for example tannin accumulation, that can unduly influence a score. Additionally, when tasting large numbers of wines in a single setting, even the most skilled taster who is faithfully spitting all of the wine they are sampling will be influenced by the effects of alcohol.
I have used a breathalyzer to confirm this during previous (non-Wine Enthusiast) mass tastings I participated in, where I have registered above the legal limit after a morning of large-scale tasting (60+ wines in three hours), even though I was spitting all of the wine. This effect is compounded by a morning and an afternoon of mass tasting (often well over 100 wines). These mass tastings are not uncommon at wine competitions and also professional review tastings at some publications.
During mass tastings, a reviewer's perception for the first wine they taste is obviously vastly different from the 40th or 100th due to the effects of alcohol. I believe this is unfair to all of the wines in question. Tasting in small sets removes the potential effect of substantial alcohol absorption on the subsequent scores that can occur in large scale tastings.
Wines are popped and poured prior to tasting
I believe it is critical that all wines are sampled in a standardized way, as differences in process can impact resulting scores. For this reason, all bottles that I review are popped, poured, and subsequently sampled. As noted below, I make multiple passes tasting a flight of wines, with each pass providing the wine with some air, though obviously not as much as a decant.
I have experimented with decanting wines for review in the past. It was somewhat laborious, double decanting eight to 20 wines. More importantly, not all wines were well served by decanting. Then there is the question of how long: 30 minutes? An hour? Two? Do you use the same decanter for each wine? If so, do you rinse it in between bottles, adding some water to the equation, which can subsequently impact the wine? Or do you use eight to twenty separate decanters?
One might decide to only decant wines that seem like they would benefit from it. However, in my view, this provides the reviewer with too much discretion. Perhaps it is obvious that one wine would benefit from decanting while another might equally benefit but is not as obvious, and so the reviewer does not. This gives the former wine an advantage that the latter does not have.
For these reasons, I have stuck with pop and pour, though I am not entirely satisfied with it. The benefit of this approach is that all wines are treated equally. The disadvantage is that wines that might benefit from decanting are not given that opportunity. This is a sacrifice I am willing to make to have all wines treated equally.
Multiple passes per wine
When tasting wines for review, I typically make more than one pass through the flight, taking independent notes each time. I usually spend 5-10 minutes per wine, tasting the wine and writing a tasting note. These tastings take place over several hours.
While I may taste a wine over several days to get a sense of its overall ageworthiness - and I resample all wines on the second day to look for latent cork taint - any notes beyond the first day when the wine was tasted blind and in a standardized setting do not affect the subsequent score. Rather, they might affect the wine's drinking window if it is a Cellar Selection and perhaps the other special designations listed here.
Evaluating typicity and overall quality
When tasting wines for review, I am evaluating them for typicity and overall quality. Typicity means, for example, does a Washington Merlot taste like a Washington Merlot? If it does - or does not - this may subsequently impact the score or text of the review. For example, if a Washington Merlot smells like a very green Cabernet Franc, this would be considered atypical for the variety and would most likely impact the score.
Quality looks at a number of factors, such as the pleasantness of the aromas and flavors as well as the overall balance, complexity, depth, intensity, finish, and length. I also think about what a wine is trying to accomplish and how well it accomplishes it.
I try as best I can to review wines irrespective of my own personal palate preferences. That is to say, I am trying to assess what the quality of the wine is, not whether I might personally like to drink it at home. This differs considerably from how consumers approach wine.
For example, let's say a Chardonnay is made in a ripe style and fermented in 100% new oak that has an overt, but balanced, influence on the wine. Perhaps I do or do not personally care for that style, but, regardless, if the style is well executed, I would rate the wine highly. For a consumer, if the wine is not in a style that they would personally prefer, they would most likely pass on it and not think highly of it. This is fundamentally different from a critic's approach.
If you have any questions about how I taste wines for review at Wine Enthusiast, please email me at wawinereport@gmail.com.
Popular Posts
-
In 2020, I reviewed nearly 1,300 Washington wines for Wine Enthusiast magazine. Below are the forty wines that stood out the most. Note tha...
-
Today Kiona Vineyards, one of the largest growers on Red Mountain, announced the hiring of Matt Halldorson as viticulturalist. He will ove...
-
Marty Taucher knew they had something special when winemaker Chris Peterson first tasted him on the inaugural Liminal Grenache from barrel...
-
Below are my Wine Enthusiast reviews for October 2020. Wines are listed alphabetically by winery. Read information on how I review wines ...

Editor

Sean P. Sullivan is the editor of Washington Wine Report and a contributing editor at Wine Enthusiast magazine, covering Washington and Idaho. He has been writing about and reviewing Washington wine since 2005.


Labels Cloud
14 Hands
2010 Initiatives
2020 Washington Merlot Challenge
2021 Washington Syrah Challenge
Abbey Page
Abeja
Adams Bench
Airfield Estates
Alder Ridge
Alexandria Nicole
Alternative Closures
aMaurice Cellars
Amavi
Ambassador
Ancestry
Ancient Lakes
Andrew Januik
Andrew Will
Anelare
Angel Vine
AntoLin
Apex Cellars
Ardor
Arlington Road Cellars
Array
Ash Hollow
Ashan
Auclair
Avennia
Baer Winery
Balboa
Barnard Griffin
Barons V
Barrage
Barrister
Beresan
Bergevin Lane
Betz Family Winery
Board Track Racer
Bonair Winery
Bookwalter
Boomtown
Boudreaux Cellars
Brian Carter
Bridgman
Bunchgrass Winery
Bunnell Family
Buried Cane
Buty
Cadaretta
Cadence
Cairdeas
Cana's Feast
Candy Mountain
Canoe Ridge
Canon del Sol
Cartel Wine Group
Cascade Valley Wineries
Castillo de Feliciana
Castle Rock Winery
Cave B
CAVU
Cayuse Vineyards
Cedergreen Cellars
Charles and Charles
Charles Smith Wines
Chateau Rollat
Chateau Ste. Michelle
Chelan Estate
Chelan Ridge
Chinook
City Limits
Cloudlift Cellars
Clubhouse Cellars
Co Dinn
Col Solare
College Cellars
Columbia Crest
Columbia Gorge
Columbia Winery
Concentric Wine Project
Cooper Wine Company
Corked Counter
Corked Wines
Corliss Estates
Corvidae
Corvus Cellars
Cote Bonneville
Cougar Crest
Covey Run
Covington Cellars
Crayelle Cellars
Cuneo Cellars
CZ Cellars
Darby
Daven Lore
DeLille
Delmas
Desert Wind
Distant Bay
DiStefano
Domaine Pouillon
Domaine Ste Michelle
Donedei
Double Canyon
Doubleback
Dowsett Family Winery
DuBrul Vineyard
Duck Pond Cellars
Duckhorn
Dumas Station
Dunham
Dusted Valley
Dynasty Cellars
Efeste
Eight Bells
El Corazon
Eliseo Silva
Elsom Cellars
Ensemble Cellars
Envious Cellars
Erath
Eritage
Estrin Estates
Eyrie
Fall Line
Falling Rain
Fidelitas Winery
Fielding Hills WInery
Figgins
Five Star Cellars
Fjellene
Flying Dreams
Flying Trout
For a Song
Force Majeure
Forgeron
Full Pull Wines
Furion Cellars
Gard Vintners
Giant Wine Co
Gifford-Hirlinger
Gilbert
Glencorrie
Goedhart
Golden Ridge
Goose Ridge
Gordon Brothers
Gorman
Gramercy Cellars
Grand Rêve
Grosgrain
Guardian
Hard Row
Harvest 2010
Harvest 2011
Harvest 2012
Harvest 2013
Harvest 2014
Harvest 2015
Harvest 2016
Harvest 2017
Harvest 2018
Harvest 2019
Harvest 2020
Hawks View
Haystack Needle
Heaven's Cave
Hedges Family Estate
Helix
Hestia Cellars
Hogue Cellars
Hoodsport
Hors Catégorie
Horse Heaven Hills
Horsepower Vineyards
Hyatt Vineyards
Idilico
Intrinsic
Isenhower Cellars
Jaine
Januik Winery
JB Neufeld
JM Cellars
Jones of Washington
Juliette's Dazzle
K Vintners
Kaella Winery
Kerloo
Kevin White
Kiona
Kontos Cellars
Kyra Wines
L'Ecole
Lake Chelan AVA
Lantz Cellars
Latitude 46 North
Laurelhurst Cellars
Lauren Ashton
Lawrelin
Leonetti Cellar
Liberty Bay Cellars
Liminal
Lobo Hills
Locati Cellars
Lodmell Cellars
Lone Birch
Lone Canary
Long Shadows
Lost River Winery
Magnificent Wine Company
Maison Bleue
Manu Propia
Mark Ryan Winery
Maryhill
Matthews Estate
McCrea Cellars
McKinley Springs
Mercer Estates
Merf
Michael Florentino
Milbrandt Vineyards
Modern Wine Project
Monesia's Song
Morrison Lane
Mosquito Fleet
Mountain Dome
Naches Heights
Naches Heights AVA
Napeequa Vintners
Native Sun
Nefarious
Nelms Road
Nicholas Cole Cellars
No Girls
Nodland
Northstar
Northwest Wine Round-up
Nota Bene
Novelty Hill
NW Totem Cellars
NW VIne Project
NxNW
Obelisco Estate
Olsen Estates
OS Winery
Otis Kenyon
Ott and Murphy
Owen Roe
Pacific Rim
Palencia
Palouse
Pamplin
Pandora
Parejas
Passion
Patterson
Paul Gregutt
Pendulum
Pepper Bridge
Phylloxera
Pic of the Vine
Plumb Cellars
Pomum Cellars
Pondera
Portteus
Pour Me
Powers
Proletariat Wine Company
Proper
Prospice
Puget Sound
Purple Star
Quilceda Creek
Ramseyer Vineyards
Randall Harris
Rasa Vineyards
Red Diamond
Red Mountain
Red Willow
Reininger
Renegade
Result of a Crush
Rex Hill
Reynvaan Family Vineyards
RiverAerie
Riverhaven Cellars
RMV Cellars
Robert Ramsay
Robison Ranch Cellars
Ross Andrew
Rotie
Royal Slope
Rulo Winery
Russell Creek WInery
Rusty Grape Vineyard
Ryan Messer
Ryan Patrick
Sageland Vineyards
Saint Laurent
Salida Wines
Salmon Harbor
San Juan Vineyards
Sandhill
Sapolil Cellars
Savage Grace
Saviah Cellars
Scarborough
Screwcaps
Seattle Area Wineries
Seufert
Seven Hills Winery
Shady Grove Winery
Sheridan
Silvara
Silver Bell
Silver Lake Winery
Sineann
Six Prong
Skylite Cellars
Sleight of Hand
Smasne Cellars
Snipes Gap Vineyards
Snipes Mountain
Snoqualmie
Sockeye
Sodovino
Sol Stone
somme de parties
sonoris
Soos Creek
Sparkman Cellars
Spindrift
Spokane Area
Spring Valley
Steele Wines
Stella Fino
Stevens Winery
Stomani Cellars
Stonecap
Stottle
SuLei Cellars
Sweet Valley Winery
Swiftwater
Syncline Cellars
Syrah
SYZYGY
Tagaris
Tamarack Cellars
Tefft
Tempus
Tenor Wines
Tero Estates
Terra Blanca Winery
The Burn of Columbia Valley
The Rocks District of Milton-Freewater
Three Rivers Winery
Thurston Wolfe
Tildio
Time & Direction
Townshend Cellar
Tranche
Treveri
Trust
Tulpen Cellars
Two Mountain
Two Vintners
Upland Estates
Va Piano Vineyards
Valdemar Estates
Viento Wines
Vin du Lac
Vinyl Wines
Virtual tasting
Virtue Cellars
W.T. Vintners
Wahluke Slope
Walla Walla Valley
Walla Walla Vintners
Walter Dacon
Washington Hills
Waterbrook
Waters
Waving Tree
White Bluffs
Whitestone
Whitman Cellars
William Church
Willow Crest
Wilridge Winery
Wind Rose Cellars
Wine Enthusiast
Wine Enthusiast Scores
WineGirl Wines
Wines of Substance
Woodhouse Wine Estates
Woodinville Wine Cellars
Woodinville WIneries
Woodward Canyon Winery
Yakima Valley
Yellow Hawk Cellar
Zerba Cellars
Zero One Vintners
