Tradeoffs between bias, model fits, and using common sense about biology and fishing behaviors when choosing selectivity forms Dana Hanselman and Pete.

Slides:



Advertisements
Similar presentations
An exploration of alternative methods to deal with time-varying selectivity in the stock assessment of YFT in the eastern Pacific Ocean CAPAM – Selectivity.
Advertisements

Science Behind Sustainable Seafood Age Matters! Alaska Fisheries Science Center.
A spatial integrated population model applied to black-footed albatross Simon Hoyle Mark Maunder.
Sheng-Ping Wang 1,2, Mark Maunder 2, and Alexandre Aires-Da-Silva 2 1.National Taiwan Ocean University 2.Inter-American Tropical Tuna Commission.
Modeling fisheries and stocks spatially for Pacific Northwest Chinook salmon Rishi Sharma, CRITFC Henry Yuen, USFWS Mark Maunder, IATTC.
An evaluation of alternative binning approaches for composition data in integrated stock assessments Cole Monnahan, Sean Anderson, Felipe Hurtado, Kotaro.
A multi-species population assessment model for the Gulf of Alaska Kray F. Van Kirk, SFOS, UAF, Juneau Terrance J. Quinn II, SFOS, UAF, Juneau Jeremy S.
George Bank Cod Base –Similar to GARM2005 assessment Fleet_dome Survey_dome Survey_and_Fleet_dome Purpose: test models ability to estimate correctly when.
Discussion: Use of ecosystem level productivity as a fishery management tool New England Not used in management, but currently under consideration for.
Model time step and species biology considerations for growth estimation in integrated stock assessments P. R. Crone and J. L. Valero Southwest Fisheries.
The current status of fisheries stock assessment Mark Maunder Inter-American Tropical Tuna Commission (IATTC) Center for the Advancement of Population.
458 More on Model Building and Selection (Observation and process error; simulation testing and diagnostics) Fish 458, Lecture 15.
458 Policies and Their Evaluation Fish 458, Lecture 22.
Case Study - Dover Sole Range from Baja California to the Bering Sea. On mud or muddy-sand, at 35 to 1400 m depths. Feed on polychaete worms, shrimp, brittle.
Hui-Hua Lee 1, Kevin R. Piner 1, Mark N. Maunder 2 Evaluation of traditional versus conditional fitting of von Bertalanffy growth functions 1 NOAA Fisheries,
Age-structured assessment of three Aleutian fish stocks with predator-prey interactions Doug Kinzey School of Aquatic and Fishery Sciences University of.
How many conditional age-at-length data are needed to estimate growth in stock assessment models? Xi He, John C. Field, Donald E. Pearson, and Lyndsey.
The (potential) value and use of empirical estimates of selectivity in integrated assessments John Walter, Brian Linton, Will Patterson and Clay Porch.
Time-Varying vs. Non-Time- Varying Growth in the Gulf of Mexico King Mackerel Stock Assessment: a Case Study Southeast Fisheries Science Center Jeff Isely,
Megan Stachura and Nathan Mantua University of Washington School of Aquatic and Fishery Sciences September 8, 2012.
60º Introduction and Background ù The Barents Sea covers an area of about 1.4 x 10 6 km 2, with an average depth of 230 m. ù Climatic variations depend.
Developing a statistical-multispecies framework for a predator-prey system in the eastern Bering Sea: Jesús Jurado-Molina University of Washington Jim.
R. Sharma*, A. Langley ** M. Herrera*, J. Geehan*
Estimation of age-specific migration in an age-structured population dynamics model of Eastern Bering Sea walleye pollock (Theragra chalcogramma) Sara.
Investigating the Accuracy and Robustness of the Icelandic Cod Assessment and Catch Control Rule A. Rosenberg, G. Kirkwood, M. Mangel, S. Hill and G. Parkes.
Pacific Hake Management Strategy Evaluation Joint Technical Committee Northwest Fisheries Science Center, NOAA Pacific Biological Station, DFO School of.
Surplus-Production Models
ASSESSMENT OF BIGEYE TUNA (THUNNUS OBESUS) IN THE EASTERN PACIFIC OCEAN January 1975 – December 2006.
Pacific Hake Management Strategy Evaluation Joint Technical Committee Northwest Fisheries Science Center, NOAA Pacific Biological Station, DFO School of.
Spatial issues in WCPO stock assessments (bigeye and yellowfin tuna) Simon Hoyle SPC.
Evaluation of a practical method to estimate the variance parameter of random effects for time varying selectivity Hui-Hua Lee, Mark Maunder, Alexandre.
BSAI SAFE Report November 2005 Alaska Fisheries Science Center.
NPFMC--Jane DiCosimo NMFS --Loh-Lee Low Mike Sigler Grant Thompson Lowell Fritz Andy Smoker USF&W --Kathy Kuletz ADF&G --Ivan Vining Kristin Mabrey Univ.Alaska--Brenda.
WP 2.4 Evaluation of NMFS Toolbox Assessment Models on Simulated Groundfish Data Sets Comparative Simulation Tests Overview Brooks, Legault, Nitschke,
. Assessment of the Icelandic cod stock Björn Ævarr Steinarsson Marine Research Institute.
DEEPFISHMAN Using bioeconomic modeling for evaluation of management measures – an example Institute of Economic Studies.
GOA Retrospective analysis Model use: hypothesis testing The system, the stories, and the “data” The model: Elseas; like Ecosim but more flexible for our.
Economic impacts of changes in fish population dynamics: the role of the fishermen’s behavior Dipl.-Geogr. Peter Michael Link, BA Research Unit Sustainability.
Summary of Atlantic Swordfish Species Working Group Discussion (see also SCI -021)
Jennifer M. Marsh M.S. Fisheries Student School of Fisheries and Ocean Sciences University of Alaska Fairbanks.
Simulated data sets Extracted from:. The data sets shared a common time period of 30 years and age range from 0 to 16 years. The data were provided to.
Evaluation of harvest control rules (HCRs): simple vs. complex strategies Dorothy Housholder Harvest Control Rules Workshop Bergen, Norway September 14,
Overview of NMFS AFSC Field Activities Alaska Fisheries Science Center 7600 Sand Point Way NE Seattle, WA.
Update on groundfish stock trends for the Gulf of Alaska
Gulf of Alaska Groundfish Plan Team Gulf of Alaska Groundfish Plan Team December 2005 Update on groundfish stock trends for the Gulf of Alaska GOA Plan.
The effect of variable sampling efficiency on reliability of the observation error as a measure of uncertainty in abundance indices from scientific surveys.
The Influence of Spatial Dynamics on Predation Mortality of Bering Sea Walleye Pollock Pat Livingston, Paul Spencer, Troy Buckley, Angie Greig, and Doug.
Estimation of growth within stock assessment models: implications when using length composition data Jiangfeng Zhu a, Mark N. Maunder b, Alexandre M. Aires-da-Silva.
1 Federal Research Centre for Fisheries Institute for Sea Fisheries, Hamburg Hans-Joachim Rätz Josep Lloret Institut de Ciències del Mar, Barcelona Long-term.
Kray F. Van Kirk, SFOS, UAF, Juneau Terrance J. Quinn II, SFOS, UAF, Juneau Jeremy S. Collie, GSO, URI, Narragansett A Multispecies Age-Structured.
Using distributions of likelihoods to diagnose parameter misspecification of integrated stock assessment models Jiangfeng Zhu * Shanghai Ocean University,
Estimation of selectivity in Stock Synthesis: lessons learned from the tuna stock assessment Shigehide Iwata* 1 Toshihde Kitakado* 2 Yukio Takeuchi* 1.
CAN DIAGNOSTIC TESTS HELP IDENTIFY WHAT MODEL STRUCTURE IS MISSPECIFIED? Felipe Carvalho 1, Mark N. Maunder 2,3, Yi-Jay Chang 1, Kevin R. Piner 4, Andre.
MSE Performance Metrics, Tentative Results and Summary Joint Technical Committee Northwest Fisheries Science Center, NOAA Pacific Biological Station, DFO.
Yellowfin Tuna Major Changes Catch, effort, and length-frequency data for the surface fisheries have been updated to include new data for 2005.
Lecture 10 review Spatial sampling design –Systematic sampling is generally better than random sampling if the sampling universe has large-scale structure.
Multispecies Catch at Age Model (MSCAGEAN): incorporating predation interactions and statistical assumptions for a predator ‑ prey system in the eastern.
A bit of history Fry 1940s: ”virtual population”, “catch curve”
Empirical comparison of historical data and age- structured assessment models for Prince William Sound and Sitka Sound Pacific herring Peter-John F. Hulson,
UALG Statistical catch at age models Einar Hjörleifsson.
Influence of selectivity and size composition misfit on the scaling of population estimates and possible solutions: an example with north Pacific albacore.
NWFSC A short course on data weighting and process error in Stock Synthesis Allan Hicks CAPAM workshop October 19, 2015.
Population Dynamics and Stock Assessment of Red King Crab in Bristol Bay, Alaska Jie Zheng Alaska Department of Fish and Game Juneau, Alaska, USA.
Survey Data Conflicts and Bias and Temporal Variation of Model Parameters of St. Matthew Island Blue King Crab J. Zheng, D. Pengilly and V. A. Vanek ADF&G,
Is down weighting composition data adequate to deal with model misspecification or do we need to fix the model? Sheng-Ping Wang, Mark N. Maunder National.
Time of Death: Modeling Time-varying Natural Mortality in Fish Populations Phil Ganz 1 Terrance Quinn II 1 Peter Hulson 2 1 Juneau Center, School of Fisheries.
Nonlinear function minimization (review). Newton’s minimization method Ecological detective p. 267 Isaac Newton We want to find the minimum value of f(x)
Selectivity.
Bristol Bay Red King Crab Assessment in Spring 2019
Eastern Bering Sea snow crab
Presentation transcript:

Tradeoffs between bias, model fits, and using common sense about biology and fishing behaviors when choosing selectivity forms Dana Hanselman and Pete Hulson Alaska Fisheries Science Center Juneau, AK

Outline Introduction Introduction Biology and fleet behavior Biology and fleet behavior Case study: GOA Pacific ocean perch Case study: GOA Pacific ocean perch Precision and estimability Precision and estimability Case study: Alaska sablefish Case study: Alaska sablefish Simulation tests Simulation tests Preliminary Conclusions Preliminary Conclusions

Introduction The slow creep of SS3 into AFSC The slow creep of SS3 into AFSC Paladins of parsimony Paladins of parsimony Highly parameterized models seem unstable Highly parameterized models seem unstable Can we use complicated models for research, but simpler models for management? Can we use complicated models for research, but simpler models for management?

Double Domes and steep drops WC Sablefish H&LBS Turbot Trawl fish. BS skate trawl fish. Ian-Stewart

BS P. Cod T. SurveyEBS Pollock Time varying everything Ian-Taylor Ian-Elli

GOA Pacific ocean perch Strong catch-history, rebuilt Strong catch-history, rebuilt Variable recruitment, clustered cohorts Variable recruitment, clustered cohorts Age structured (AMAK-like) Age structured (AMAK-like) Marginally good trawl survey Marginally good trawl survey 1000 otoliths per survey/fishery year (odd/even) 1000 otoliths per survey/fishery year (odd/even)

Gulf of Alaska POP – Problems Survey q drifting upward each assessment Survey q drifting upward each assessment Fishery selectivity was drifting domed but highly constrained Fishery selectivity was drifting domed but highly constrained q and selectivity interact q and selectivity interact Is it more likely that the survey q is changing in one direction or the fishery selectivity might have changed? Is it more likely that the survey q is changing in one direction or the fishery selectivity might have changed? Look for evidence of dome-shape selectivity in fishery Look for evidence of dome-shape selectivity in fishery

POP Fishery: Early Fishery versus Current

POP – Catch by depth

Fishery was catching greater than 25% over 25 years old in the 80’s

Fishery was catching a much higher proportion of older fish than survey in 80’s

The reverse has occurred recently

Fit selectivities to raw data by estimating selectivity curves and mortality Logistic looks pretty good for survey

Gamma fits about half as good, minimal dome suggested.

Logistic to the fishery fits acceptably except for pooled group…

But gamma has 20% of the residual error and fits pooled age well

POP – Final model New selectivity functions to describe fishing fleet New selectivity functions to describe fishing fleet Fit toward dome in three stages Fit toward dome in three stages 1961 to 1976: the beginning and end of the foreign fishing fleets massive catches 1961 to 1976: the beginning and end of the foreign fishing fleets massive catches 1977 to 1995: The domestication of the fishery, but large factory trawlers still dominant 1977 to 1995: The domestication of the fishery, but large factory trawlers still dominant 1996-Present: The emergence of catcher-boats, semi-pelagic trawling, fishing cooperatives, fishing shallower 1996-Present: The emergence of catcher-boats, semi-pelagic trawling, fishing cooperatives, fishing shallower

Better fit to fishery ages, 9 less parameters, slightly better but similar fit overall

POP – Model Results Recommended model, new selectivity Substantially better fit to fishery age comps (25% reduction in fishery age –lnL) Survey catchability parameter reduced below 2 Fit data better with 9 less parameters

Alaska sablefish Long survey time series (36 annual LL, 13 trawls) Long survey time series (36 annual LL, 13 trawls) High-value fish ($142 million in 2011, IFQ) Lots of data Split-sex 2 fishery (really at least 3) Huge area Mainly targeted

Alaska sablefish Two sexes made selectivity difficult to estimate Trawl survey and fishery should be descending (shallow) Simplified selectivities for better estimation

Trawl fishery selectivity Exponential LogisticGamma Females Males 6 parameters to 2 parameters

Trawl survey selectivity Exponential LogisticPower (1/a x ) Females Males 6 parameters to 2 parameters

Selectivity: Precision

Model Evaluation Parameter correlations greater than 0.4: Parameter correlations greater than 0.4: Model 1: 17 Model 1: 17 Model 2: 14 Model 2: 14 Model 3: 1 Model 3: 1 Model 3 fits about the same as Model 1 but with 13 less parameters, better model stability and less parameter correlation. Model 3 fits about the same as Model 1 but with 13 less parameters, better model stability and less parameter correlation.

Simulation – life history cases FishGadid (Pollock) Flatfish (Arrowtooth) Rockfish (POP) M N ages91324 Pop. TrendDecreasingIncreasing Survey CV~18%~8%~25% Survey q~1.00~0.73~2.00 RecVarHighLowMedium

Simulation – selectivity cases SelectivityParamsShape Logistic 2Asymp. Gamma 2Dome Exp. Logistic 3 Asymp. Or Dome Double-gamma 4 Dome or Double Dome Double-log 4 Asymp. Or Dome Double-normal 8Abstract art

Simulation – model SelectivityParamsForm Recruitment 38-53LMR + devs M 1Lognormal Q 1 Lognormal or fixed Age comps. - Multinomial Survey biomass - Lognormal Catch biomass 30Fdevs/Lognormal

Operating/Estimation One fishery, one survey, one SEX One fishery, one survey, one SEX Survey constrained to be logistic Survey constrained to be logistic 6 x 6 x 100 (fixed q) 6 x 6 x 100 (fixed q) 6 x 6 x 1000 (estimate q) 6 x 6 x 1000 (estimate q) Age comps only, no lengths Age comps only, no lengths Multinomial sample size of 200 Multinomial sample size of 200

Gamma (POP)

Double normal (POP)

Double normal (pollock, est. q)

Catchability (POP) (est. q)

LMR (POP, est. q)

Natural mortality (ATF)

Natural mortality (POP)

Ending SSB (POP)

Estimation/precision More parameters, more uncertainty, less convergence More parameters, more uncertainty, less convergence Even when biased, logistic and gamma are precise Even when biased, logistic and gamma are precise Models are more stable Models are more stable Correlations are lower Correlations are lower

CVs –Double normal

CVs –Logistic and gamma Logistic Gamma

CV of OFL (pollock)

Multiplier at P*=0.25 (pollock, est. q)

Preliminary conclusions Forcing the logistic can create bias in M Forcing the logistic can create bias in M For fishery selectivity, logistic not necessarily conservative For fishery selectivity, logistic not necessarily conservative Double normal can fit most shapes but at a cost: Double normal can fit most shapes but at a cost: Selectivity parameters are not precise Selectivity parameters are not precise Oddly, OFL and ending SSB are more precise (Hessian) Oddly, OFL and ending SSB are more precise (Hessian)

Preliminary conclusions Complicated selectivities are OK when: Complicated selectivities are OK when: There is a rationale that a fisherman can understand There is a rationale that a fisherman can understand The model can be reliably estimated with the number of selectivity parameters (e.g., easy convergence and CV<50%) The model can be reliably estimated with the number of selectivity parameters (e.g., easy convergence and CV<50%) Parameter correlations <0.5? Parameter correlations <0.5? Our simple simulations did not provide obvious results, selectivity IS complicated Our simple simulations did not provide obvious results, selectivity IS complicated

Introducing The TWINCE model

Introducing The Triple-Weibull-Inverse-Negative- Cauchy-Exponential The Triple-Weibull-Inverse-Negative- Cauchy-Exponential ONLY 19 parameters ONLY 19 parameters Can meet all your selectivity needs Can meet all your selectivity needs Flexible shapes (reversible, like overfished) Flexible shapes (reversible, like overfished) Stable until you add real data Stable until you add real data Estimable until you turn on the parameters Estimable until you turn on the parametersTHANKS!