While the proposed work has the potential to provide useful information on an important anadromous population in the Snake River basin, information that may be transferable (in some way to other subbasins), there are several major issues that need clarification and expansion. These issues include:
1. Better justification for Objective 3
2. Better explanation of the power analysis and data analysis
3. Justification for using different types of adult sampling methods and the rationale for their locations
4. Issues relating to comparability of data between tributaries whose adults were sampled using different techniques.

1. Technical Justification, Program Significance and Consistency, and Project Relationships
The purpose of the proposed work is to quantify, with a "high degree of precision," escapement and spatial distribution of steelhead in the Imnaha River. The steelhead population in the Imnaha is part of the Snake River steelhead ESU declared Threatened under the Endangered Species Act.

The proponents state that the Regional RM&E Collaboration strategies for the Snake River called for high precision estimates of adult abundance, with a coefficient of variation of 15% or less, "in at least one population per life history type per Major Population Group." This CV apparently was based on a recommendation by NOAA-Fisheries for monitoring VSP parameters (Crawford and Rumsey 2009, draft). In accordance with this strategy, the Coordinated Anadromous Workshop identified Imnaha steelhead as a "high precision priority population" so accurate estimates of escapement are needed. This is one of the more compelling justifications for the proposed work, but the proponents need to explain how the determination that the Imnaha was a priority population was made.

However, the ISRP notes that CV (coefficient of variation) is not usually associated with precision of data, but with the variation associated with a state of nature. That is, salmon abundance across years has a CV, fall steelhead parr length has a CV. These are descriptions of the state of variation. They are not appropriate to determine confidence intervals. Crawford and Rumsey (2009) reference Carlile et al. (2008), which makes recommendations for coefficients of variation for estimates of total spawning escapement. The reference is to standard error of the estimate, not to variation in the population. More importantly, the statistical and biological basis for the recommendation in Carlile et al. (2008) has not been reviewed. The justification that the standard represents a realistic goal for planning because it corresponds to an acceptable risk (one year of one stock in six) of failing to label a stock of concern when warranted appears to be arbitrary. The observation that the standard has proven to be attainable for many escapement estimation studies does not mean that this is the appropriate data standard. Further justification for sample size targets is required.

Further justification for expanding monitoring of A-run steelhead in the Imnaha includes: "The Imnaha River steelhead population is unique in the Snake River DPS in that it: 1) is physically small enough to conduct sampling of steelhead (mainstem flow and manageable number of spawning/rearing aggregates), 2) has a dendritic structure of spawning areas occurring across the entire range of elevations available to Snake basin DPS steelhead (spawning in areas from 1,000 feet up to 6,000 feet), and 3) has a supplementation program occurring in just two of its spawning aggregates." Also, "Steelhead redd counts are not physically possible throughout most the Imnaha River drainage due to inaccessibility and high turbidity".

This justification appears meaningful. It seems consistent with the BiOp and the Imnaha Subbasin Plan. However, the justification could be stronger. The proposal makes the point that the work outlined is needed to fill a "critical data gap." A better justification would show how management of Imnaha steelhead could be improved if the new data were available.

The proponents assert that monitoring the status of steelhead in individual tributaries within the Imnaha basin provides more detailed information on the status of the species than does an aggregate measure of abundance. Tributary population monitoring is needed to more effectively evaluate the efficacy of the Imnaha steelhead production program and the status and trends of the naturally-spawning steelhead population in the subbasin. Additionally, most estimates of adult steelhead abundance in Snake River tributaries occur at Lower Granite dam with apparently little information on steelhead escapement for subbasins and tributaries upstream of Lower Granite. This project proposes to provide this kind of information for the Imnaha subbasin and several of its tributaries.

Considerable attention in the proposal is devoted to identifying general connections between this project and Columbia River Basin Fish and Wildlife Program, Imnaha Subbasin Plan, 2008 BiOp, PNAMP/CSMEP/AHSWG reports and recommendations by the ISRP, Council, NOAA- Fisheries and BPA. The project is consistent with RPAs in the BiOp, the Fish and Wildlife Program, and is complementary to other projects ongoing in the Snake River. It meets several needs identified in the Imnaha Subbasin Plan pertaining to adult summer steelhead escapement, distribution, and movement

The proposed work will be similar to that of two others: a) ISEMP in its fast-track proposal has requested funding to install two PIT tag arrays in the Lower Imnaha River to assist this project in quantification of the distribution and abundance of steelhead in the Imnaha River basin, and b) the Lower Snake River Compensation Plan monitoring through the NPT and ODFW. Is the proposed work fully compatible with these projects?

2. Project History and Results
This is new project. Information on Imnaha steelhead escapement and distribution gathered by previous projects is briefly summarized to provide background and context for this proposal. A version of this project was proposed as a new project in 2002 (#200205600) and received favorable reviews by the ISRP but was not funded.

3. Objectives, Work Elements, and Methods
Objectives were clearly described and seem appropriate. The goal of the project is to establish steelhead population status information in the Imnaha River Subbasin. More specific objectives were embedded in a series of questions with specific tasks identified as objectives such as 1) Installing and maintaining of floating weirs and PIT tag arrays, 2) Quantifying steelhead escapement and collecting fish condition, tag, and tissue data, and 3) Collection of annual stream temperature and discharge.

Objective 3 could be better justified. What is the benefit of measuring temperature and discharge relative to the proposals objectives? How will measurement of these parameters refine escapement estimates?

The proposal seems to concentrate mostly on monitoring adult returns. It appears that juvenile production will be monitored but that is not explained with any detail. The proponents should describe to what extent outmigrants will be monitored? Will the proposed work complete all that is needed for Imnaha steelhead monitoring?

The description of the power analysis [as recommended by NOAA-Fisheries (Crawford and Rumsey 2009, draft)] and methods of data analysis were provided in some detail, but were not entirely satisfactory. Better explanation of power analysis assumptions is necessary and the data analysis section needs to be clarified. References such as Thomson (2002) were not given, although relevant material can be found in Chapter 9 of Thompson, 1992 (“Sampling,” Wiley Interscience). Some notation should be clarified. Note that V(Ratio) is simply V(Ntotal)/(Ntag)2 and define Nno-tag, perhaps in terms of Ntag and Ntotal.

A major objective of the proposed work is to install floating weirs and PIT tag arrays to estimate adult escapement, gather life history data, and collect tissues for genetic analysis of population structure. One set of PIT tag arrays will be placed near the mouth of the Imnaha to estimate subbasin adult escapement and two others will be located on tributaries. Several weirs, including fixed and resistivity weirs are already in place on a number of Imnaha tributaries. The proponents contend that the suite of arrays and weirs (in place and proposed) will allow precise estimation of steelhead escapement.

Funding for the PIT tag arrays at the Imnaha mouth was not requested in this proposal. Rather, the proponents are depending on funding of ISEMP's fast-track proposal (proposal 2003-017-000) which proposes to install the arrays. The proponents of this proposal actually provide a better justification for installation of the arrays than the ISEMP proposal. It is of interest that the proponents did not request funding for the array at the Imnaha mouth in this proposal, but rather they trust that this apparently important part of their work would be funded through another proposal. Are there contingencies in the event that the ISEMP proposal for the Imnaha is not funded?

The proponents should justify why the work requires different types of weirs (floating, resistivity, fixed) as well as PIT tag arrays. They also should clearly present the rationale for location of the weirs and the tributary arrays.

Could the proposed work, in coordination with ISEMP, present an opportunity for testing the efficacy of different types of sampling methods (PIT-tag arrays, floating, resistivity, fixed weirs) for estimating adult returns? If so, it should be one of the objectives with corresponding methods for testing and analysis. Can basinwide adult estimates be derived from the set of upstream arrays and weirs and compared to estimates from the arrays at the river mouth?

A possible concern is comparability of data between tributaries when different methods, with different efficiencies for sampling returning adults (e.g., arrays, different types of weirs) are used. For example, some tests of resistivity weirs in Alaska have identified serious biases in detecting returning adults. How do the proponents plan to handle this potentially confounding issue? Will the efficiencies and biases of the different sampling techniques be directly evaluated in the proposed work?

The proposed M&E work could provide important information on status and trends of adult steelhead abundance in the Imnaha River. Its designation as a high precision population suggests the importance of the steelhead run, although justification for this designation was not clearly presented in the proposal. It seems that the intent is to use the Imnaha as a sort of index stream for other Snake River subbasins and tributaries, but the proponents are not explicit about this use.

Qualification: Analyses using data collected under this proposal – whether conducted by the NPT, FPC, or others – should be increased and documented in future project progress reports and proposals.

Summary: The project provides valuable data for several other projects and management applications in the basin. The project rationale is clearly presented, adequately showing how the data collected and supplied by this project are applied to management issues and decisions. The history of project activities and the time series assembled are outlined in a general sense, at least insofar as what was done (rather than what was discovered).

In a previous ISRP review of this project, the ISRP wrote that 199701501 is not a research investigation but essentially a data collection project. That assessment remains accurate. The objectives are more accurately called sampling and data summary tasks designed to provide the data in a form suitable for a database. The objectives are adequate as far as they go, i.e., as strictly a monitoring project. The project itself is well conducted using appropriate sampling and population estimation methods. The methodologies for this sort of smolt trapping work are identified and referenced, and are adequately standardized.

Although the historical data generated in this project are presented in the proposal, the proponents indicate that interpretation of the data is probably someone else’s primary responsibility, or is at least outside of the scope of the proposal. It is unclear, however, whose responsibility is it to analyze this valuable data.

There remain several opportunities for making more effective use of this 13-year data set. First, in a general sense, it would be helpful for the proponents to discuss the meaning of their results. The tables present the collected data very well. There appear to be some trends, and it would be helpful for the proponents to discuss those possible trends. Besides showing the accumulated data, presenting basic analyses (with narrative) of those data would be required to fulfill the criterion that the project “benefit fish and wildlife” as would interpreting the data and drawing conclusions about effects on the focal fish population and management implications. These data do not need to be dealt with in a routine manner. The results need not just be reported but can also be evaluated and interpreted.

For example, how might accuracy, precision, and bias be evaluated? Would short-term operation of a second trap (if cost-effective), or another approach, provide accuracy and precision estimates? It is not clear what biases may exist in this sampling regime. None of these issues are indicated as being addressed.

As for interpretation of the data collected, there is no research component, no hypotheses are listed, no indications are given of any research analysis designs. There are meaningful hypotheses that can be tested. For example, Roper and Scarnecchia (1999: CJFAS 56:939-946) develop and test several hypotheses around a 3-4 year data nearly identical in form but of much shorter duration than the impressive data set described in this proposal. There are also many other papers cited in that paper where hypotheses are tested with screw trap data on salmonid migrations. Such hypotheses might include an analysis of factors affecting run timing and duration, such as discharges, water temperatures, lunar phase, etc. It might also compare survival rates of early and late migrants. Such hypotheses testing and analyses would provide meaningful information for the Imnaha and be potentially applicable to other areas of the basin. A thorough analysis of this data would not only make full use of this valuable data set, it would show the limitations of the data and improve the sampling design for the future. This appears to be a missed opportunity; there are no refereed publications listed as having emanated from this project by the proponents.

The data are thus not being fully utilized beyond the good use by the FPC and by the LSRCP. The next proposal or project report should preferably describe the analyses conducted or proposed with this data whether through the NPT, FPC, or others.

Qualification: Analyses using data collected under this proposal – whether conducted by the NPT, FPC, or others – should be increased and documented in future project progress reports and proposals.

Summary: The project provides valuable data for several other projects and management applications in the basin. The project rationale is clearly presented, adequately showing how the data collected and supplied by this project are applied to management issues and decisions. The history of project activities and the time series assembled are outlined in a general sense, at least insofar as what was done (rather than what was discovered).

In a previous ISRP review of this project, the ISRP wrote that 199701501 is not a research investigation but essentially a data collection project. That assessment remains accurate. The objectives are more accurately called sampling and data summary tasks designed to provide the data in a form suitable for a database. The objectives are adequate as far as they go, i.e., as strictly a monitoring project. The project itself is well conducted using appropriate sampling and population estimation methods. The methodologies for this sort of smolt trapping work are identified and referenced, and are adequately standardized.

Although the historical data generated in this project are presented in the proposal, the proponents indicate that interpretation of the data is probably someone else’s primary responsibility, or is at least outside of the scope of the proposal. It is unclear, however, whose responsibility is it to analyze this valuable data.

There remain several opportunities for making more effective use of this 13-year data set. First, in a general sense, it would be helpful for the proponents to discuss the meaning of their results. The tables present the collected data very well. There appear to be some trends, and it would be helpful for the proponents to discuss those possible trends. Besides showing the accumulated data, presenting basic analyses (with narrative) of those data would be required to fulfill the criterion that the project “benefit fish and wildlife” as would interpreting the data and drawing conclusions about effects on the focal fish population and management implications. These data do not need to be dealt with in a routine manner. The results need not just be reported but can also be evaluated and interpreted.

For example, how might accuracy, precision, and bias be evaluated? Would short-term operation of a second trap (if cost-effective), or another approach, provide accuracy and precision estimates? It is not clear what biases may exist in this sampling regime. None of these issues are indicated as being addressed.

As for interpretation of the data collected, there is no research component, no hypotheses are listed, no indications are given of any research analysis designs. There are meaningful hypotheses that can be tested. For example, Roper and Scarnecchia (1999: CJFAS 56:939-946) develop and test several hypotheses around a 3-4 year data nearly identical in form but of much shorter duration than the impressive data set described in this proposal. There are also many other papers cited in that paper where hypotheses are tested with screw trap data on salmonid migrations. Such hypotheses might include an analysis of factors affecting run timing and duration, such as discharges, water temperatures, lunar phase, etc. It might also compare survival rates of early and late migrants. Such hypotheses testing and analyses would provide meaningful information for the Imnaha and be potentially applicable to other areas of the basin. A thorough analysis of this data would not only make full use of this valuable data set, it would show the limitations of the data and improve the sampling design for the future. This appears to be a missed opportunity; there are no refereed publications listed as having emanated from this project by the proponents.

The data are thus not being fully utilized beyond the good use by the FPC and by the LSRCP. The next proposal or project report should preferably describe the analyses conducted or proposed with this data whether through the NPT, FPC, or others.

100% of the hatchery steelhead released into the Imnaha River subbasin are marked with an adipose fin clip.  Fish production and marking is supported by the LSRCP.  We do not feel there is an association of RPA 50.7 with project 201003200 given our project is only quantifying adults escapement by origin.  Our project will use internal and external marks to determine fish origin of returning adults.

Viewed in the context that this is essentially a data collection project, the rationale for the presentation of tasks as objectives is understandable. The proposal as constructed must be viewed not as a research investigation per se but a data supply project. The response does an adequate job of showing how the data collected by this project are applied through other analyses and inform management decisions. Interpretation of the data is acknowledged by the presenters as probably someone else's primary responsibility, or is at least outside of the scope of this proposal. However, the sponsors should remain vigilant on staying current on how the information is being used in management decisions to ensure that they are collecting the highest priority data. The proposal is fundable on that basis.