Kudos to the EvalForEarth team for giving us this space to connect, share and learn from one another!
For me, what needs to change is how we decide what to evaluate, how we plan for disruption and who has the final say on the findings. In Caribbean small island developing states (SIDS), scenario planning and a portfolio approach can help us make scarce evaluation funds go further while protecting the credibility, independence and usefulness of our work.
Hurricane Beryl offers an example of the impact on the fishing industry. In Barbados, fishing boats were badly damaged. On Union Island in Saint Vincent and the Grenadines, disruptions to water and electricity meant fish could no longer be cleaned or stored. An evaluation of boat repairs could accurately count how many vessels returned to sea and still miss the question that matters to fishing families: Could they get their catch to market and earn a living again?
Three changes I’d like to see in practice:
Plan for disruption to protect credibility. Before fieldwork, ask what we would do if a storm interrupted travel or displaced families. Agree on how to reach people whose experiences might otherwise be missed and be clear about any gaps in the evidence.
Pool resources and protect independent judgement. Programmes supporting boat repairs, landing sites and cold storage could fund one evaluation and coordinate visits. Agree from the outset that evaluators retain control over methods, findings and conclusions, even when several partners share the bill.
Start with the decision the evaluation needs to inform. Ask fishers, vendors and public officials what they need to know before the next round of recovery funding. Their questions can help focus the evaluation and get findings into people’s hands while there is still time to act.
With limited resources, I’d rather we answer a few questions well, protect evaluators’ freedom to report what they find and make sure the evidence reaches the people who can use it.
RE: Evaluation under pressure : Strengthening evidence use, accountability and learning amidst funding constraints (Joint EvalforEarth-ALNAP discussion)
Barbados
Stephanie Bishop
Evaluation Officer
Caribbean Development Bank
Posted on 04/11/2026
Kudos to the EvalForEarth team for giving us this space to connect, share and learn from one another!
For me, what needs to change is how we decide what to evaluate, how we plan for disruption and who has the final say on the findings. In Caribbean small island developing states (SIDS), scenario planning and a portfolio approach can help us make scarce evaluation funds go further while protecting the credibility, independence and usefulness of our work.
Hurricane Beryl offers an example of the impact on the fishing industry. In Barbados, fishing boats were badly damaged. On Union Island in Saint Vincent and the Grenadines, disruptions to water and electricity meant fish could no longer be cleaned or stored. An evaluation of boat repairs could accurately count how many vessels returned to sea and still miss the question that matters to fishing families: Could they get their catch to market and earn a living again?
Three changes I’d like to see in practice:
With limited resources, I’d rather we answer a few questions well, protect evaluators’ freedom to report what they find and make sure the evidence reaches the people who can use it.