Green Ship Program Process and Outcome Evaluation Design

MEMO
To: Port of Long Beach
From: Port of Long Beach Air Quality Team, Administrator
Date: June 25, 2021
Subject: Green Ship Program Process and Outcome Evaluation Design
-19050186055
The Green Ship Incentive Project aims at protecting and improving the quality of local air by bringing the greenest/newest ships with clean engines that reduce hazardous emissions from the ships that pollute the air. The proposed process evaluation design encompasses participation and fidelity to measure and analyze activities and output design by identifying the participants and their implementation on the program. The program will use a quasi-experimental with only program participants. Survey questionnaires will be used to collect data from shippers participating in the program to assess the program's effectiveness regarding its outcome of changing the behavior of the shippers to improve the environment and its impact of improving the quality of the quality local air in San Pedro Bay. It will help to measure the suitability and efficacy of the program.
Process Evaluation Design
Participation: The attributes of participants-shippers will be captured from the Shippers Board. Data collected from the survey questionnaire will have information that includes the shipper's name, number of ships, ship size, load capacity, fuel consumption, and engine displacement. Participating shippers will be grouped using a non-random technique. Data collection will be done at the onset of the program. However, a proposal is made to conduct an exit interview to capture all the information regarding the ships that qualify for incentives compared to newer ships and retrofitted ships to reduce air pollution.
Fidelity: Fidelity measures the alignment between the program as designed, that is, the activities and its implementation, that is, the outputs. It determines the program's eligibility by identifying the number of ships that qualify to participate in the incentive program. The activities and outputs link directly to the qualifying shippers, who are then shortlisted and added to the program. The activities and output link include: evaluating ships based on standards established by Air quality team and the environmental ship index. Outreaching participating ships where business development runs the payment of the program and creates a partnership between POLB and ship owners to measure several ships that received the payment and participates in the program. Conducting surveys provide necessary data such as the likes and dislike giving feedback to the shipholders and measure their responses and outlook toward the program, thereby improving functions for the future.
Outcome/Impact Evaluation Design
Data Evaluation & Design: A quasi-experimental design with only program participants will be used to measure the outcome and impact for participating shippers. This design with only program participants allows no matching control group. A quasi-experimental design is used due to its feasibility in establishing the association between superior program outcomes and impacts. This design compares post and follow-up data to baseline data(pre-program) to analyze the program's effectiveness to enhance the required environmental behaviors and meet local, stat...