LTC 250-2017 Mystery Rider Program Results for FY 2016_17 Quarter 2MIAMIBEACH
OFFICE OF THE CITY MANAGER
LTC # 250-2017
LETTER TO COMMISSION
TO: Mayor Philip Levine and Members the Citymmission
FROM: Jimmy L. Morales, City Manager
DATE: May 12, 2017
SUBJECT: Mystery Rider Program Results for Y 2016/17 Quarter 2
The purpose of this Letter to Commission is to communicate the results of the newly
developed Mystery Rider Program from FY 2016/17 Quarter 2 (January 1 to March 31,
2017).
The collection of data began in FY 2015 via paper for Alton -West Loop and North Beach
Loop; however, was automated at the beginning of FY 2016. The automation has allowed us
to merge the data and provide program results. The Middle Beach Loop and Collins Link
commenced service on November 22, 2016 and December 22, 2016, respectively. Both
routes were added to Mystery Rider Program effort in FY 2017 Quarter 2. We are working
with the Transportation Department to identify areas for improvement, and have monitored
through FY 2016, with a quarterly Letter to Commission beginning in FY 2017.
Background
The Mystery Rider Program is an objective measurement of performance ranging from 1.0
(Very Well Maintained) to 6.0 (Not Maintained) and includes assessments for bus/trolley
stop amenities, reliability, cleanliness and interior/exterior appearance, customer service,
safety, and maintenance (See attached).
The results of the assessments are used to monitor the impacts of recently implemented
initiatives to target areas for future improvements, and assure the quality of services.
Quarterly sample sizes are set to ensure no greater than ± 5.0 percentage point sampling
error given the 95% confidence level.
Summary of the Mystery Rider Results (Trolley only) FY 2016/17 Quarter 2
Overall, the City Mystery Rider Program (Trolley only) in FY 2016/17 Quarter 2 was a 1.81,
with 74.2% of assessments scoring a 2.0 or better. This represents 13% improvement when
compared to the same quarter in the prior FY.
Areas of Focus (Trolley only)
• Appearance/Cleanliness — Scores in this area improved by 8% when compared to
the previous quarter and remained stable when compared the same quarter in the
prior FY. The score of 2.09 indicates 70.3% of assessments meeting the target.
Staff is requiring submittal of daily vehicle cleaning log by the operator. Staff will
continue to monitor this factor, and work closely with the service provider to ensure
improved performance in the future. Additionally, staff is evaluating the possibility of
incorporation of real-time alerts which would enable improved response times in
connection to vehicle cleanliness.
• Amenities — Stop amenities is a low scoring area at 2.46 and 62.0% of stops
meeting the target; however this is a 13% improvement from the same quarter in the
prior FY. A contract for a design of new bus shelters was awarded at the July 13,
2016 City Commission meeting; however, given the proposed cost of the design
effort, the Administration will be seeking direction from the City Commission on May
17, 2017. Design effort accounts for four (4) bus shelter design styles to provide
flexibility for installation at bus/trolley stops based on right-of-way constraints and
ridership. Currently there are 354 bus stops in the City with only 107 bus/trolley
shelters. Transportation Department is working closely with Clear Channel on
replacement of deteriorated benches and repair or replacement of damaged
elements of the existing bus shelters. Trolley stop signs along North Beach Loop and
Alton -West Loop were replaced with a new sign design providing required trolley
service information. Transportation Department is completing evaluation of the
current stops without a shelter to determine if a trash receptacle or bench can be
installed or if existing amenities need replacement.
Positive and Stable Areas
• Reliability - Results show that trolley reliability scores improved compared to the
previous quarter, scoring 1.98 with 71.8% meeting the target of 2.0. This is a 6%
improvement from the prior quarter and 22% improvement from prior FY quarter.
Transportation Department staff continues to monitor trolley operations and is
enforcing applicable performance penalties as stipulated in the Trolley Agreement.
Staff also continues to review existing headways and on-time performance reports
and is developing new reports that will improve monitoring of service performance.
• Customer Service — Results indicate an average score of 1.86 with 79.7% meeting
the target of 2.0. This is 17% deterioration when compared to the same quarter in the
prior FY, but a 13% improvement from the prior quarter. The Transportation
Department will continue to work with the trolley contractor to provide customer
service refresher courses for all Miami Beach trolley operators. City's Organizational
Development Performance Initiatives staff will provide a supplemental customer
service training to trolley operators on May 18, 2017. Additionally, in order to improve
overall quality of service, six (6) operators were removed from operating along City
routes in the last six (6) months.
Mystery Rider Program Score For All City of M iami Beach Trolley Routes Citywide
Overall M iami Beach Transit Index Score for
All Trolley Routes by Factor (Target=l.5)
FY15/16
Q1
Q2
Q3
Q4
FY Average
Overall
2.14
r 2.09
r 2.14
r 1.99
2.10
Stop Amenities
3 33
2.99
3.13
2 61
3.07
Reliability
2.22
2.53
2.34
2.25
230
Appearance/Cleanliness
2.18
2.06
2.05
1.98
2.09
Customer Service
1.86
154
2.36
2.04
1.92
Safety_
_ - 1.64
- '-
1.55
1.53
1.87
Maintenance
Overall Miami Beach Transit Index Score for
All Trolley Routes by Factor (Target=1.5)
FY16/17
01
Q2
Q3
Q4
FY Average
%Change
from prior qtr
% Change
from prior FY
qtr
% Change
from ba
year Qtt
Overall
2.06
1.81
r -12%
r -13%
r -13%
Stop Amenities
2.66
2.46
-8%
-18%
-18%
Reliability
2.11
1.98
r -6%
* -22%
r -22%
Appearance/Cleanliness
2.26
2.09
-8%
1%
r 1%
Customer Service
2.14
1.86
r -13%
r 21%
r 21%
Safety
1.62
r -17%
r 2%
r 2%
Maintenance
1.59
r -19%
r -39%
r -39%
FY15/16
y Meeti
Q1
02
Q3
Overall
64.0%
69.9%
68.2%
7
04 FY Average
58% 69.5%
Stop Amenities
Reliability
Appearance/Cleanliness
Customer Service
Safety
Maintenance
87.3%
85.6%
66.2%
71.4%
64.9%
87.0%
64.0%
66.9%
78.0%
52.4%
65.9%
70.0%
Overall Miami Beach Mystry Rider Percent
Trolley Meeting Target of 2.0 by Factor
(Target 90%)
FY16/17
Q1
Q2
Q3
Overall
69.6%
74.2%
% Change
44 from base
6%
Fl,rAyar ge
% Change
7%
% Change
from prior FY
6%
Stop Amenities
55.9%
62.0%
11%
13%
Reliability
70.2%
71.8%
2%
15%
Appearance/Cleanliness
65.8%
70.3%
7%
Customer Service
76.9%
79.7%
4%
6%
r -14%
r 13%
P 15%
P 6%
P -14%
Safety
Maintenance
_ 1.0-1.5
1.51-2.0
2.1-6.0
79.999 and below
80 00-89.999
90.0-100
2%
8%
0%
14%
• 0%
P 14%
Score For CMB Trolleys & MDC South Beach Local
by Factor, Agency & Time of Day (Target =1.5)
FY16/17
Q1
Q2
Q3
Q4
FY Average
% Change
from prior
qtr
% Change
from prior
FY qtr
% Change
from base
year Qtr
Stop Amenities
CMB- Time of Day
(8am-4pm)
(4pm-12aml
2.70
2.29
r -15%
r -25%
r -25%
2.64
2.34
r -11%
r -18%
r -18%
MDC -Time of Day
(8am-4pm)
(4pm-12am)
3.08
3.25
r 6%
r 1%
r 1%
3.02
3.23
r 7%
r -5%
r -5%
Reliability
CMB- Time of Day
(8am-4pm)
(4pm-12am)
2.05
2.49
r 21%
r -1%
r -1%
2.26
2.27
r 0%
r -13%
r -13%
MDC -Time of Day
(8am-4pm)
(4pm-12am)
2.51
2.51
r 0%
r 8%
r 8%
2.21
2.02
r -9%
r 5%
r 5%
Appearance
CMB- Time of Day
(8am-4pm)
(4pm-12am)
2.29
2.23
r -3%
r 9%
r 9%
2.26
2.39
r 6%
r 16%
r 16%
MDC -Time of Day
(8am-4pm)
(4pm-12am)
1.96
2.12
r 8%
r -3%
r -3%
2.11
2.15
r 2%
r -11%
r -11%
Customer Service
_
CMO- Time of Day
(8am-4pm)
(4pm-12am)
2.05
2.22
r 8%
r 51%
r 51%
2.36
2.23
-6%
r 33%
r 33%
MDC -Time of Day
(8am-4pm)
(4pm-12am)
1.76
1.60
r -3%
r 3%
r 3%
r -9%
r -18%
r -18%
Safety
CMB- Time of Day
(8am-4pm)
(4pm-12am)
1.66
r -19%
r -2%
r -2%
1.60
r -14%
r 11%
11%
MDC -Time of Day
(8am-4pm)
(4pm-12am)
1.69
r -6%
r 25%
r 25%
r -16%
r 4%
r 4%
Maintenance
CMB- Time of Day
(8am-4pm)
(4Pm-12am)
1.58
r
-21%
r -43%
r -43%
1.64
r -21%
r -32%
r -32%
MDC -Time of Day
(8am-4pm)
(4pm-12am)
1.65
1.71
r 12%
-31%
r -31%
r 4%
r -16%
r -16%
Next Quarter Assessments
City part-time staff is conducting assessments every quarter. Additionally, residents are
always welcome to participate. If you or any member of your staff is interested in
participating in the City's Mystery Rider Program, please contact Dr. Leslie Rosenfeld with
Organization Development Performance Initiatives at extension 6923.
If you have any further questions, please feel free to contact me.
c: Kathie G. Brook, Assistant City Manager
Jose R. Gonzalez, Transportation Director
Dr. Leslie D. Rosenfeld, Chief Learning and Development Officer
A tachment
K BI
Criteria for each area is listed below:
Amenities
Bus/Trolley stop in acceptable condition
• Signage firm in the ground (not lose or fallen)
• No litter around stop, bench or shelter
• Visually clear with no signs of graffiti or stickers
• No gum, sticky material or stain on stop, bench or shelter
• Location free of unpleasant odors
• Stop well illuminated at night or located in a visible area
Bus Trolley stop had the following features
• Bench
• Concrete pad
• Bus shelter
• Signage
• Trash receptacle
Signage provided sufficient information about the bus/trolley route
• Name of the route
• Hours of operation
• Stop ID number
• Map of the route
• Website listed (for additional information)
• Telephone listed (for additional information)
Reliability
Headway between vehicles (SBL)
• 0-20 minutes
• 21-25 minutes
• 26-31 minutes
• 32-27 minutes
• 38-45 minutes
• More than 45 minutes or did not arrive
Headway between vehicles (AWT)
• 0-13 minutes
• 14-18 minutes
• 19-27 minutes
• 28-36 minutes
• 37-45 minutes
• More than 45 minutes or did not arrive
Headway between vehicles (NBT, MBT, CLT)
• 0-10 minutes
• 11-15 minutes
• 16-18 minutes
• 19-22 minutes
• 23-25 minutes
• More than 25 minutes or did not arrive
Appearance / Cleanliness Interior and Exterior
Exterior appearance of the vehicle
• Paint/colors looked noticeable/crisp
• No dust on body of vehicle
• Applicable branding observed
• No body defects on vehicle
• LED signs (digital destination signs) functional and providing accurate
info
• Text on vehicle readable
Driver's appearance acceptable
• Uniform
• Name tag or badge
• Hair/beard trimmed and neat
• Shirt tucked in
• Odor unnoticeable/acceptable
• Closed toe shoes
Interior of vehicle clean condition
• No litter on floor or seats
• No dust or deterioration visible on window interiors
• No pests observed
• No unpleasant odor (trash, urine, defecation)
• No graffiti
• Garbage disposal available
Customer Service
• Greeted with a smile
• Responded to customer in a courteous manner
• Assistance provided upon request or not assistance requested
• Driver announced major intersections or automated stop announcers
functional
• Bus not left unattended (except to assist disabled passengers)
• Driver did not argue with passengers
Safety
Maintenance
• No abrupt stops or speeding
• Waited for passengers to be secured behind yellow line before
moving
• Obeyed traffic laws
• Not eating or drinking while driving
• Not using a cell phone while driving
• No personal belongings obstructing the visual of roadway or the
operation of the vehicle controls
• Acceptable inside temperature
• Functional seat
• Functional interior lighting
• No mechanical issues notices
• No visibly loose or broken interior items
• No visibly loose of broken exterior items