Why?
Defining an evaluation framework is, together with the problem definition, the most important stage of a procurement, permitting (or at times even regulatory) action.
It is also an important signal to operators and other stakeholders about your intentions, trustworthiness and commitment to delivering the best community outcomes.
Example
Barcelona created the BCN Open Challenge to procure innovative solutions against bicycle theft. The RFP was open to any business with at least a prototype, highlighting the importance of evaluation to select new ideas from often small suppliers.
Barcelona designed a two-step selection process with stage 1 being an ‘ideas competition’ whose winners would pre-qualify to a ‘negotiated procedure’.
Evaluation criteria focused on community and environmental outcomes and the city convened an expert panel of business professors to evaluate the financial sustainability of proposed solutions.
Deliverables
Define selection criteria
Used to qualify the bidder. The question here is ‘can they do it’. Be thoughtful about creating a level playing field for diverse proposers.
Define award criteria
Used to evaluate the good or services that are being offered and should identify which of the eligible bidders offer the best value for the community.
Who is evaluating
Your evaluators should represent the perspectives of your stakeholders and be in a position to make a competent decision. Remember that mobility solutions typically include behavior, social, technical and financial issues.
Process
You should determine and advertise the process upfront. You have a lot of room to be creative and include steps like interviews, pilots or sub-panels on usability, sustainability etc.