This section is dedicated to the Key Performance and Impact Indicators based on the Keyway Map of Impacts. The Keyway project partners have developed a list of 44 indicators that services can use to help them measure the progress they are making towards reaching their objectives and goals.
Welcome to the Keyway Performance and Impact Indicators! Follow these simple steps to develop your guidance service’s Performance and Impact Evaluation Plan: 1. Check out the Keyway Guide for instructions and detailed information on methodology. 2. Review the Keyway Indicators and select the indicators that are most adequate for your organisation and the objective of your evaluation process. 3. With a list of indicators selected, collect data from exisiting sources, and/or develop questionnaires and tools to collect this data from your service users. 4. Once you have colllected the data, introduce the data in the Results tab of the Excel file. 5. Display and publish your results. Check out the Guide to get ideas.
Indicator database legend:
Area Corresponding area on the Keyway Impact Map
Subarea Corresponding subarea on the Keyway Impact Map
Number Number to easily identify the indicator
Name Name of the indicator
Definition of the indicator Definition of the indicator, with a description of the calculation
Population Population of users to which the indicator applies (general, adults, young people)
Specific population Specific population to which the indicator is of most interest, with age ranges indicated to ensure maximum comparability.
Data source Source of data for the guidance service
Timetable Proposal of when to assess indicators
Typology Type of indicator
Examples of questions Examples of questions to measure the indicator
Scale Scale to measure the indicator
Reference source Origin of the proposed indicator and source where comparative data can be found
| Area | Subarea | Number | Name | Definition of the indicator | Population | Specific population | Data source | Timetable | Typology | Reference source | Notes |
|---|---|---|---|---|---|---|---|---|---|---|---|
| Guidance service | Context | C1 | Users | Total number of guidance service users in the last year | general | general | Guidance service data | Direct outcome | |||
| Guidance service | Context | C2 | Number of professionals | Number of guidance practitioners working | general | general | Guidance service data | Direct outcome | |||
| Guidance service | Context | C3 | Profile of guidance users | Description of guidance users | general | general | Guidance service data | Descriptive | |||
| Guidance service | Context | C4 | Context of reference for KPIs | Level of comparison chosen for evaluating the KPIs | general | general | Guidance service data | Descriptive | |||
| Guidance service | Context | C5 | Number of guidance hours | Total number of guidance hours given throughout all services and programs | general | general | Guidance service data | Direct outcome | |||
| Individual | Personal | 1 | Self-efficacy | % of individuals who report higher self-efficacy | general | general | Self-report/Guidance practitioner report | Baseline/ End /6 months | Indirect-long term outcome | Chen, G., Gully, S. M., & Eden, D. (2001) | |
| Individual | Personal | 2 | Optimism | % of individuals who report a more positive attitude about work | general | general | Self-report/Guidance practitioner report | Baseline/ End /6 months | Indirect-long term outcome | NORTH_IR_EGSA Economic Value Study | |
| Individual | Personal | 3 | Career optimism | % of individuals who report a more positive attitude about their career | general | general | Self-report/Guidance practitioner report | Baseline/ End /6 months | Indirect-long term outcome | Rottinghaus, P. J., Day, S. X., & Borgen, F. H. (2005). The Career Futures Inventory: A measure of career-related adaptability and optimism. Journal of Career Assessment, 13, 3–24. | |
| Individual | Personal | 4 | Motivation about training | % of individuals who report being more motivated | general | general | Self-report/Guidance practitioner report | Baseline/ End /6 months | Indirect-long term outcome | (UKrr638) Tyers, C., & Sinclair, A. (2015). Intermediate Impacts of Advice and Guidance. | |
| Individual | Personal | 5 | Motivation about work | % of individuals who report being more motivated | general | general | Self-report/Guidance practitioner report | Baseline/ End /6 months | Indirect-long term outcome | (UKrr638) Tyers, C., & Sinclair, A. (2015). Intermediate Impacts of Advice and Guidance. | |
| Individual | Personal | 6 | Coping with transitions | % of individuals who report being more able to cope with adversities | general | general | Self-report/Guidance practitioner report | Baseline/ End /6 months | Indirect-long term outcome | ||
| Individual | Personal | 7 | Pro-activity | % of individuals who report being more pro-active | general | general | Self-report/Guidance practitioner report | Baseline/ End /6 months | Indirect-long term outcome | Bateman, T. S., & Crant, M. J. (1993). The proactive component of organizational behavior: A measure and correlates. Journal of Organizational Behavior, 14,103–118 | |
| Individual | Personal | 8 | Career adaptability work related | % of individuals who report being more adaptable to diverse work settings | adults | employed | Self-report/Guidance practitioner report | Baseline/ End /6 months | Indirect-long term outcome | Rottinghaus, P. J., Day, S. X., & Borgen, F. H. (2005). The Career Futures Inventory: A measure of career-related adaptability and optimism. Journal of Career Assessment, 13, 3–24. | |
| Individual | Personal | 9 | Career adaptability in general | % of individuals who report adapting better to change in career plans | general | general | Self-report/Guidance practitioner report | Baseline/ End /6 months | Indirect-long term outcome | Rottinghaus, P. J., Day, S. X., & Borgen, F. H. (2005). The Career Futures Inventory: A measure of career-related adaptability and optimism. Journal of Career Assessment, 13, 3–24. | |
| Individual | Personal | 10 | Emotional control | % of individuals who report being more able to control their emotions | |||||||
| Individual | Personal | 11 | Life satisfaction | Mean level of life satisfaction | general | general | Self-report/Guidance practitioner report | Baseline/ End /6 months | Indirect-long term outcome | Diener, E. D., Emmons, R. A., Larsen, R. J., & Griffin, S. (1985). The satisfaction with life scale. Journal of personality assessment , 49 (1), 71-75. | |
| Individual | Personal | 12 | Job satisfaction | Mean level of job satisfaction | adults | employed | Self-report/Guidance practitioner report | Baseline/ End /6 months | Indirect-long term outcome | (UKrr638) Tyers, C., & Sinclair, A. (2015). Intermediate Impacts of Advice and Guidance. | |
| Individual | Personal | 13 | Career satisfaction | Mean level of career satisfaction | general | general | Self-report/Guidance practitioner report | Baseline/ End /6 months | Indirect-long term outcome | Greenhaus, J.H., Parasuraman, S.J. and Wormley, W.M. (1990), “Effects of race on organisational experiences, job performance evaluations, and career outcomes”, Academy of Management Journal, Vol. 33, pp. 64-86. | |
| Individual | CMS | 14 | Personal effectiveness/Self-knowledge | % of individuals who report knowing better themselves | general | general | Self-report/Guidance practitioner report | Baseline/ End /6 months | Learning-direct outcomes | The LEADER Framework for Careers _ extended_July 2017 | |
| Individual | CMS | 15 | Personal effectiveness/Self-knowledge | % of individuals who report being more aware of strengths and weaknesses | general | general | Self-report/Guidance practitioner report | Baseline/ End /6 months | Learning-direct outcomes | The LEADER Framework for Careers _ extended_July 2017 | |
| Individual | CMS | 16 | Managing relationships/Interaction skills | % of individuals who report interacting more confidently | general | general | Self-report/Guidance practitioner report | Baseline/ End /6 months | Learning-direct outcomes | The LEADER Framework for Careers _ extended_July 2017 | |
| Individual | CMS | 17 | Managing relationships/Networking skills | % of individuals who report having extended their professional network to include active and quality contacts | general | general | Self-report/Guidance practitioner report | Baseline/ End /6 months | Learning-direct outcomes | The LEADER Framework for Careers _ extended_July 2017 | |
| Individual | CMS | 18 | Finding and accessing work/Access to information | % of individuals who report having improved their access to information about work or education | general | general | Self-report/Guidance practitioner report | Baseline/ End /6 months | Learning-direct outcomes | The LEADER Framework for Careers _ extended_July 2017 | |
| Individual | CMS | 19 | Finding and accessing work/Search for new options | % of individuals who report being more aware of new career options | general | general | Self-report/Guidance practitioner report | Baseline/ End /6 months | Learning-direct outcomes | The LEADER Framework for Careers _ extended_July 2017 | |
| Individual | CMS | 20 | Finding and accessing work/Coping with changes related to work | % of individuals who report being more able to cope with changes/transitions in education and work | general | general | Self-report/Guidance practitioner report | Baseline/ End /6 months | Learning-direct outcomes | The LEADER Framework for Careers _ extended_July 2017 | |
| Individual | CMS | 21 | Managing life and career/Setting career goals and career planning skills | % of individuals who report having improved their career planning skills | general | general | Self-report/Guidance practitioner report | Baseline/ End /6 months | Learning-direct outcomes | The LEADER Framework for Careers _ extended_July 2017 | |
| Individual | CMS | 22 | Managing life and career/Self-organisation | % of individuals who report having improved their career-life balance | adults | employed | Self-report/Guidance practitioner report | Baseline/ End /6 months | Learning-direct outcomes | The LEADER Framework for Careers _ extended_July 2017 | |
| Individual | CMS | 23 | Understanding the world/Awareness of learning and work changes | % of individuals who report being more aware of changes in learning and work over time | general | general | Self-report/Guidance practitioner report | Baseline/ End /6 months | Learning-direct outcomes | The LEADER Framework for Careers _ extended_July 2017 | |
| Individual | Career | 24 | Engagement in lifelong learning | % of service users who report having participated in education or training in the 6 months preceding the survey | adults | aged 25-64 | Self-report/Guidance practitioner report | Baseline/1 year | Indirect-long term outcome | Eurostat: http://ec.europa.eu/eurostat/tgm/table.do?tab=table&init=1&language=en&pcode=tsdsc440&plugin=1 | |
| Individual | Career | 25 | Education attaintment/Early school leavers | % of service users aged 18-24 with at most lower secondary education and are no longer in education or training | young people | aged 18-24 | Self-report/Guidance practitioner report | Baseline/1 year | Indirect-long term outcome | Eurostat: http://ec.europa.eu/eurostat/tgm/table.do?tab=table&init=1&language=en&pcode=tsdsc410&plugin=1 | Reversed |
| Individual | Career | 26 | Education attaintment/ Abandonment | % of service users that have abandoned a formal qualification | adults | aged 25-64 | Self-report/Guidance practitioner report | Baseline/1 year | Indirect-long term outcome | OECD: Survey of Adult Skills | Reversed |
| Individual | Career | 27 | Re-engaging in education | % of service users with at most lower secondary education that after a period of at least 6 months not being in education or training re-engage in education | young people | aged 18-24 | Self-report/Guidance practitioner report | Baseline/ 6 months | Indirect-long term outcome | ||
| Individual | Career | 28 | Right choice of studies | % of service users who report having make the right choice of studies, education or training | general | general | Self-report/Guidance practitioner report | Baseline/ 6 months | Learning-direct outcomes | Eurobarometer 417 (modified) European Area of Skills and Qualifications Report | |
| Individual | Career | 29 | Enhanced carrier options/Entrepreneurship | % of adults (25-64) entrepreneurs (freelance, setting up own business) during the last year | adults | aged 25-64 | Self-report/Guidance practitioner report | Baseline/1 year | Indirect-long term outcome | (UKrr638) Tyers, C., & Sinclair, A. (2015). Intermediate Impacts of Advice and Guidance. | |
| Individual | Career | 30 | Enhaced carrier options/International mobility | % of individuals enrolling on international mobility programmes or labour mobility | general | aged 18-54 | Self-report/Guidance practitioner report | Baseline/1 year | Indirect-long term outcome | AQU: http://www.aqu.cat/doc/doc_56174010_1.pdf | |
| Individual | Career | 31 | Reduced unemployment periods | Mean number of months of unemployment among economically active service users during the last year | adults | economically active population | Self-report/Guidance practitioner report | Baseline/1 year | Indirect-long term outcome | Reversed | |
| Individual | Career | 32 | Transitition to Tertiary education/Time | Mean number of months not in education or training after finishing compulsory education among service users enrolling in post-compulsory education | young people | post-compulsory students | Self-report/Guidance practitioner report | Baseline/1 year | Indirect-long term outcome | Reversed | |
| Individual | Career | 33 | Transitition to Tertiary education/Decision-making | % of service users who report knowing what to study after compulsory education | young people | post-compulsory students | Self-report/Guidance practitioner report | Baseline/ 6 months | Indirect-long term outcome | ||
| Individual | Career | 34 | School-Work transition/NEET | % of young service users neither in employment nor in education and training (NEET) | young people | aged 15-24 | Self-report/Guidance practitioner report | Baseline/ 6 months | Indirect-long term outcome | Eurostat: http://ec.europa.eu/eurostat/tgm/table.do?tab=table&init=1&language=en&pcode=tipslm90&plugin=1 | Reversed |
| Individual | Career | 35 | School-Work transition/Time for employment | Number of months for first employment after graduation among economically active service users | adults | economically active population | Self-report/Guidance practitioner report | Baseline/1 year | Indirect-long term outcome | Eurostat (modified) http://ec.europa.eu/eurostat/tgm/web/table/description.jsp | Reversed |
| Societal | Education | 36 | Early School Leaving | (Reversed) % of individuals aged 18-24 with at most lower secondary education and are no longer in education or training during the last four weeks preceding the survey | young people | aged 18-24 | Local-Region-Country statistics | Baseline/ 6 months | Indirect-long term outcome | Eurostat: http://ec.europa.eu/eurostat/tgm/table.do?tab=table&init=1&language=en&pcode=tsdsc410&plugin=1 | |
| Societal | Education | 37 | Access to education and training/Upper secondary | % of people aged 20-24 who have successfully completed at least upper secondary education | adults | aged 20-24 | Local-Region-Country statistics | Baseline/1 year | Indirect-long term outcome | Eurostat: http://ec.europa.eu/eurostat/tgm/table.do?tab=table&init=1&language=en&pcode=tps00186&plugin=1 | |
| Societal | Education | 38 | Access to education and training/Tertiary | % of the population aged 30-34 who have successfully completed tertiary studies (e.g. university, higher technical institution, etc.). | adults | aged 30-34 | Local-Region-Country statistics | Baseline/1 year | Indirect-long term outcome | Eurostat: http://ec.europa.eu/eurostat/tgm/table.do?tab=table&init=1&language=en&pcode=tsdsc480&plugin=1 | |
| Societal | Education | 39 | Access to learning | % of adults (25-64) obtaining a qualification | adults | aged 25-64 | Local-Region-Country statistics | Baseline/1 year | Indirect-long term outcome | ||
| Societal | Education | 40 | Access to information/Education | % of individuals who report finding the needed information about education/training courses or interships/traineeships/apprenticeships | general | general | Local-Region-Country statistics | Baseline/End/6 months | Learning-direct outcomes | Eurobarometer 417 (modified) European Area of Skills and Qualifications Report | |
| Societal | Education | 41 | Transitition to Tertiary education/Time | Mean number of months not in education or training after finishing compulsory education among individuals enrolling in post-compulsory education | young people | post-compulsory students | Local-Region-Country statistics | Baseline/1 year | Indirect-long term outcome | Reversed | |
| Societal | Employment | 42 | Access to information/Work | % of individuals who report finding the information for job-seeking | general | general | Local-Region-Country statistics | Baseline/End/6 months | Learning-direct outcomes | ||
| Societal | Economic | 43 | Public costs of ESL | Estimate of public costs from % of Early School Leavers & Cost per Early School Leaver (lifetime) | young people | aged 18-24 | Local-Region-Country statistics | Baseline/1 year | Indirect-long term outcome | Eurostat: http://ec.europa.eu/eurostat/tgm/table.do?tab=table&init=1&language=en&pcode=tsdsc410&plugin=1 & Overview and examples of costs of early school leaving in Europe | |
| Societal | Community | 44 | Access to information/Social resources | % of individuals that report knowing well community social services or resources | general | general | Local-Region-Country statistics | Baseline/1 year | Indirect-long term outcome |
How was the Keyway Impact Indicator Database developed? Part of the process included the consultation and validation of the indicators with Academic and Career Guidance Experts. The report from this process and the feedback from the 47 experts can be found below.