Learning Experience Designer
EVALUATION OF INSIGHTS DISCOVERY PROGRAM
Welcome to my CV & Portfolio. Please take a moment to browse my work, skills, and professional experience. It’s my firm belief that a good challenge offers an opportunity to develop and improve, which is why I make a point of seeking out new ones in the professional realm as well as in my personal life. Contact me directly to learn more.
ABOUT THIS PROJECT
In 2018, the Insights Discovery program was implemented within Connect, Inc (a pseudonym). This program was introduced to create a common language around communication and assist employees with understanding why they struggle to communicate with others.
Three years after the initial implementation of Insights Discovery, the need for a formative evaluation was identified to understand opportunities where content application and implementation can be better supported and improved.
The Global Talent Development team at Connect agreed to partner with the evaluation team to conduct this program evaluation.
PROFICIENCIES
PROJECT DETAIL
Type: Evaluation ProjectÂ
Client: Connect, Inc    Â
Duration: 4 months
TOOLS
Chyung’s 10-step evaluation procedure
Kirkpatrick’s 4-level model of evaluation
Bloom’s taxonomy of educational objectives
SKILLS
Performance Analysis
Needs Assessment
Evaluation
Performance Improvement
COMPLIANCE
American Evaluation Association (AEA)’s guiding principles for evaluators
ISPI’s code of ethics
ISPI’s standards for performance improvement
BACKGROUND
Organization
Connect, Inc. (a pseudonym) designs software for flexible work. Connect’s software provides customers with tools for unified communication and collaboration, IT management, and support, including cloud-based phone systems, video/webinar meeting systems, contact center solutions, and IT remote access and support tools.The company has approximately 3,700 employees/contractors in a dozen countries. Since the global Covid pandemic in 2020, Connect adopted a hybrid-remote work model where the majority of employees work from home and/or spend limited days in an office.
In 2018, the Insights Discovery program was implemented within Connect. This program was introduced to create a common language around communication and assist employees with understanding why they struggle to communicate with others. In addition to engaging learning content, Insights Discovery offered the benefit of a team-building activity and the continued benefit of continuous application of the knowledge and concepts learned to increase team engagement and build respective, productive, and positive working relationships.
Since launching the program in 2018, over 1,400 (37%) of the company's current employees have completed the training. In the first two months of 2022, Connect's T&D team facilitated four Insights Discovery workshops. Connect adopted Insights Discovery without conducting a formal needs analysis. Participants' informal feedback is positive, but Connect has yet to collect formal feedback regarding the program and how it can be improved to be more effective.
Insights Discovery Program
Insights is an external company that provides people development programs that help companies worldwide get the best from their people at work. Insights offers learning solutions that support teamwork, leadership, change, sales and service, and culture and engagement.This program focuses explicitly on self-awareness by using a four-color model to help individuals learn more about their personal preferred communication styles and behaviors. A personal profile produced for each participant details strengths and value they bring to a team, challenges they're likely to face, and communication strategies for working with others.
The program consists of an initial course called Insights Discovery and custom follow up workshops. Insights Discovery is a 2.5 hour virtual, instructor-led course.The course costs approximately $107 per participant, which covers the cost of producing a unique Insights Discovery Personal Profile for each participant. The course is available to teams based on manager requests and budget approval. After managers arrange a training session with facilitators, each participant completes a questionnaire, which results in the Personal Profile participants receive during the course. Connect offers additional follow-up workshops to teams upon request. The follow-up workshops are based on the team's needs and are custom-created by one of the certified facilitators using Insights’ content and materials.
STAKEHOLDERS
UPSTREAM STAKEHOLDERS
Three facilitators within Connect are certified, through Insights, to deliver the training. It is their responsibility to maintain and provide the course and workshop content.
CLIENT
The client is the Vice President of Talent Development for Connect. She is responsible for ensuring the benefits of the Insights Discovery Program for Contact. The three facilitators and the financial management of Insights Discovery fall under her mandate.
DIRECT IMPACTEES
The direct impactees are the teams that have attended the course or follow-up workshops within the Insights Discovery Program. Since Connect has implemented the Insights Discovery Program, over 1,400 employees have participated in the training. In 2021 alone, there were 645 direct impactees.
INDIRECT IMPACTEES
The indirect impactees interact with the participants who have attended the Insights Discovery Program. These individuals could be other internal team members within or external to their department, members of leadership, or external customers.
EVALUATION METHODOLOGY
Evaluation Goal
The client and upstream stakeholders intend to use the evaluation findings to identify areas for improvement, the team conducted a formative evaluation. The evaluation team understood that the evaluation findings would be used by the client to:
Obtain data on whether participants can apply what is taught in the Insights Discovery Program.
Identify where there may be gaps in applying the concepts taught
Identify strategies to reinforce and/or follow up to help with the content application.
Process
The evaluation team employed an evidence-based 10 - step evaluation process (Chyund,2019) to conduct the identification, planning, and implementation phases of the project. (See Figure 1)
