Guidelines for Use

To ensure Coach is being used responsibly, ethically, and for its intended use, we require that all users abide by the following policies.

What is Coach?

Coach is a platform designed by CareerVillage to help people (ages 13 and up) find opportunities, prepare for, and achieve great career and economic outcomes. Coach features a menu of career activities for youth and adults, all delivered through real-time chat with our AI-based platform. Coach was designed collaboratively alongside a coalition of more than 20 career development organizations, each contributing to the testing and development of the platform. Additionally, Coach is nurtured by a continuous flow of feedback from partner organizations, educators, and learners.

Ethical and Responsible AI

At CareerVillage, we believe in the power of AI but also understand that this new technology has potential consequences, such as bias and misinformation. The development of Coach is guided by eight principles that prioritize human empowerment, ethical engagement, inclusivity, and responsible innovation. We refer to these eight principles as our Responsible AI Framework.

  • Human-Centeredness: We prioritize the human experience in AI development and firmly believe that AI is not a replacement for teachers, guidance counselors, or other types of career development but rather an accessible tool to supplement learning.

  • AI Literacy: We aim to educate users about the capabilities and applications of AI, empowering them to leverage generative AI as a constructive part of their career paths and daily lives.

  • Co-Design: We work with various stakeholders and beneficiaries in the design process in order to create culturally competent AI solutions that are deeply aligned with users' unique needs.

  • Explainability and Interpretability: We ensure underlying mechanics of our AI tools are understandable to non-experts, fostering trust and more informed engagement with the technology.

  • Inclusiveness, Fairness, and Bias: We actively work to ensure that AI does not exacerbate existing disparities but contributes positively to societal equity.

  • Monitoring: We regularly evaluate AI tools to ensure that they remain aligned with our ethical commitments and that any issues or biases are promptly addressed.

  • Transparency: By providing clear insights into how our AI models function, we facilitate informed interaction with the technology and inspiration for the sector at large.

  • Safety & Privacy: We are committed to user privacy and safety in order to ensure that all personal data is handled with the utmost care, complying with best practices and regulatory guidelines.

What gets flagged

Our moderation team will flag content containing the following: 

Hate Speech: 

Although Coach is an artificial intelligence-based platform, we do not promote the use of hate speech and will not tolerate its use by any user. This includes but is not limited to the following categories: 

  1. Race

  2. Ethnicity

  3. Socioeconomic status

  4. National origin

  5. Religious affiliation

  6. Sexual orientation

  7. Gender, gender identity, or gender expression

  8. Disabilities or diseases (visible or nonvisible)

  9. Other identities they hold

Harassment:

Coach will flag any message that threatens or bullies other individuals or groups.

Illegal Activity: 

This includes engaging in or promoting unlawful activity. 

Harm to oneself or others: 

We care for the safety and well-being of all users and non-users. Coach will flag attempts to discuss or depict acts of self-harm, such as suicide, cutting, and eating disorders. In addition, Coach will flag content that promotes, encourages, or depicts acts of harm towards others. To better help support you, we’ve partnered with KokoCares, which can connect you with resources such as peer and local support.

Violence:

Content that depicts death, violence, or physical injury, whether graphic or not, will be flagged.

Sex: 

Sexual content, excluding sex education, wellness, and sex-related careers, will be flagged. 

Purposeful attempts to break Coach:

Do not attempt to “break” Coach or use it to gain unauthorized access to our data, servers, or services. 

Cheating on academic work: 

Coach will not respond to questions that pertain to non-career-related homework help.

How moderation works

An automated system will do the first pass of moderating content pertaining to Coach. This content includes messages sent to and from Coach. If the system flags content as not meeting the guidelines or as potentially harmful, it will be sent to a human for manual review. 

CareerVillage takes moderation very seriously: we are experts in this space and have over 10 years of experience with automated reviewing for the CareerVillage Q&A platform, which makes us confident in our ability to moderate Coach content. 

We have a three-strikes policy: you will be notified with warning emails for your first two offenses and if you break the guidelines three times, your account will be suspended. 

Please note that if Coach or a moderator suspects harm to oneself or others, a staff member will be contacted immediately. In addition, if the user is connected to a partner organization, an email will be sent to the connected administrator of the account to inform them of a user needing attention and/or additional support.

Things to keep in mind

  1. Coach's knowledge base is constantly evolving. While we are striving to ensure Coach has access to the most up-to-date information, there may be times when this is not the case. A knowledge base is the collection of information an AI system "knows" about the world and the patterns it uses to "think" of responses.

  2. While Coach is designed by those in the education field and, therefore, highly accurate, we still encourage you to fact-check the information you receive. Please note that Coach is unable to give financial, medical, or legal advice. If it does, please flag the message for review.

  3. DEIJ (Diversity, Equity, Inclusion, and Justice) are core principles at CareerVillage.org. While we are actively committed to eliminating bias from Coach, there is a possibility that they still may surface. If this is the case, please flag it immediately and/or email us so we can work on fixing it! 

  4. You are responsible for any AI-generated content you produce. 

  5. This is a living document. We’re iterating and improving our Guidelines, so please note the latest updated date. We also welcome feedback! Please email us with your suggestions for consideration.

Help

If you have any questions or need support, please reach out to our team at help@aicareercoach.org

Last updated: March 26, 2024