ChatGPT: More than a Weapon of Mass Deception, Ethical challenges and responses from the Human-Centered Artificial Intelligence (HCAI) perspective

ChatGPT as an educational and creative writing assistant

Context: Used in educational settings, including K-12 and higher education, for student support under teacher supervision. It assists with homework, generates content, transforms text styles, and provides tutoring. It is also utilized in creative writing processes for brainstorming and enhancing narrative forms.

Implementation: Educators and writers use ChatGPT as a tool for generating text, answering questions, improving writing quality, and exploring creative ideas in a controlled environment. This includes assistance in mundane writing tasks such as summarization, copywriting, and coding help.

Outcomes: Facilitates knowledge transfer, critical thinking, language learning, and creativity by providing unique ideas and styles. Improves engagement and access to information for students while enhancing writing quality and efficiency in various writing tasks.

Challenges: Risk of over-reliance leading to deskilling, potential for incorrect outputs (hallucinations), ethical concerns regarding academic integrity, and the need to maintain individual authenticity in writing.

AI writing assistants for job seekers

Context: Used in career services for students and job seekers to improve resume quality and increase hiring chances.

Implementation: Algorithmic writing assistance applied to resumes and other job application materials, enhancing the quality and presentation of users' submissions.

Outcomes: Demonstrated increased hire rates among users of the AI-assisted resumes.

Challenges: Potential over-reliance on AI tools and the need to ensure individual authenticity in job applications.

Critiquing AI tools in educational settings

Context: Implementing critical thinking about AI through discussions and critiques in computer science and social science classes.

Implementation: Courses designed to include discussions and critiques of AI tools like chatbots, fostering an understanding of AI ethics and functionalities among students.

Outcomes: Enhanced understanding of AI ethics and functionalities, promoting critical thinking skills.

Challenges: Need for curriculum development and faculty training on AI tools.

Ethical

Concerns about academic dishonesty, such as students passing off AI-generated work as their own, and the ethical implications of using AI in education, including bias and misinformation.

Proposed Solutions: Implement strict guidelines and educational policies to promote academic integrity and responsible AI use, along with training educators on ethical AI use.

Technical

ChatGPT can generate misleading information or 'hallucinations' that users may take as fact, and there are challenges related to the integration of AI tools into existing educational frameworks and curricula.

Proposed Solutions: Incorporate fact-checking mechanisms, promote digital literacy among users to verify AI outputs, and provide professional development for educators to effectively use AI tools.

Social

Over-reliance on AI tools can lead to deskilling and a lack of critical thinking in students.

Proposed Solutions: Educators should emphasize the importance of independent learning and critical engagement with AI outputs.

Access

Disparities in access to technology and AI tools among different educational institutions.

Proposed Solutions: Investing in technology infrastructure and ensuring equitable access for all students.

Project Contact: Dr. Jianhua Yang

LLM Model Version: gpt-4o-mini-2024-07-18

Analysis Provider: Openai