AI Therapy Data Concerns

Young Indians are increasingly using AI-driven mental health apps and chatbots, but data protection laws are struggling to keep pace. A recent study revealed that a significant percentage of mental health apps collect user data for advertising and share it with third parties. Many users are unaware of how their data is processed and have limited concern about potential misuse. The CEO of OpenAI, which built ChatGPT, has stated that conversations with AI chatbots lack the legal safeguards of traditional therapy sessions. This raises concerns about the confidentiality and potential vulnerability of sensitive user information in legal proceedings or government requests.

Unlike regulated healthcare, AI therapy operates in a legal grey area, potentially collecting personal information without clear consent or oversight. Experts are calling for stronger regulations and industry guardrails to protect user data and ensure ethical AI practices. They emphasise the need for transparency and user control over their data, as well as the implementation of privacy-enhancing technologies to prevent bias and manipulation. As AI adoption grows, balancing innovation with data privacy is crucial to safeguard sensitive information and maintain user trust.

Without legal protection, AI interactions could be disclosed in court.