Google on Tuesday unveiled a dermatology app that it says can recognize 288 different skin conditions from pictures, and there’s something very Google about it. The deep learning system the app is based on was originally trained and tested on a dataset that—like the company itself—vastly underrepresents people with dark skin tones.
As a result of the biased sampling, dermatologists say the app could end up over- or under-diagnosing people who aren’t white.
Google’s New Dermatology App Wasn’t Designed for People With Darker Skin
