Not sure if my thread should be here in testing or it concerns philosophy... Actually, it is about both.
Some software devs were put under control of AI, it played a role of their project manager. AI fulfiled its obligations with flying colors but it was a complete fail for humans as a big part of a team was fired by a machine. How We Put Our Team Under Artificial Intelligence Control - Qubit Labs Can we call such testing successful?
IMHO, yes. People will have to suffer a bit to give AI a chance to study. In the nearest future developers will improve AI and it'd be more human-like in terms of emotions.