How Simple is Simplicity?