Fix slight performance regression in classes with custom ``__setattr__`` and speedup even more.