You talk about aligning AI with human values. Look all over the world. Do you think human values are what we should strive for?
How about we have AI strive for Godly values. Those are values of perfection. Since all humans sin and come short of the glory of God why would we seek anything less than Godly values.
Ponder these thoughts.