No you did the right thing and the image you submitted is the best of the bunch!
If you really want to get into architecture photography you’ll want to invest in and learn a good tilt shift lens. Tilt shift lenses are great for correcting these kinds of distortions.
