Set the object back to the origin and then make the changes, or
Build the changes on the object in its new position and then apply movement transformations, etc