You are right, I rewrote it so that I use the Grabber and that solved it!
I didn't use it from the start, as the experience was a bit limiting with larger objects due to measuring the distance to the objects center when grabbing.
But in
this thread you provided a solution for this and now it works well!
Would be great if setting bounding box vs. object center would be an argument in the standard grabber tool!
Thanks!