Ok, I like where you're going with this.
Would you perhaps say, INACTION IS NEVER IMMORAL?
Yes, I would.
Well, we appear to be on the same side of this at the moment.
Now, purely hypothetically,
What if your grandparents made a contract with a bunch of people to give them a bunch of land they could presumably hunt and farm on (so they could stay alive) and then changed the deal and gave them much less land than they had promised and also polluted the water supply and killed off the animals.
You didn't do any of this.
But you know, hypothetically, what if your grandparents did this.
Does the passage of time magically make "wrong" things "normal"?