I think we will face challenges either way. When someone misuses it, we will all feel the consequences.
When we do, we will not feel it, but will face the consequences too.
As there is no such thing as a free lunch, everything in this universe tends to seek balance.
And so does the use of some of our skills.

Those that are being replaced by any form of external entity will atrophy. If we ‘outsource’ our natural-given orientation skills to GPS, they atrophy with time. If we provide our body with the external souce of certain hormones for a longer period of time, for example, the organs that are responsible to produce those, ‘atrophy’.

Since doing also means training, enforcing, when we outsource our certain mind processes, we can expect those to atrophy as well.
We, as ‘ultimate adaptable machines’ can adapt to the changes in the environment, but we need time for that. But the problem might be with artificial, technological systems, that can stop working with a simple flip of a switch.

Just thinking about it…