I get your concerns but if it were to happen i'm sure they would put in a fail-safe if things got out of hand. Realistically speaking, we wont be seeing this technology for another 10 years at least. People are worried about technology ruining us, yet they seem to forget that ultimately we control it, not the other way around.
We humans might be lazy and have everything done for us, but we didn't get here by sitting back and letting everything overrun us. We are resourceful and have always been able to pull ahead of everything. I doubt we would be stupid enough to get destroyed by our own technology.
I think this technology is a lot more into the future than just 10 years. Even the experts say that it won't be here before 2050.
And about the fail-safe thing, we are talking about a conscious AI who could re-programme its own programming and make us look like infants in comparison as far as intelligence is concerned.