Yes it is easy to just let the phone take care of your child, I'm sure most parents are guilty of this to some degree, myself included.
My wife and I made it a point to minimize the time our toddler spend staring at a TV / laptop / handphone. If he is watching them, we try to make time to watch it with him and teach him to repeat words and phrases spoken in the videos.