I've heard if you don't read the books it gets a little hard to follow as the time jumps around quite a bit, but some of the characters don't age or age really slowly, so it makes it hard to understand what "time" you're in if you're not paying close attention.
I was thinking about that after I wrote this, if you haven't read the books or played the games, the way they set up the first season it has to be super confusing due to the lack of character development.
The flashback in season one is very confusing.