You are not alone. With time series that is the easiest solution for any model. That is why you need a lot of work creating your datasets and the experiment setup with time series. To avoid the easy solution and obtain something useful.