We gifted this wooden train set to my son and I would say he really started to get into building tracks at age 3. I love that these sets come a bucket for storage that is also part of the track, so you can keep all the parts organized easily.
Larger Farm 75 PC Set linked here.