Kind of - the exact direction of your shadow depends on the time of day, the time of year and how far you are from the equator, because the location of the Sun in the sky depends on all those things.
Generally the Sun is eastward in the morning so your shadow then would be roughly to the west and the opposite in the late afternoon. At mid-day the Sun is highest so that is when your shadow is shortest.

Terry