Does enabling location services on devices really impact privacy, or is it just a common misconception?

I thought that most companies can track you no matter, if your location is active or not? So does it actually make a difference.

Like google, Microsoft and Apple know what my location is, whether I have location active or not.

apple companies devices google impact location location services matter microsoft privacy services thought track