FedRAMP Certification requirements for software?

Does any Software/tools that will be utilized for a FedRamp environment need to be certified?

Specially wondering around tools such as TerraGrunt or even say, VS Code... Or is the focus primarily around the provider environment, its settings and controls? This would be within an Azure GovCloud Enviro with FedRAMP H. I know that outlook for instance must use govclouds secure version, but that's also a communication medium.

Which control specifically would define this by chance?

TIA!

certification cybersecurity fedramp requirements software