Does Modular provides GPU machines if so what is the cost of it?

Welcome. Modular does not provide GPU. The list of supported GPU is here. There is the option to use your CPU. For more information see MAX can now be used in Google Colab