After some research, it is an incompatibility between Jetpack and the payment part.
This is since I upgraded to the latest version of Jetpack (13.2.1) earlier this week.
This may be specific to Jetpack, please try disabling HivePress plugin in WordPress/Plugins and test the checkout form again, if this issue persists I recommend reaching out to Jetpack plugin support.