There are many solutions available for online giving that work with WordPress. It is possible to create a button that links to a payment form hosted by your giving solution provider. It is also possible to embed a form for collecting tithes and offerings directly on your website. Some solutions have options for setting up recurring giving.

Please see How can we handle giving? for more information.