When I push an order to a Source store, does the payment I already captured get pushed over as well?

The payment doesn't get pushed to the source store. Right now, the Source store will need to manually invoice the Destination store for any orders they fulfill.

However, you can save time managing commissions and payment records for synced orders, with our Payouts add-on (available only with our Shopify integration).