Hi Andrew,
If you want to keep the layout in all of your wooCommerce template then you need to dig a little bit. So first please copy the WooCommerce templates to your theme. You need to copy archive-product.php. For folder structure, you can check this documentation. https://docs.woocommerce.com/document/template-structure/ .
Then you should generate the Generic shortcode and then replace the loop part of archive-product.php with our shortcode.
Hope this helps.
Thanks