There is a Buddhist temple opposite the store I rented. There's no business since it opened. Does it matter?

It doesn't matter, you are a new store, few people know it, and your business is not well-known in this industry. Business is normal at present. Your own efforts and those related to your business are the quality of your products, the integrity of the merchants, and the opportunities you seize to promote yourself, your business and your team. Has nothing to do with anything else.