General caution should be used when spraying an insecticide like Talstar P to certain types of plants, including tropical plants. You may consider using a product like Bonide Systemic Granules which are convenient, ready to use granules that provide effective, long lasting insect control for up to 8 weeks. This product is excellent for indoor houseplant use with no odor, no spray, no mess formula, and is labeled to kill tough houseplant pests like fungus gnats, mealybugs, whiteflies, thrips, and aphids. The s systemic action of this product means that it is absorbed through the roots and moves throughout the plant and even protects new growth.
If you are indeed dealing with boxelder bugs, and what you have described does sound like boxelder bugs, then a product called Talstar P will do a great job for you. Talstar P can be sprayed directly on the plant foliage and it can be used on and in the house. We do recommend that you look up a few pictures of boxelder bugs online just to be sure they match the insect that you have spotted at your home.
You should not spray Talstar P (or allow drift of spray) to contact herbs or any other edibles. If this is not possible, we would not recommend using it in this area.