Plants vary in shape so always look closely at the blooms, leaves, or size. Recognizing patterns that would be present in their typical coloration can help, too. You could try going by smell if you have the sense for it, but I don't recommend it. Everything must be handled with caution until you're certain it's nontoxic or any toxins will only be dangerous through various methods of contact.