Belly or duodenal ulcer. If you have a belly ulcer or duodenal ulcer, prednisone could make it even worse. Using prednisone with the NSAID (soreness reliever) such as ibuprofen may enhance your possibility of creating or worsening an ulcer. When you have just one of such ulcers, talk with your health practitioner about whether prednisone is best fo