Both are equally competitive. In TOEFL, especially the computer based, time is of utmost value. You hardly can digress from your concentration as you stand to loose information. Once you click an answer, its done. In speaking also, once the mic is on, you can't stop midway to think.
In IELTS, even though conversation is happening face to face, which is psychologically comforting, the level of questions and grading them is quite complex.
If your English is 7 out of 10, according to you, you may need atleast 2 months proper coaching to obtain a good band score.