A Pepper Plant Question

[AlittleSalt]

I've been watching the hot peppers we planted this year. I've noticed that pepper plants that start setting peppers don't seem to grow taller like the plants that don't have pepper growing on them. I've never had this problem before.

I have read that tomato plants that start producing tomatoes while the plant is small - all the energy goes into producing the fruit instead of growing the plant larger. I'm guess the same holds true for pepper plants. Should I cut the peppers off the plants until the plants grow bigger?

In the first picture is a Thai Chili that is basically the same size as when I planted it back in late March. The second picture is Aji Amarillo, and it is growing more like my pepper plants have in past years. The third picture is a Tabasco plant. It looks healthy and no peppers growing on it. I grew Tabasco plants last year, and they are about the same size this year as they were last year at this time. I've never grown a Thai chili or Aji Amarillo until now.