Not forming fruit at all certainly sounds like a pollination problem. The fruit not being as big as it should be may be the plant not being as healthy as it seemed. Check the soil, water supply, and drainage (was there a hole in the bucket?)