The answer is yes only if all smaller males were reared under the exact same conditions which is not that easy even in a lab. The size of the male and female over 1 generation means nothing because you do not know if those same conditions it developed under would lead to even smaller adults of a less suited animal. Diet can't make majors if the food is improperly offered or the temperature is off (too high can be as bad as too low).