Even the man of knowledge behaves in conformity with his own nature; beings follow nature; what shall restraint avail?
In plain words: Krishna says even a wise person acts according to their own nature. All beings follow their nature, so just forcing yourself to hold back does not achieve much.