Is this normal for a 4-month-old ?

every baby develops differently. although, my only advice is that he may be able to eat the baby food but he still needs most of the nutrients that only formula or breast milk can provide for him. be sure that you still continue to give that to him as a main source of food and the baby food stay as a treat until he is about 7-8 months old.