If you drive from Neuchâtel-Peseux going West, in the woods before Rochefort follow the signs for l'Aubier- it is a great restaurant- and a fabulous terrasse in the Summer, with great views of the Lake and the Alps- and on the first floor there is a good health food store selling all local produce, as well as Ecover refills for cleaning stuff, etc, and local crafts too.
Very concerned about your baby/toddler though ihtxam- I know you posted that you didn't have health insurance in place- but as you arrived in October, you have till the end of the month to organise this and you are covered for the first 3 months- so please, do not hesitate to go to a doctor's or the the emergency room at the Neuchâtel hospital if fever persists and / or temperature higher than 39ish. Please keep him/her safe.