How to remove the gritty feeling of granite countertops?

my granite was installed and sealed. it is 4 yrs old and we have never "resealed"it because some people say its not good for the stone. but lately it feels more gritty and porous. can it be buffed shiny and smooth?