If you want to stop tracking a file that you commited ages ago (thus not worth fixing with a git rebase), you want to run:

git rm --cached $FILE

Sources: [1]