.Rproj is fine - it's .Rproj.user that needs to go.

RStudio - the only real R IDE, and an incredibly commonly used environment for R, particularly since it has git support - uses .Rproj files in projects, that follow the pattern projectname.Rproj. Adding *.Rproj to capture these and exclude them.