There are a ton of factors that contribute to BMR, and body fat is certainly one of them. Since muscle tissue is metabolically active tissue, the more muscle you have, the higher your BMR is. If you were to take two 180 pound individuals, one with 12%bf and one with 30%, they would have significantly different BMR's.
I always recommend people who want to track calories to begin by tracking their normal day to day diet. BMR calculators are a good estimate, but are often very inaccurate. I would use a BMR calc as a rough guide, and then use trial and error to determine how many calories you need to maintain your weight. You can start by following the number a calculator gives you, but just know that it is probably high or low, depending on numerous factors (body fat, activity level, macronutrient balance, stress, etc.)