The choice of where to retire can be a challenge. There are so many things to consider.

Will you stay close to family or are you looking for a change of scene?

Of course you also need to consider other important elements. How safe is the city you're thinking of, for instance? How's the health care there? Bankrate.com analyzed nearly 200 cities of varying sizes, taking into account a 2015 poll that asked what people looked for in a retirement destination, as well as the challenges retirees will face in the coming years.

In determining the rankings, it considered the following factors: cost of living, health care quality and affordability, tax burden, weather, crime rate, cultural vitality, walkability and overall well-being.

Here you'll find the cities that Bankrate determined were the 10 worst for retirees, based on the criteria above.

10. New York City

The Big Apple has great walkability and culture, and a low crime rate. But then there are the drawbacks: Very high taxes, a very high cost of living, and below average well-being, weather and, surprisingly, health care mean you might want to think twice before making the city that never sleeps your home in retirement.

9. Little Rock, Ark.

Little Rock does have some advantages: A low cost of living, good health care and good weather.

But beyond that, a very high crime rate, a poor well-being rating, taxes that are only average and below average walkability and culture make for a less than fantastic retirement destination.

8. Worcester, Mass.

A poor weather rating is probably to be expected when a city is ranked low on best places to retire, but Worcester also has high taxes, a high cost of living, and a high crime rate.

Couple that with below average well-being and culture and average health care, and the city's good walkability doesn't count for much—especially in that poor weather.

7. Troy, N.Y.

This Empire State city has an average cost of living, very high taxes and a high crime rate.

While it also boasts a good walkability score and an average culture rating, it has poor weather and below average well-being and health care.

6. Buffalo, N.Y.

Ah, another New York city. Poor Buffalo. A very high crime rate kind of cancels out the great walkability factor, while poor weather and below average well-being, health care and culture pretty much do the same for a low cost of living.

5. Cheektowaga, N.Y.

Pity poor New York. It outdoes Connecticut for the total number of cities making the bottom 10—in fact, it accounts for half the list.

Cheektowaga does its part with four below average ratings: for well-being, walkability, health care, and culture. Despite the fact that crime and the cost of living are low here, taxes are very high and the weather gets a poor rating.

4. San Bernardino, Calif.

One might think that at least some things would be rosy out in California, at least in a few factors beyond the weather (which, despite this city's good ranking, is taking a beating elsewhere in the state at present).

But not so, at least in San Bernardino—where a high cost of living and crime rate, very high taxes and poor culture vie with below average ratings in well-being, walkability and health care.

3. New Haven, Conn.

Poor Connecticut—two cities in the bottom 10. New Haven ranked higher than Milford because it has great walkability—although it also has a high crime rate that may render that advantage moot.

A high cost of living, very high taxes, a poor well-being rating and below average rankings for health care, weather and culture round out this city's demerits.

2. Milford, Conn.

Milford has a few strikes against it as well. In fact, it's easier to list the positives it got in this rating process: a low crime rate.

Other than that, it has a high cost of living, very high taxes, a poor well-being score, and was ranked below average in walkability, weather, health care and culture. Not exactly a sterling recommendation.

1. Niagara Falls, N.Y.

So the honeymoon destination of millions of newlyweds over the decades is actually rated the worst place to retire for folks on the other end of life. That's partly due to its crime rate (very high), its taxes (also very high), and its below average rankings for well-being, health care and culture.

On the flip side, it does have a low cost of living and good walkability. Although, considering winters in that part of New York…well, watch your step.