Having a difficult time buying a house for the first time? You’re not alone.

New Jersey is listed in the top 10 worst states for first-time homebuyers, according to financial website Moneywise. 

First-time homebuyers in New Jersey face the ninth highest down payment requirement, with an average of a little over $57,000 needed upfront. The median home in New Jersey costs $441,000. Moneywise ranked all 50 states based on the median price for houses as provided by Zillow. The National Association of Realtors says the average down payment percentage is 13%.

The worst states for first-time homebuyers with the highest down payments needed by state are Hawaii at No. 1 and California at No. 2 with nearly $100,000 needed upfront, according to the survey.

The easiest state for first-time homebuyers is West Virginia where a homebuyer only needs a down payment of $17,000, according to the survey.

Moneywise advises those looking to purchase their first home to start saving early. They say determine how much home you can actually afford and figure out the kind of home you need.