Ah so the problem is that the supply of houses is very limited and prices are dictated by amount average house buyer for specific house can afford. It makes sense.

This is another proof why government shouldn't intervene into the market by offering loans or subsidies. Usually what they end up doing is completely opposite of the intention. Instead of subsidizing young buyers to buy homes for less cost, they end up subsidizing the owners of the houses.