Last week I attended a conference run by the Tory "Fresh" group Bright Blue. There were plenty of faces I recognised and not all of them belonging to the "left wing" of the Tory party. After a few conversations it had become apparent that there is an anger across all wings of their party regarding the continued employment of George Osborne.

For the Tories, who fancy themselves as the party of fiscal responsibility (though as a Labour party member myself, I remain skeptical), the perception of Osborne's continued weak effort is the source of much frustration.

However to suggest that Osbornomics is the sum total of the financial thinking within the Conservative party would be an error. Take the area of finance that I'm interested in for example, that of personal debt – many in the party who are driven by principle rather than pride tend to sit on the correct side of the tracks here.

Justin Tomlinson MP, for example, the member for North Swindon, is one of the most vocal critics of the payday lending industry in parliament.

Earlier this year he addressed parliament during the debate on the clauses in the Financial Services Bill in support of imposing a total cost cap on loans that lenders can deal out to consumers. This, for him, is one way to ensure exploitative companies don't make life harder of those who are most vulnerable.

But Tomlinson understands that this cannot be a single policy enacted in isolation. This was why he, along with fellow Conservative member of parliament, Andrew Percy, authored a very interesting report on financial education. For them both, more focus on finance early on, can better gear up people when they are older to make healthy financial decisions – which can be hard to come by if times are tough on the pocket with more and more payday lenders popping up on our high streets.

With Percy, his interest in bad debt stems from his own problems with it. Though he has never had to take out a payday loan, he has been in the position of owing tens of thousands of pounds – for which as of 2011 he was still paying off.

"I now pay about £600 a month to clear off all of my credit cards which I've had to roll into a loan since my election", he told the BBC last year.

Another Tory MP, Tracey Crouch, member for Chatham and Aylesford, also came into focusing on debt issues as a consequence of her own past. When I spoke to her earlier this year she told me that her debts were down to "youthful stupidity" and her £15,000 credit card and store card debt was largely the outcome of living a lifestyle she couldn’t afford, which some of her peers could.

Crouch insisted that there is a positive side to credit, indeed most regard it as the sign of a healthy economy. However she herself has seen the negative side of it. She is particularly concerned about those who are termed the "underbanked", namely those those who still have bills to manage and cashflow problems to overcome, but are restricted in their access to mainstream credit products.

Given the rate at which the payday loans industry is growing, the temptation to see this as an easy way out for the very vulnerable increases. The government has a responsibility to do what it can to ensure all consumers do not fall foul to expensive loans, but also many of the barriers of alternatives such as credit unions need to be overcome too.

For example the Association of British Credit Unions (ABCUL) still haven't tapped into social media, and trying to raise credit union membership that way, whereas payday lenders such as Wonga have done this very successfully.

One person who does know a thing or two about credit unions is Damian Hinds MP, the member for East Hampshire. He chairs the All-party Parliamentary Group (APPG) on Credit Unions, and is a vice chairman of the APPG on Debt.

His politics are perhaps most interesting because he is a self-described free-market Conservative. He told me that when he first became an MP he was convinced that market solutions would drive down expensive lenders and anything the state could do would only frustrate this process.

However, he has since changed tack on this, deciding that "normal market rules don't apply with payday lenders". Now Hinds realises that the state can play a part in helping a create a fairer lending market since all evidence points out that the invisible hand is typically absent.

The legacy of Osbornomics will be negative – and Conservatives themselves are as adamant as anyone that this is the case. David Cameron is not being a renegade, but a fool for keeping him. But the Conservative party is not without sound economic minds – and on an issue as important as personal debt this is proven most forcibly.