Leslie Healey was employed by North Yorkshire County Council's Scarborough social services department as a social worker in the Children and Young People's Service from December 2003 until November 2008, when he was dismissed for gross misconduct.
He is accused of pushing a Scarborough social services client – named only as 'Ms A' in documents – to the wall, trying to kiss her and touching her inappropriately.
The incidents took place after he was removed as the woman's social worker.
He is also accused of failing to take appropriate action to safeguard a vulnerable adult.
He is today set to appear before social work regulator the General Social Care Council in London in connection with the Scarborough allegations, and other incidents of sexually-based misconduct involving two other female clients while he was working for Kirklees Metropolitan Borough Council.
The Kirklees allegations cover the period from May 1997 to October 2008. He is accused of having an affair with a client, lending her, or her family, a sum in the region of £5,000, taking her and her children on holidays, and sharing confidential information with her. He also continued to pursue his sexual obsession with her despite direct instructions from management not to do so.
He has also been accused of asking another woman for sex, and a series of other allegations.
A county council spokesman said: "Concern about Mr Healey was first raised with the authority in late 2006, when unproven allegations were made of inappropriate behaviour towards a client – an adult. At a disciplinary hearing in 2007 Mr Healey received a final written warning, as the outcome of the disciplinary process. The General Social Care Council was informed of this action, and began inquiries on its own behalf.
"In October 2008, further concerns came to light in connection with Mr Healey's behaviour. He was again suspended from duty on October 27. One month later, on November 28 2008, Mr Healey was dismissed for gross professional misconduct.
"North Yorkshire County Council has fully supported the General Social Care Council throughout its investigation into the complaints against Mr Healey."
The General Social Care Council regulates the social care workforce in England. It is responsible for ensuring high standards of work in social care. Healey's hearing began today and is scheduled to run for eight days.