Simplify polyline problem

I have a problem with simplifying the offsetted polylines. There is one piont on each curve just won't go away. I guess it has something to do with the start/end point. Does anyone have a clue on how to solve this?