Having trouble inflating/colliding

Hi guys, I wanted to be able to make an inflatable/constrained structure much akin to Kengo Kuma's teahouse, except I wanted to constrain the inflation by placing nearby pillars. So far i can start to add pressure to the mesh but then the simulation runs kinda crazy and just doesn't work. Any help would be greatly appreciated.