weaver bird rectangular frame attractor point panel

Hello, I'm trying to make a facade with weaver bird components in which I'd like to be able to control the size of the apertures by the distance of each panel to the attractor point.

However, I'm having trouble getting each rectangular panel to offset all 4 edges equally, as you may see in the image below the only panel that is doing what I wish is the panel surrounding the attractor point, its offsetting equally on all sides.

I believe it's because each edge gets offset depending on the distance from each vertice to the attractor point.

The only solution I could think of was to some how, create a definition in which the vertices of each panel gets off-set  the same distance as the first or last vertice of each respective panel.