Image Sample Hue Value to Point mapping question

Hi, 

I am totally stumped. I have used the image sampler to export the RGB values which I sorted and assigned numbers onto a matrix. I then dispatched the list into separate lists which I wish to use to map and scale polygons to points where the numbers are now. The trouble is, is that there are only values now and I cannot figure out how to transfer the data back into sublists of points. I suppose it is a wonder of how to add points to a whole sublist that do not have coordinates? I know that sounds ridiculous sorry. 

Ultimately I would like to use this on a grayscale image of HUE values and simply assign polygons to different hues, which is why I am taking this approach. Hopefully there is a more efficient method. 

Thank you in advance.