If that works for you, great 
But I must say it looks a bit odd, so having Sizes as a type Colours and Quantities as type Sizes.
I would have thought you would want a data type of something like “Inventory Line”.
This is a combination of SKU, Size, Colour (each with that data type) and has a numeric field called Quantity.
It just looks (to me anyway) that you are going to have difficulty doing updates and searches on something so complex.
You would want to split your “inventory management” (we have x of these SKUs of this colour and size) from your “product management” (This SKU only comes in Blue and Red).
Trying to squeeze both product structure/rules and inventory into a single structure may prove tricky.